Longer contexts present a new attack surface for adversarial attacks. In search of a "fruit-fly" of long-context vulnerabilities, we study Many-shot Jailbreaking (MSJ; Figure 1), a simple yet effective and scalable jailbreak.
Unlike the classic utility maximizers who maximize their quasi-linear utility given by the difference between value and payment, value maximizers maximize the total value subject to a return-on-spend (RoS) constraint [Balseiro et al., 2021b].