Jailbreak Transferability Emerges from Shared Representations
Angell, Rico, Brinkmann, Jannik, He, He
–arXiv.org Artificial Intelligence
Jailbreak transferability is the surprising phenomenon when an adversarial attack compromising one model also elicits harmful responses from other models. Despite widespread demonstrations, there is little consensus on why transfer is possible: is it a quirk of safety training, an artifact of model families, or a more fundamental property of representation learning? We present evidence that transferability emerges from shared representations rather than incidental flaws. Across 20 open-weight models and 33 jailbreak attacks, we find two factors that systematically shape transfer: (1) representational similarity under benign prompts, and (2) the strength of the jailbreak on the source model. To move beyond correlation, we show that deliberately increasing similarity through benign only distillation causally increases transfer. Our qualitative analyses reveal systematic transferability patterns across different types of jailbreaks. For example, persona-style jailbreaks transfer far more often than cipher-based prompts, consistent with the idea that natural-language attacks exploit models' shared representation space, whereas cipher-based attacks rely on idiosyncratic quirks that do not generalize. Together, these results reframe jailbreak transfer as a consequence of representation alignment rather than a fragile byproduct of safety training.
arXiv.org Artificial Intelligence
Oct-30-2025
- Country:
- Asia > Middle East > UAE > Abu Dhabi Emirate > Abu Dhabi (0.14)
- Genre:
- Research Report > New Finding (0.93)
- Industry:
- Government > Military (0.88)
- Information Technology > Security & Privacy (1.00)
- Technology: