Lifelong Safety Alignment for Language Models

Neural Information Processing Systems 

LLMs have made impressive progress, but their growing capabilities also expose them to highly flexible jailbreaking attacks designed to bypass safety alignment. While many existing defenses focus on known types of attacks, it is more critical to prepare LLMs for attacks that may arise during deployment.