On the Loss Landscape of Adversarial Training: Identifying Challenges and How to Overcome Them Chen Liu

To this end, we first provide analytical studies of the properties of adversarial loss functions under different adversarial budgets. We then demonstrate that the adversarial loss landscape is less favorable to optimization, due to increased curvature and more scattered gradients.