Fundamental Convergence Analysis of Sharpness-Aware Minimization

Minimization (SAM), a recently proposed gradient-based optimization method [Foret et al., 2021] that significantly improves the generalization of deep neural