Third-order Smoothness Helps: Faster Stochastic Optimization Algorithms for Finding Local Minima
Yaodong Yu, Pan Xu, Quanquan Gu
–Neural Information Processing Systems
We propose stochastic optimization algorithms that can find local minima faster than existing algorithms for nonconvex optimization problems, by exploiting the third-order smoothness to escape non-degenerate saddle points more efficiently.
Neural Information Processing Systems
Mar-27-2025, 05:47:50 GMT