A Multi-step Inertial Forward-Backward Splitting Method for Non-convex Optimization
Jingwei Liang, Jalal Fadili, Gabriel Peyré
–Neural Information Processing Systems
We propose a multi-step inertial Forward-Backward splitting algorithm for minimizing the sum of two non-necessarily convex functions, one of which is proper lower semi-continuous while the other is differentiable with a Lipschitz continuous gradient. We first prove global convergence of the algorithm with the help of the Kurdyka-Łojasiewicz property. Then, when the non-smooth part is also partly smooth relative to a smooth submanifold, we establish finite identification of the latter and provide sharp local linear convergence analysis. The proposed method is illustrated on several problems arising from statistics and machine learning.
Neural Information Processing Systems
Jan-20-2025, 21:50:39 GMT