Analysis of Krylov Subspace Solutions of Regularized Non-Convex Quadratic Problems

Yair Carmon, John C. Duchi

Neural Information Processing Systems 

We provide convergence rates for Krylov subspace solutions to the trust-region and cubic-regularized (nonconvex) quadratic problems. Such solutions may be efficiently computed by the Lanczos method and have long been used in practice.