Gradient Descent Converges to Minimizers
Lee, Jason D., Simchowitz, Max, Jordan, Michael I., Recht, Benjamin
We show that gradient descent converges to a local minimizer, almost surely with random initialization. This is proved by applying the Stable Manifold Theorem from dynamical systems theory.
Mar-4-2016