Escaping Saddle-Point Faster under Interpolation-like Conditions

One of the fundamental aspects of over-parametrized models is that they are capable of interpolating the training data.