Robustness Analysis of Non-Convex Stochastic Gradient Descent using Biased Expectations

Third, the probabilistic bounds we obtain for SGD (i.e., on quantiles) provide novel insights over the previously known in-expectation