Non-convex Finite-Sum Optimization Via SCSG Methods

Moreover, SCSG is never worse than the state-of-the-art methods based on variance reduction and it significantly outperforms them when the target accuracy is low.