The Marginal Value of Momentum for Small Learning Rate SGD

Open in new window