Large Catapults in Momentum Gradient Descent with Warmup: An Empirical Study

Open in new window