Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD than Constant Stepsize

Open in new window