light-tail assumption
Technology: Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (0.51)
abd1c782880cc59759f4112fda0b8f98-AuthorFeedback.pdf
We thank the reviewers for their feedback and time! We are encouraged they found our theoretical results "impressive" Large batchsizes help us to obtain complexity guarantees beating the state-of-the-art ones. We can add these details to the main body using an additional 9th page. We agree with this criticism. We will try to test our methods on this task and investigate the heavy-tailedness of stochastic gradients for this problem. Simsekli et al. focus on non-convex problems and rates of convergence in expectation .