Review for NeurIPS paper: An Improved Analysis of Stochastic Gradient Descent with Momentum
–Neural Information Processing Systems
Weaknesses: The ideas of the paper could be interesting however the paper loses some points in terms of presentation. Also some claims are not really justified. For example the title mentioned "An Improved Analysis" but it was never really explained in detail why the proposed analysis justifies the word "improved". There are some limitations of existing papers in the Intro but this should be more clear in the main contributions of the work. In line 74, the authors mentioned: "To the best of our knowledge, this is the first convergence (and acceleration) guarantee for SGDM in the multistage setting."
Neural Information Processing Systems
Feb-6-2025, 16:50:48 GMT
- Technology: