Error estimates between SGD with momentum and underdamped Langevin diffusion
Guillin, Arnaud, Wang, Yu, Xu, Lihu, Yang, Haoran
Stochastic gradient descent with momentum is a popular variant of stochastic gradient descent, which has recently been reported to have a close relationship with the underdamped Langevin diffusion. In this paper, we establish a quantitative error estimate between them in the 1-Wasserstein and total variation distances.
Oct-22-2024
- Country:
- Asia
- China
- Beijing > Beijing (0.04)
- Guangdong Province > Zhuhai (0.04)
- Macao (0.04)
- Middle East > Jordan (0.04)
- China
- Europe > France (0.04)
- North America > United States
- Florida > Palm Beach County
- Boca Raton (0.04)
- New York (0.04)
- Florida > Palm Beach County
- Asia
- Genre:
- Research Report (0.63)
- Technology: