First Exit Time Analysis of Stochastic Gradient Descent Under Heavy-Tailed Gradient Noise
Thanh Huy Nguyen, Umut Simsekli, Mert Gurbuzbalaban, Gaël RICHARD
–Neural Information Processing Systems
In this study, we provide formal theoretical analysis where we derive explicit conditions for the step-size such that the metastability behavior of the discrete-time system is similar to its continuous-time limit.
Neural Information Processing Systems
Aug-19-2025, 22:59:02 GMT
- Country:
- North America
- United States (0.04)
- Canada (0.04)
- Europe
- United Kingdom > England
- Oxfordshire > Oxford (0.14)
- Cambridgeshire > Cambridge (0.04)
- France > Île-de-France
- United Kingdom > England
- Asia > Japan
- Honshū > Kansai > Osaka Prefecture > Osaka (0.04)
- North America
- Genre:
- Research Report > New Finding (0.48)
- Technology: