Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks

Yuanzhi Li, Colin Wei, Tengyu Ma

Aug-20-2025, 00:46:33 GMT–Neural Information Processing Systems

Neural Information Processing Systems http://nips.cc/

artificial intelligence, learning rate, machine learning, (17 more...)

Neural Information Processing Systems

Aug-20-2025, 00:46:33 GMT

Conferences PDF

Country:
- North America
  - Canada
    - British Columbia > Metro Vancouver Regional District
      - Vancouver (0.04)
    - Ontario > Toronto (0.14)
  - United States
    - California > Santa Clara County
      - Palo Alto (0.04)
    - Pennsylvania > Allegheny County
      - Pittsburgh (0.04)

Technology:
- Information Technology > Artificial Intelligence > Machine Learning
  - Neural Networks > Deep Learning (0.46)
  - Statistical Learning > Gradient Descent (0.31)