Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Open in new window