Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging

Open in new window