A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation

Open in new window