Why Adam Works Better with $β_1 = β_2$: The Missing Gradient Scale Invariance Principle

Open in new window