Improving Generalization and Convergence by Enhancing Implicit Regularization Mingze Wang 1,3, Jinbo Wang 1, 3 Haotian He1,3 Zilin Wang 1

Neural Information Processing Systems 

We show that IRE can be practically incorporated with generic base optimizers without introducing significant computational overload.