Control Batch Size and Learning Rate to Generalize Well: Theoretical and Empirical Evidence

LetS bethe independently {1,2,...,}, whereN is Thensimilar S is ˆgS( (t)) =r (t) ˆR( (t)) = 1 |S| X International [12] K. He, Confer [13] K. He, confer, 2016.