Deep linear networks for regression are implicitly regularized towards flat minima

The largest eigenvalue of the Hessian, or sharpness, of neural networks is a key quantity to understand their optimization dynamics.