On Uniform Convergence and Low-Norm Interpolation Learning

In the past several years, it has become empirically clear that - contrary to traditional intuition - it is possible for models which exactly interpolate noisy training data to reliably generalize well on practical problems, especially in deep learning [7, 25, 34].