OntheEffectiveNumberofLinearRegionsinShallow UnivariateReLUNetworks: ConvergenceGuarantees andImplicitBias

Howeverwhat is perhaps more surprising, is that in stark contrast to our classic understanding of generalization in machine learning models, this does not seem to degrade the generalization capabilities of the learned model in spite of the significant increase in its capacity.