Multiple Descent: Design Y our Own Generalization Curve

This paper explores the generalization loss of linear regression in variably param-eterized families of models, both under-parameterized and over-parameterized. We show that the generalization curve can have an arbitrary number of peaks, and moreover, locations of those peaks can be explicitly controlled.