Asymptotics of Bayesian Uncertainty Estimation in Random Features Regression

One of the most surprising empirical observations in deep learning is the generalization of overpa-rameterized models that can perfectly interpolate the data. The "double descent" curve, referring to the test error first increasing then decreasing with model complexity, has been both empirically and