Exact expressions for double descent and implicit regularization via surrogate random design

It has been shown that models such as deep neural networks, as well as certain so-called interpolating kernels and decision trees, can generalize well in this regime.