Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks

In two layer networks, we show how feature learning can dynamically reduce the variance of the final tangent kernel and final network predictions.