Review for NeurIPS paper: Quantitative Propagation of Chaos for SGD in Wide Neural Networks

In a nutshell the authors bound the distance between SGD iterates and that of the mean field dynamic. Using this theory the authors also study the effect of the scaling of the step size. All reviewers thought the paper was interesting, in particular the regime change result. Reviewer 2 had some concerns about the strictness of the assumptions which were mitigated based on the authors' response. I concur with the positive reviews and recommend the paper to be accepted.