Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup

Sebastian Goldt, Madhu Advani, Andrew M. Saxe, Florent Krzakala, Lenka Zdeborová

Aug-20-2025, 02:11:13 GMT–Neural Information Processing Systems 

Deep neural networks behind state-of-the-art results in image classification and other domains have one thing in common: their size.