Mean Field Residual Networks: On the Edge of Chaos

Neural Information Processing Systems 

We study randomly initialized residual networks using mean field theory and the theory of difference equations.