Almost Surely Asymptotic Freeness for Jacobian Spectrum of Deep Network

Free probability theory helps us to understand Jacobian spe ctrum of deep neural networks. We rigorously show almost surely asymptot ic freeness of layer-wise Jacobians.