Beyond Gaussian Processes: On the Distributions of Infinite Networks

A general analysis of the limiting distribution of neural network functions is performed, with emphasis on non-Gaussian limits. We show that with i.i.d.