FreeProbabilityforpredictingtheperformanceof feed-forwardfullyconnectedneuralnetworks

We also nuance the idea that learning happens at the edge of chaos by giving evidence that avery desirable feature forneural networks isthehyperbolicity of their Jacobian at initialization.