Nevertheless, these methods usually rely on hand-crafted or external subgraph construction, andthesubgraph assembling depends solely onlocal arrangement.
We also nuance the idea that learning happens at the edge of chaos by giving evidence that avery desirable feature forneural networks isthehyperbolicity of their Jacobian at initialization.