Dynamical Isometry is Achieved in Residual Networks in a Universal Way for any Activation Function

Open in new window