Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes

Neural Information Processing Systems 

The mixed regime is the'best of both worlds': it converges