The Underlying Correlated Dynamics in Neural Training