Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks Physics & Informatics Laboratories, NTT Research, Inc., Sunnyvale, CA, USA Stanford University, Stanford, CA, USA