Pre-RMSNorm and Pre-CRMSNorm Transformers: Equivalent and Efficient Pre-LN Transformers Zixuan Jiang, Jiaqi Gu, Hanqing Zhu, David Z. Pan Chandra Department of Electrical and Computer Engineering