SWAN: SGD with Normalization and Whitening Enables Stateless LLM Training

Open in new window