AdamS: Momentum Itself Can Be A Normalizer for LLM Pretraining and Post-training

Open in new window