AdamHD: Decoupled Huber Decay Regularization for Language Model Pre-Training

Open in new window