Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Open in new window