Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Open in new window