Review for NeurIPS paper: Why are Adaptive Methods Good for Attention Models?

There was a reasonable amount of discussion about this paper. The author feedback clarified a variety of issues which caused some reviewers to increase their scores, while some of the discussion caused other reviewers to decrease their scores. Although there was one holdout, the majority of the reviewers leaned towards rejection of the paper. However, I believe this is one of the rare cases where the AC should recommend for the PC to accept the paper against the recommendations of the reviewers. The main reason I'm recommending acceptance is due to the broader context and potential impact of the paper.