Quantizable Transformers: Removing Outliers by Helping Attention Heads Do Nothing Y elysei Bondarenko, Markus Nagel, Tijmen Blankevoort Qualcomm AI Research Amsterdam, The Netherlands