On the Regularity of Attention