Softmax Attention with Constant Cost per Token