Fast Attention Requires Bounded Entries