Average-Hard Attention Transformers are Constant-Depth Uniform Threshold Circuits

Open in new window