Top-Theta Attention: Sparsifying Transformers by Compensated Thresholding

Open in new window