Mixture of Sparse Attention: Content-Based Learnable Sparse Attention via Expert-Choice Routing

Open in new window