Load Balancing Mixture of Experts with Similarity Preserving Routers

Open in new window