ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing

Open in new window