MoNE: Replacing Redundant Experts with Lightweight Novices for Structured Pruning of MoE

Open in new window