Dynamic Mixture of Experts Against Severe Distribution Shifts