Adaptive Slimming for Scalable and Efficient Speech Enhancement