DeRS: Towards Extremely Efficient Upcycled Mixture-of-Experts Models