Do Your Best and Get Enough Rest for Continual Learning