Adapt before Continual Learning