Forget but Recall: Incremental Latent Rectification in Continual Learning