Learning Mamba as a Continual Learner