A multifidelity approach to continual learning for physical systems