Continual Learning for Multiple Modalities