Towards Robust and Efficient Continual Language Learning