Efficient Continual Adaptation for Generative Adversarial Networks