SCALE: Upscaled Continual Learning of Large Language Models