Continual Learning with Pretrained Backbones by Tuning in the Input Space