Connect Later: Improving Fine-tuning for Robustness with Targeted Augmentations