On the Robustness Tradeoff in Fine-Tuning