Preserving Domain Generalization in Fine-Tuning via Joint Parameter Selection