Data Diversity Matters for Robust Instruction Tuning