LIMIT: Less Is More for Instruction Tuning Across Evaluation Paradigms