CLUES: Collaborative Private-domain High-quality Data Selection for LLMs via Training Dynamics

Experiments show that training on the high-quality data selected by our method can often outperform other data selection methods for collaborative fine-tuning of LLMs, across diverse private domain datasets, in medical, multilingual and financial settings.