Clean First, Align Later: Benchmarking Preference Data Cleaning for Reliable LLM Alignment

Open in new window