Direct Preference Optimization with Unobserved Preference Heterogeneity: The Necessity of Ternary Preferences