Direct Preference Optimization with Unobserved Preference Heterogeneity: The Necessity of Ternary Preferences

Open in new window