Hybrid Preference Optimization: Augmenting Direct Preference Optimization with Auxiliary Objectives

Open in new window