Direct Preference Optimization: Your Language Model is Secretly a Reward Model

Open in new window