SimPO: Simple Preference Optimization with a Reference-Free Reward

Open in new window