SimPO: Simple Preference Optimization with a Reference-Free Reward 2 1

Open in new window