Gradient Imbalance in Direct Preference Optimization

Open in new window