Orthogonal Finetuning for Direct Preference Optimization

Open in new window