When Human Preferences Flip: An Instance-Dependent Robust Loss for RLHF

Open in new window