A Unified Theoretical Analysis of Private and Robust Offline Alignment: from RLHF to DPO

Open in new window