Direct Preference-based Policy Optimization without Reward Modeling

Instead, we propose a PbRL algorithm that directly learns from preference without requiring any reward modeling.