KL-Regularized RLHF with Multiple Reference Models: Exact Solutions and Sample Complexity

Open in new window