Catastrophic Goodhart: regularizing RLHF with KL divergence does not mitigate heavy-tailed reward misspecification

Open in new window

The document is on a web server that cannot be reached. Please try again later.