Bridging Model-Based Optimization and Generative Modeling via Conservative Fine-Tuning of Diffusion Models

To address this, we introduce a conservative fine-tuning approach, BRAID, by optimizing a conservative reward model, which includes additional penalization outside of offline data distributions.