BoNBoN Alignment for Large Language Models and the Sweetness of Best-of-n Sampling Lin Gui 1, Cristina Gârbacea 2, and Victor V eitch 1,2 1 Department of Statistics, University of Chicago 2