COLD Decoding: Energy-based Constrained Text Generation with Langevin Dynamics Lianhui Qin 1 Sean Welleck 12 Daniel Khashabi 3

Many applications of text generation require incorporating different constraints to control the semantics or style of generated text. These constraints can be hard (e.g., ensuring certain keywords are included in the output) and soft (e.g., contextualizing the output with the left-or right-hand context).