Multiverse: Your Language Models Secretly Decide How to Parallelize and Merge Generation

Neural Information Processing Systems 

Inspired by this, we introduce Multiverse, a new generative model enabling natively parallel generation.