Mean Flows for One-step Generative Modeling
Geng, Zhengyang, Deng, Mingyang, Bai, Xingjian, Kolter, J. Zico, He, Kaiming
–arXiv.org Artificial Intelligence
We propose a principled and effective framework for one-step generative modeling. We introduce the notion of average velocity to characterize flow fields, in contrast to instantaneous velocity modeled by Flow Matching methods. A well-defined identity between average and instantaneous velocities is derived and used to guide neural network training. Our method, termed the MeanFlow model, is self-contained and requires no pre-training, distillation, or curriculum learning. MeanFlow demonstrates strong empirical performance: it achieves an FID of 3.43 with a single function evaluation (1-NFE) on ImageNet 256x256 trained from scratch, significantly outperforming previous state-of-the-art one-step diffusion/flow models. Our study substantially narrows the gap between one-step diffusion/flow models and their multi-step predecessors, and we hope it will motivate future research to revisit the foundations of these powerful models.
arXiv.org Artificial Intelligence
May-20-2025
- Country:
- Europe
- Switzerland > Vaud
- Lausanne (0.04)
- United Kingdom > North Sea
- Southern North Sea (0.04)
- Switzerland > Vaud
- North America
- Canada > Ontario
- Toronto (0.04)
- United States > Montana
- Roosevelt County (0.04)
- Canada > Ontario
- Europe
- Genre:
- Research Report (0.82)
- Technology: