Bezier Distillation
–arXiv.org Artificial Intelligence
In Rectified Flow, by obtaining the rectified flow several times, the mapping relationship between distributions can be distilled into a neural network, and the target distribution can be directly predicted by the straight lines of the flow. However, during the pairing process of the mapping relationship, a large amount of error accumulation will occur, resulting in a decrease in performance after multiple rectifications. In the field of flow models, knowledge distillation of multi - teacher diffusion models is also a problem worthy of discussion in accelerating sampling. I intend to combine multi - teacher knowledge distillation with Bezier curves to solve the problem of error accumulation. Currently, the related paper is being written by myself.
arXiv.org Artificial Intelligence
Mar-20-2025
- Country:
- North America > Canada
- Europe > Italy
- Calabria > Catanzaro Province > Catanzaro (0.04)
- Asia > China
- Guangdong Province (0.04)
- Genre:
- Research Report (0.40)
- Technology: