AnimateDiff-Lightning: Cross-Model Diffusion Distillation

Video generative models are gaining great attention We present AnimateDiff-Lightning for lightning-fast lately. Text-to-video models [2-4, 6, 8, 30, 36, 44] allow the video generation. Our model uses progressive adversarial creation of videos straight from ideation; image-to-video diffusion distillation to achieve new state-of-the-art in models [2, 4, 6, 36] enable more fine-grained control over few-step video generation. We discuss our modifications to content and composition; video-to-video models [4, 6] can adapt it for the video modality. Furthermore, we propose to convert existing videos to different styles, such as anime or simultaneously distill the probability flow of multiple base cartoon. The advancement in video generation has enabled diffusion models, resulting in a single distilled motion module brand-new creative possibilities.