Enhancing Scene Transition Awareness in Video Generation via Post-Training
Shen, Hanwen, Lu, Jiajie, Cao, Yupeng, Yang, Xiaonan
–arXiv.org Artificial Intelligence
Recent advances in AI-generated video have shown strong performance on \emph{text-to-video} tasks, particularly for short clips depicting a single scene. However, current models struggle to generate longer videos with coherent scene transitions, primarily because they cannot infer when a transition is needed from the prompt. Most open-source models are trained on datasets consisting of single-scene video clips, which limits their capacity to learn and respond to prompts requiring multiple scenes. Developing scene transition awareness is essential for multi-scene generation, as it allows models to identify and segment videos into distinct clips by accurately detecting transitions. To address this, we propose the \textbf{Transition-Aware Video} (TAV) dataset, which consists of preprocessed video clips with multiple scene transitions. Our experiment shows that post-training on the \textbf{TAV} dataset improves prompt-based scene transition understanding, narrows the gap between required and generated scenes, and maintains image quality.
arXiv.org Artificial Intelligence
Jul-25-2025
- Country:
- Asia > Middle East
- Republic of Türkiye > Batman Province > Batman (0.04)
- North America
- Canada
- British Columbia > Vancouver (0.04)
- Rocky Mountains (0.04)
- United States
- Arizona > Maricopa County
- Phoenix (0.04)
- California > San Francisco County
- San Francisco (0.14)
- Michigan > Wayne County
- Detroit (0.04)
- Rocky Mountains (0.04)
- Arizona > Maricopa County
- Canada
- South America > Chile
- Asia > Middle East
- Genre:
- Research Report > New Finding (0.68)
- Technology: