Physics-Grounded Motion Forecasting via Equation Discovery for Trajectory-Guided Image-to-Video Generation
Feng, Tao, Zhao, Xianbing, Chen, Zhenhua, Wong, Tien Tsin, Rezatofighi, Hamid, Haffari, Gholamreza, Qu, Lizhen
–arXiv.org Artificial Intelligence
Recent advances in diffusion-based and autoregressive video generation models have achieved remarkable visual realism. However, these models typically lack accurate physical alignment, failing to replicate real-world dynamics in object motion. This limitation arises primarily from their reliance on learned statistical correlations rather than capturing mechanisms adhering to physical laws. To address this issue, we introduce a novel framework that integrates symbolic regression (SR) and trajectory-guided image-to-video (I2V) models for physics-grounded video forecasting. Our approach extracts motion trajectories from input videos, uses a retrieval-based pre-training mechanism to enhance symbolic regression, and discovers equations of motion to forecast physically accurate future trajectories. These trajectories then guide video generation without requiring fine-tuning of existing models. Evaluated on scenarios in Classical Mechanics, including spring-mass, pendulums, and projectile motions, our method successfully recovers ground-truth analytical equations and improves the physical alignment of generated videos over baseline methods.
arXiv.org Artificial Intelligence
Jul-10-2025
- Country:
- North America > United States
- Minnesota (0.28)
- Asia > Middle East
- UAE (0.28)
- North America > United States
- Genre:
- Research Report (0.83)
- Industry:
- Energy (0.46)
- Technology:
- Information Technology > Artificial Intelligence
- Vision (1.00)
- Representation & Reasoning (1.00)
- Natural Language (1.00)
- Machine Learning
- Evolutionary Systems (0.94)
- Neural Networks > Deep Learning (0.47)
- Information Technology > Artificial Intelligence