Physics-Grounded Motion Forecasting via Equation Discovery for Trajectory-Guided Image-to-Video Generation
Not on the map. Why?
Abstract (arXiv)
Recent advances in diffusion-based and autoregressive video generation models have achieved remarkable visual realism. However, these models typically lack accurate physical alignment, failing to replicate real-world dynamics in object motion. This limitation arises primarily from their reliance on learned statistical correlations rather than capturing mechanisms adhering to physical laws. To address this issue, we introduce a novel framework that integrates symbolic regression (SR) and trajectory-guided image-to-video (I2V) models for physics-grounded video forecasting. Our approach extracts motion trajectories from input videos, uses a retrieval-based pre-training mechanism to enhance symbolic regression, and discovers equations of motion to forecast physically accurate future trajectories. These trajectories then guide video generation without requiring fine-tuning of existing models. Evaluated on scenarios in Classical Mechanics, including spring-mass, pendulums, and projectile motions, our method successfully recovers ground-truth analytical equations and improves the physical alignment of generated videos over baseline methods.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 27 of its 69 references that are in the map. First posted on arXiv 9 Jul 2025.
Builds on
27 of 69 references.
References · 27
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2022End-to-end symbolic regression with transformerscited by 195
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
15 more
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
- 2024Symbolic Regression with a Learned Concept Librarycited by 76
- 2023Transformer-based Planning for Symbolic Regressioncited by 72
- 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
- 2022Symbolic Regression is NP-hardcited by 68
- 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
- 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generationcited by 50
- 2023SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified Pre-trainingcited by 41
- 2023StoryGPT-V: Large Language Models as Consistent Story Visualizerscited by 25
- 2024CausalScore: An Automatic Reference-Free Metric for Assessing Response Relevance in Open-Domain Dialogue Systemscited by 5
- 2021Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videoscited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 40
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generationcited by 3
- 2026NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamicscited by 1
- 2026Phase-aware video generation for physics-grounded dynamics and interactionscited by 0
- 2026Phase-aware video generation for physics-grounded dynamics and interactions8 Oct 2026
- 2026NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamics12 Jun 2026
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generation3 Dec 2025
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamics25 Sep 2025