mlsanityData to 7 Oct 2026

Physics-Grounded Motion Forecasting via Equation Discovery for Trajectory-Guided Image-to-Video Generation

arXiv 2507.06830 ↗First posted 9 Jul 2025cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Recent advances in diffusion-based and autoregressive video generation models have achieved remarkable visual realism. However, these models typically lack accurate physical alignment, failing to replicate real-world dynamics in object motion. This limitation arises primarily from their reliance on learned statistical correlations rather than capturing mechanisms adhering to physical laws. To address this issue, we introduce a novel framework that integrates symbolic regression (SR) and trajectory-guided image-to-video (I2V) models for physics-grounded video forecasting. Our approach extracts motion trajectories from input videos, uses a retrieval-based pre-training mechanism to enhance symbolic regression, and discovers equations of motion to forecast physically accurate future trajectories. These trajectories then guide video generation without requiring fine-tuning of existing models. Evaluated on scenarios in Classical Mechanics, including spring-mass, pendulums, and projectile motions, our method successfully recovers ground-truth analytical equations and improves the physical alignment of generated videos over baseline methods.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 27 of its 69 references that are in the map. First posted on arXiv 9 Jul 2025.

Builds on

27 of 69 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  3. 2020Scaling Laws for Neural Language Modelscited by 6,411
  4. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  5. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  6. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  7. 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
  8. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  9. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  10. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
  11. 2022End-to-end symbolic regression with transformerscited by 195
  12. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
15 more
  1. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
  2. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161
  3. 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
  4. 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
  5. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
  6. 2024Symbolic Regression with a Learned Concept Librarycited by 76
  7. 2023Transformer-based Planning for Symbolic Regressioncited by 72
  8. 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
  9. 2022Symbolic Regression is NP-hardcited by 68
  10. 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
  11. 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generationcited by 50
  12. 2023SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified Pre-trainingcited by 41
  13. 2023StoryGPT-V: Large Language Models as Consistent Story Visualizerscited by 25
  14. 2024CausalScore: An Automatic Reference-Free Metric for Assessing Response Relevance in Open-Domain Dialogue Systemscited by 5
  15. 2021Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videoscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.