mlsanityData to 7 Oct 2026

Learning Explicit Physical Parameter Control and Benchmarking for Video Generation

arXiv 2607.18924 ↗First posted 21 Jul 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Recent advances in image-to-video generation have improved visual realism, making physically grounded and controllable dynamics an important step toward future world simulation. Current models often generate plausible motion, but it is not reliably governed by explicit physical causes, and instance-level constraints can leak or become entangled in multi-object interactions. We attribute this gap to two missing pieces: large-scale, fine-grained physical parameterization, and model designs that correctly bind physical attributes to instances and emphasize dynamics over appearance. To bridge this gap, we introduce PhyParam-Dataset, an interaction-centric collection of 130K physically simulated videos with dense physical parameterization, including force vectors, object material properties, and environmental constants across five representative rigid-body motion types. Built on this data, we present PhyParam, a physics-guided image-to-video diffusion model that conditions on object-level forces, masses, friction, restitution, and scene-level gravity via a lightweight physical-attention routing mechanism, and further improves motion learning with semantic-structural feature-space supervision. We also establish PhyParam-Bench, a benchmark for physical-law consistency in image-to-video generation, with a multi-level protocol evaluating temporal dynamics, spatial stability, and semantic--physical alignment. Experiments show that PhyParam improves physical consistency while maintaining high visual fidelity, advancing explicit rigid-body physical-parameter control for image-to-video generation. We will publicly release the dataset, benchmark, and code to support future research.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 53 of its 63 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

53 of 63 references.

References · 53

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2023Segment Anythingcited by 8,158
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2025Qwen2.5-VL Technical Reportcited by 5,418
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  12. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
38 more
  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2025DINOv3cited by 1,297
  4. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  5. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  6. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  7. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  8. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  9. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  10. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  11. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
  12. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  13. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  14. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  15. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
  16. 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
  17. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
  18. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
  19. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
  20. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161
  21. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
  22. 2025Do generative video models understand physical principles?cited by 151
  23. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
  24. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
  25. 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
  26. 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 54
  27. 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signalscited by 51
  28. 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 49
  29. 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 48
  30. 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
  31. 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 43
  32. 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 40
  33. 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
  34. 2025NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generationcited by 21
  35. 2024InterDyn: Controllable Interactive Dynamics with Video Diffusion Modelscited by 11
  36. 2025MirrorVerse: Pushing Diffusion Models to Realistically Reflect the Worldcited by 8
  37. 2025C-Drag: Chain-of-Thought Driven Motion Controller for Video Generationcited by 6
  38. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
  2. 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation
  3. 2026StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actions
  4. 2026PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment
  5. 2025Learning to Generate Rigid Body Interactions with Video Diffusion Models
  6. 2026ACWM-Phys: Investigating Generalized Physical Interaction in Action-Conditioned Video World Models
  7. 2025PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learning
  8. 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization