Learning Explicit Physical Parameter Control and Benchmarking for Video Generation
Not on the map. Why?
Abstract (arXiv)
Recent advances in image-to-video generation have improved visual realism, making physically grounded and controllable dynamics an important step toward future world simulation. Current models often generate plausible motion, but it is not reliably governed by explicit physical causes, and instance-level constraints can leak or become entangled in multi-object interactions. We attribute this gap to two missing pieces: large-scale, fine-grained physical parameterization, and model designs that correctly bind physical attributes to instances and emphasize dynamics over appearance. To bridge this gap, we introduce PhyParam-Dataset, an interaction-centric collection of 130K physically simulated videos with dense physical parameterization, including force vectors, object material properties, and environmental constants across five representative rigid-body motion types. Built on this data, we present PhyParam, a physics-guided image-to-video diffusion model that conditions on object-level forces, masses, friction, restitution, and scene-level gravity via a lightweight physical-attention routing mechanism, and further improves motion learning with semantic-structural feature-space supervision. We also establish PhyParam-Bench, a benchmark for physical-law consistency in image-to-video generation, with a multi-level protocol evaluating temporal dynamics, spatial stability, and semantic--physical alignment. Experiments show that PhyParam improves physical consistency while maintaining high visual fidelity, advancing explicit rigid-body physical-parameter control for image-to-video generation. We will publicly release the dataset, benchmark, and code to support future research.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 53 of its 63 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
53 of 63 references.
References · 53
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023Segment Anythingcited by 8,158
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
38 more
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2025DINOv3cited by 1,297
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
- 2025Do generative video models understand physical principles?cited by 151
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
- 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
- 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 54
- 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signalscited by 51
- 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 49
- 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 48
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 43
- 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 40
- 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
- 2025NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generationcited by 21
- 2024InterDyn: Controllable Interactive Dynamics with Video Diffusion Modelscited by 11
- 2025MirrorVerse: Pushing Diffusion Models to Realistically Reflect the Worldcited by 8
- 2025C-Drag: Chain-of-Thought Driven Motion Controller for Video Generationcited by 6
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Modelscited by 0
- 2026Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Modelcited by 0
- 2026PhysicsLENS: Diagnosing Physical Property Blindness in Video Generation Modelscited by 0
- 2026PhysicsLENS: Diagnosing Physical Property Blindness in Video Generation Models1 Oct 2026
- 2026Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Model30 Sep 2026
- 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models20 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation
- 2026StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actions
- 2026PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment
- 2025Learning to Generate Rigid Body Interactions with Video Diffusion Models
- 2026ACWM-Phys: Investigating Generalized Physical Interaction in Action-Conditioned Video World Models
- 2025PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learning
- 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization