PhysChoreo: Physics-Controllable Video Generation with Part-Aware Semantic Grounding
Not on the map. Why?
Abstract (arXiv)
While recent video generation models have achieved significant visual fidelity, they often suffer from the lack of explicit physical controllability and plausibility. To address this, some recent studies attempted to guide the video generation with physics-based rendering. However, these methods face inherent challenges in accurately modeling complex physical properties and effectively control ling the resulting physical behavior over extended temporal sequences. In this work, we introduce PhysChoreo, a novel framework that can generate videos with diverse controllability and physical realism from a single image. Our method consists of two stages: first, it estimates the static initial physical properties of all objects in the image through part-aware physical property reconstruction. Then, through temporally instructed and physically editable simulation, it synthesizes high-quality videos with rich dynamic behaviors and physical realism. Experimental results show that PhysChoreo can generate videos with rich behaviors and physical realism, outperforming state-of-the-art methods on multiple evaluation metrics.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 45 of its 57 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
45 of 57 references.
References · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023Segment Anythingcited by 8,234
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2020Point Transformercited by 1,470
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
33 more
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 258
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2025Video models are zero-shot learners and reasonerscited by 220
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
- 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Modelscited by 181
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 118
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 95
- 2025OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generationcited by 69
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
- 2025MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidancecited by 61
- 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signalscited by 53
- 2024Physical Property Understanding from Language-Embedded Feature Fieldscited by 48
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 45
- 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 42
- 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priorscited by 41
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generationcited by 41
- 2024PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulationcited by 36
- 2025PUGS: Zero-shot Physical Understanding with Gaussian Splattingcited by 24
- 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 24
- 2025UniPhy: Learning a Unified Constitutive Model for Inverse Physics Simulationcited by 12
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026NEWTON: Agentic Planning for Physically Grounded Video Generationcited by 12
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine Systemcited by 8
- 2026PhysAgent: Automating Physics-Based 4D Synthesis via Trajectory-Grounded Multi-Agent Feedbackcited by 5
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generationcited by 4
- 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Modelscited by 2
- 2026PhysWeep: Does a Video Generator Realize the Physics You Ask For?cited by 2
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generationcited by 0
- 2026VIPER: Visual In-Context Physics Reasoning for Physically Plausible Video Generationcited by 0
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioningcited by 0
- 2026PhysWeep: Does a Video Generator Realize the Physics You Ask For?5 Sep 2026
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning1 Sep 2026
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System29 Jul 2026
- 2026VIPER: Visual In-Context Physics Reasoning for Physically Plausible Video Generation26 Jul 2026
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation25 Jun 2026
- 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models25 Jun 2026
- 2026PhysAgent: Automating Physics-Based 4D Synthesis via Trajectory-Grounded Multi-Agent Feedback7 Jun 2026
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation22 May 2026
- 2026NEWTON: Agentic Planning for Physically Grounded Video Generation18 May 2026