Motion Forcing: A Decoupled Framework for Robust Video Generation in Motion Dynamics
Not on the map. Why?
Abstract (arXiv)
The ultimate goal of video generation is to satisfy a fundamental trilemma: achieving high visual quality, maintaining rigorous physical consistency, and enabling precise controllability. While recent models can maintain this balance in simple, isolated scenarios, we observe that this equilibrium is fragile and often breaks down as scene complexity increases (e.g., involving collisions or dense traffic). To address this, we introduce Motion Forcing, a framework designed to stabilize this trilemma even in complex generative tasks. Our key insight is to explicitly decouple physical reasoning from visual synthesis via a hierarchical ``Point-Shape-Appearance'' paradigm. This approach decomposes generation into verifiable stages: modeling complex dynamics as sparse geometric anchors (Point), expanding them into dynamic depth maps that explicitly resolve 3D geometry (Shape), and finally rendering high-fidelity textures (Appearance). Furthermore, to foster robust physical understanding, we employ a Masked Point Recovery strategy. By randomly masking input anchors during training and enforcing the reconstruction of complete dynamic depth, the model is compelled to move beyond passive pattern matching and learn latent physical laws (e.g., inertia) to infer missing trajectories. Extensive experiments on autonomous driving benchmarks show that Motion Forcing significantly outperforms state-of-the-art baselines, maintaining trilemma stability across complex scenes. Evaluations on physics and robotics further confirm our framework's generality.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 52 of its 55 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
52 of 55 references.
References · 52
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
38 more
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
- 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 261
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 191
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2025Do generative video models understand physical principles?cited by 161
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2024GenAD: Generalized Predictive Model for Autonomous Drivingcited by 150
- 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 98
- 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 89
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 89
- 2023DrivingDiffusion: Layout-Guided multi-view driving scene video generation with latent diffusion modelcited by 75
- 2024MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenescited by 71
- 2024Vlogger: Make Your Dream A Vlogcited by 70
- 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
- 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 58
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 46
- 2024Moonshot: Towards Controllable Video Generation and Editing with Multimodal Conditionscited by 42
- 2024DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Modelcited by 25
- 2025GeoDrive: 3D Geometry-Informed Driving World Model with Precise Action Controlcited by 19
- 20254D Driving Scene Generation With Stereo Forcingcited by 8
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.