CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generation
On the map: LLM reasoning → Spatial and embodied reasoning
also in 2 more
Abstract (arXiv)
Recent advances in diffusion-based video generation have significantly improved visual quality and short-term temporal coherence. However, existing methods still struggle to produce videos with physically consistent and causally plausible dynamics, especially in scenarios involving long-horizon interactions. This limitation arises from the fact that video diffusion models primarily learn physical consistency implicitly, while vision-language models can directly model physical laws. Based on this idea, in this work, we propose CausalMotion, a training-free framework that injects explicit physical reasoning into video generation through structured intermediate representations. Our key idea is to decouple reasoning from generation by leveraging a vision-language model to decompose a text prompt into a sequence of causally consistent keyframes and object-centric motion trajectories. These representations are then aligned and integrated as soft constraints to guide a pretrained video diffusion model during inference. This design enables explicit modeling of object dynamics and causal transitions without requiring additional training or supervision. Extensive experiments show that our method consistently improves physical plausibility and temporal coherence, particularly in dynamics-intensive scenarios, while maintaining high perceptual video quality.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 54 references that are in the map. First posted on arXiv 12 Jun 2026.
Builds on
21 of 54 references.
References · 21
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
9 more
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
- 2025Seed1.5-VL Technical Reportcited by 373
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2024Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detectioncited by 122
- 2025What about gravity in video generation? Post-Training Newton's Laws with Verifiable Rewardscited by 25
- 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generationcited by 23
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 22
- 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Modelscited by 17
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimizationcited by 1
- 2026CausalWM: Causal Chain-of-Thought Reasoning for Embodied World Modelcited by 1
- 2026Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Modelcited by 0
- 2026STRIKE: Learning Visual State Transitions for Physical World Modelingcited by 0
- 2026STRIKE: Learning Visual State Transitions for Physical World Modeling7 Oct 2026
- 2026Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Model30 Sep 2026
- 2026CausalWM: Causal Chain-of-Thought Reasoning for Embodied World Model19 Sep 2026
- 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization16 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning
- 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Prior
- 2026MotiMotion: Motion-Controlled Video Generation with Visual Reasoning
- 2025Reasoning Physical Video Generation with Diffusion Timestep Tokens via Reinforcement Learning
- 2025Enhancing Physical Plausibility in Video Generation by Reasoning the Implausibility
- 2025TRAVL: A Recipe for Making Video-Language Models Better Judges of Physics Implausibility
- 2026PhyRPR: Training-Free Physics-Constrained Video Generation
- 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models