mlsanityData to 14 Oct 2026

CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generation

arXiv 2606.14317 ↗First posted 12 Jun 2026cs.CVcited by 4

On the map: LLM reasoning → Spatial and embodied reasoning

also in 2 more
Abstract (arXiv)

Recent advances in diffusion-based video generation have significantly improved visual quality and short-term temporal coherence. However, existing methods still struggle to produce videos with physically consistent and causally plausible dynamics, especially in scenarios involving long-horizon interactions. This limitation arises from the fact that video diffusion models primarily learn physical consistency implicitly, while vision-language models can directly model physical laws. Based on this idea, in this work, we propose CausalMotion, a training-free framework that injects explicit physical reasoning into video generation through structured intermediate representations. Our key idea is to decouple reasoning from generation by leveraging a vision-language model to decompose a text prompt into a sequence of causally consistent keyframes and object-centric motion trajectories. These representations are then aligned and integrated as soft constraints to guide a pretrained video diffusion model during inference. This design enables explicit modeling of object dynamics and causal transitions without requiring additional training or supervision. Extensive experiments show that our method consistently improves physical plausibility and temporal coherence, particularly in dynamics-intensive scenarios, while maintaining high perceptual video quality.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 54 references that are in the map. First posted on arXiv 12 Jun 2026.

Builds on

21 of 54 references.

References · 21

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  8. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  9. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  10. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
  11. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  12. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
9 more
  1. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  2. 2025Seed1.5-VL Technical Reportcited by 373
  3. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
  4. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  5. 2024Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detectioncited by 122
  6. 2025What about gravity in video generation? Post-Training Newton's Laws with Verifiable Rewardscited by 25
  7. 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generationcited by 23
  8. 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 22
  9. 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Modelscited by 17

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning
  2. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Prior
  3. 2026MotiMotion: Motion-Controlled Video Generation with Visual Reasoning
  4. 2025Reasoning Physical Video Generation with Diffusion Timestep Tokens via Reinforcement Learning
  5. 2025Enhancing Physical Plausibility in Video Generation by Reasoning the Implausibility
  6. 2025TRAVL: A Recipe for Making Video-Language Models Better Judges of Physics Implausibility
  7. 2026PhyRPR: Training-Free Physics-Constrained Video Generation
  8. 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models