Thinking in Video: Can Video Generators Really Reason About the Real World?
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Recent advances in world models and video generation have given rise to an emerging reasoning paradigm that leverages video generative models to simulate, predict, and reason about real-world dynamics. We redefine this paradigm as Thinking in Video, where video is not merely an output artifact but a medium for constructing, extending, and verifying causal thought. However, this promise remains unverified: convincing rollouts may reflect memorized appearances rather than causal understanding, while existing metrics separate perceptual fidelity from semantic logic. To evaluate whether video generators support such reasoning, we introduce the Causal-Generative Dual-Judge (CGDJ), auditing World Model Consistency from two perspectives. Explicit Causal Perception tests whether a generator reads a video scenario as a reasoning problem through spatio-temporal flattened visual question answering, while Implicit Generative Perception-Prediction Gap evaluates whether it renders the causal consequence as a consistent future video. Applying CGDJ to representative open- and closed-source generators reveals a clear Perception-Prediction Gap: open-source models produce plausible dynamics despite near-zero explicit causal perception, whereas advanced closed-source systems show stronger but still limited alignment between reasoning and generation. Further analysis exposes audio-visual misalignment, where models verbalize correct causal logic more reliably than they render it, challenging the "world simulator" narrative.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 34 of its 62 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
34 of 62 references.
Closest ancestors · 2
Same direction, newest first
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
Other references · 32
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2025Gemma 3 Technical Reportcited by 1,824
- 2018World Modelscited by 1,513
- 2025OpenAI GPT-5 System Cardcited by 989
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 73
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 61
20 more
- 2025Evaluating Gemini Robotics Policies in a Veo World Simulatorcited by 51
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmarkcited by 43
- 2024The Essential Role of Causality in Foundation World Models for Embodied AIcited by 32
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2025What about gravity in video generation? Post-Training Newton's Laws with Verifiable Rewardscited by 25
- 2025Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Taskscited by 22
- 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Modelscited by 22
- 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Modelscited by 19
- 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmarkcited by 19
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligencecited by 13
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluationcited by 12
- 2025Youtu-LLM: Unlocking the Native Agentic Potential for Lightweight Large Language Modelscited by 10
- 2026RoboAlign-R1: Distilled Multimodal Reward Alignment for Robot Video World Modelscited by 8
- 2025WEAVE: Unleashing and Benchmarking the In-context Interleaved Comprehension and Generationcited by 7
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
- 2025Have we unified image generation and understanding yet? An empirical study of GPT-4o's image generation abilitycited by 4
- 2025Video Models Start to Solve Chess, Maze, Sudoku, Mental Rotation, and Raven' Matricescited by 4
- 2025Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoningcited by 4
- 2026Latent Visual Cache for Video Reasoningcited by 3
- 2024TLD: A Vehicle Tail Light signal Dataset and Benchmarkcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026YoCausal: How Far is Video Generation from World Model? A Causality Perspective
- 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models
- 2025VCRBench: Exploring Long-form Causal Reasoning Capabilities of Large Video Language Models
- 2026RISE-Video: Can Video Generators Decode Implicit World Rules?
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics
- 2026MME-CoF-Pro: Evaluating Reasoning Coherence in Video Generative Models with Text and Visual Hints
- 2026CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generation
- 2025CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video Models