Demystifying Video Reasoning
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
Recent advances in video generation have revealed an unexpected phenomenon: diffusion-based video models exhibit non-trivial reasoning capabilities. Prior work attributes this to a Chain-of-Frames (CoF) mechanism, where reasoning is assumed to unfold sequentially across video frames. In this work, we challenge this assumption and uncover a fundamentally different mechanism. We show that reasoning in video models instead primarily emerges along the diffusion denoising steps. Through qualitative analysis and targeted probing experiments, we find that models explore multiple candidate solutions in early denoising steps and progressively converge to a final answer, a process we term Chain-of-Steps (CoS). Beyond this core mechanism, we identify several emergent reasoning behaviors critical to model performance: (1) working memory that supports tasks requiring consistent reference, such as object permanence; (2) self-correction and enhancement, allowing recovery from incorrect intermediate solutions; and (3) perception before action, where early steps establish semantic grounding and later steps perform structured manipulation. Moreover, analysis of Diffusion Transformer layers shows that middle layers conduct key reasoning procedures. Motivated by these insights, we present a simple Training-Free Ensemble (TFE) as a proof-of-concept, demonstrating how reasoning can be improved by ensembling latent trajectories from identical models with different random seeds. Overall, our work provides the first systematic dissection of the mechanisms underlying video reasoning, offering a foundation to guide future research in better exploiting the inherent reasoning dynamics of video models as a new substrate for intelligence.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 71 of its 82 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
71 of 82 references.
Closest ancestors · 17
Same direction, newest first
- 2026A Very Big Video Reasoning Suite23 Feb
- 2026UniT: Unified Multimodal Chain-of-Thought Test-time Scaling12 Feb
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligence2 Dec
- 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Models20 Nov
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigm6 Nov
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmark30 Oct
- 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning16 Oct
- 2025ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulation5 Oct
- 2025Video models are zero-shot learners and reasoners24 Sep
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision7 Aug
- 2025Thinking with Generated Images28 May
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning22 May
5 more
- 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPO19 May
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing13 Mar
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step23 Jan
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
Other references · 54
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
38 more
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2022Large Language Models Can Self-Improvecited by 656
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2023Generating Images with Multimodal Language Modelscited by 259
- 2018Stochastic Video Generation with a Learned Priorcited by 244
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 200
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
- 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
- 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
- 2025Visual Planning: Let's Think Only with Imagescited by 85
- 2024CV-VAE: A Compatible Video VAE for Latent Generative Video Modelscited by 68
- 2025Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Modelscited by 58
- 2025Understanding Aha Moments: from External Observations to Internal Mechanismscited by 48
- 2025VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language Modelcited by 44
- 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 39
- 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generationcited by 31
- 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmarkcited by 28
- 2025Phased DMD: Few-step Distribution Matching Distillation via Score Matching within Subintervalscited by 21
- 2025Vision Function Layer in Multimodal LLMscited by 17
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026Video Models Can Reason with Verifiable Rewardscited by 8
- 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimizationcited by 4
- 2026Diffusion ReRoll: Revisable Denoising for Robotic Sequential Predictioncited by 4
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 4
- 2026Temporal Backtracking Search for Test-time Generative Video Reasoningcited by 3
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
- 2026The Seriality Gap in Video Diffusion Modelscited by 0
- 2026Hierarchical Denoising For Multi-Step Visual Reasoningcited by 0
- 2026Visual prompt engineering for video modelscited by 0
- 2026Why Do Video Diffusion Models Violate Physics? Unveiling the Flaws in Attention Mechanismscited by 0
- 2026Learning via Self-Consistency for Diffusion-based Video Reasoningcited by 0
- 2026Think Before You Paint: Recursive Latent Reasoning for Diffusion Modelscited by 0
- 2026Think Before You Paint: Recursive Latent Reasoning for Diffusion Models7 Oct 2026
- 2026Learning via Self-Consistency for Diffusion-based Video Reasoning29 Sep 2026
- 2026Why Do Video Diffusion Models Violate Physics? Unveiling the Flaws in Attention Mechanisms20 Sep 2026
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning26 Aug 2026
- 2026Visual prompt engineering for video models28 Jul 2026
- 2026Diffusion ReRoll: Revisable Denoising for Robotic Sequential Prediction22 Jul 2026
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence17 Jul 2026
- 2026Hierarchical Denoising For Multi-Step Visual Reasoning16 Jul 2026
- 2026The Seriality Gap in Video Diffusion Models14 Jul 2026
- 2026Temporal Backtracking Search for Test-time Generative Video Reasoning11 Jun 2026
- 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimization1 Jun 2026
- 2026Video Models Can Reason with Verifiable Rewards14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Causality in Video Diffusers is Separable from Denoising
- 2025When Thinking Drifts: Evidential Grounding for Robust Video Reasoning
- 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
- 2026SYNCR: Diagnosing and Learning Cross-Video Reasoning from Simulation
- 2026OpenCoF: Learning to Reason Through Video Generation
- 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition
- 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoning
- 2025Video-CoM: Interactive Video Reasoning via Chain of Manipulations