mlsanityData to 7 Oct 2026

Demystifying Video Reasoning

arXiv 2603.16870 ↗First posted 17 Mar 2026cs.CV cs.AIcited by 12

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Recent advances in video generation have revealed an unexpected phenomenon: diffusion-based video models exhibit non-trivial reasoning capabilities. Prior work attributes this to a Chain-of-Frames (CoF) mechanism, where reasoning is assumed to unfold sequentially across video frames. In this work, we challenge this assumption and uncover a fundamentally different mechanism. We show that reasoning in video models instead primarily emerges along the diffusion denoising steps. Through qualitative analysis and targeted probing experiments, we find that models explore multiple candidate solutions in early denoising steps and progressively converge to a final answer, a process we term Chain-of-Steps (CoS). Beyond this core mechanism, we identify several emergent reasoning behaviors critical to model performance: (1) working memory that supports tasks requiring consistent reference, such as object permanence; (2) self-correction and enhancement, allowing recovery from incorrect intermediate solutions; and (3) perception before action, where early steps establish semantic grounding and later steps perform structured manipulation. Moreover, analysis of Diffusion Transformer layers shows that middle layers conduct key reasoning procedures. Motivated by these insights, we present a simple Training-Free Ensemble (TFE) as a proof-of-concept, demonstrating how reasoning can be improved by ensembling latent trajectories from identical models with different random seeds. Overall, our work provides the first systematic dissection of the mechanisms underlying video reasoning, offering a foundation to guide future research in better exploiting the inherent reasoning dynamics of video models as a new substrate for intelligence.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 71 of its 82 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

71 of 82 references.

Closest ancestors · 17

Same direction, newest first

  1. 2026A Very Big Video Reasoning Suite23 Feb
  2. 2026UniT: Unified Multimodal Chain-of-Thought Test-time Scaling12 Feb
  3. 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligence2 Dec
  4. 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Models20 Nov
  5. 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigm6 Nov
  6. 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmark30 Oct
  7. 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning16 Oct
  8. 2025ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulation5 Oct
  9. 2025Video models are zero-shot learners and reasoners24 Sep
  10. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision7 Aug
  11. 2025Thinking with Generated Images28 May
  12. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning22 May
5 more
  1. 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPO19 May
  2. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
  3. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing13 Mar
  4. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step23 Jan
  5. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan

Other references · 54

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  10. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  11. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  12. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
38 more
  1. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  2. 2022Emergent Abilities of Large Language Modelscited by 2,483
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  4. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  6. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  8. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
  9. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  10. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  11. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  12. 2022Large Language Models Can Self-Improvecited by 656
  13. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  14. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  15. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  16. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  17. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
  18. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  19. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  20. 2023Generating Images with Multimodal Language Modelscited by 259
  21. 2018Stochastic Video Generation with a Learned Priorcited by 244
  22. 2025Transfer between Modalities with MetaQueriescited by 231
  23. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
  24. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
  25. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 200
  26. 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
  27. 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
  28. 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
  29. 2025Visual Planning: Let's Think Only with Imagescited by 85
  30. 2024CV-VAE: A Compatible Video VAE for Latent Generative Video Modelscited by 68
  31. 2025Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Modelscited by 58
  32. 2025Understanding Aha Moments: from External Observations to Internal Mechanismscited by 48
  33. 2025VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language Modelcited by 44
  34. 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 39
  35. 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generationcited by 31
  36. 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmarkcited by 28
  37. 2025Phased DMD: Few-step Distribution Matching Distillation via Score Matching within Subintervalscited by 21
  38. 2025Vision Function Layer in Multimodal LLMscited by 17

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Causality in Video Diffusers is Separable from Denoising
  2. 2025When Thinking Drifts: Evidential Grounding for Robust Video Reasoning
  3. 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
  4. 2026SYNCR: Diagnosing and Learning Cross-Video Reasoning from Simulation
  5. 2026OpenCoF: Learning to Reason Through Video Generation
  6. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition
  7. 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoning
  8. 2025Video-CoM: Interactive Video Reasoning via Chain of Manipulations