V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent progress in generative video models, such as Veo-3, has shown surprising zero-shot reasoning abilities, creating a growing need for systematic and reliable evaluation. We introduce V-ReasonBench, a benchmark designed to assess video reasoning across four key dimensions: structured problem-solving, spatial cognition, pattern-based inference, and physical dynamics. The benchmark is built from both synthetic and real-world image sequences and provides a diverse set of answer-verifiable tasks that are reproducible, scalable, and unambiguous. Evaluations of six state-of-the-art video models reveal clear dimension-wise differences, with strong variation in structured, spatial, pattern-based, and physical reasoning. We further compare video models with strong image models, analyze common hallucination behaviors, and study how video duration affects Chain-of-Frames reasoning. Overall, V-ReasonBench offers a unified and reproducible framework for measuring video reasoning and aims to support the development of models with more reliable, human-aligned reasoning skills.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 34 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
26 of 34 references.
Closest ancestors · 4
Same direction, newest first
- 2025Video models are zero-shot learners and reasoners24 Sep
- 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoning31 May
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
Other references · 22
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024Hallucination of Multimodal Large Language Models: A Surveycited by 380
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 300
- 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 275
10 more
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2019CATER: A diagnostic dataset for Compositional Actions and TEmporal Reasoningcited by 137
- 2021AGQA: A Benchmark for Compositional Spatio-Temporal Reasoningcited by 120
- 2024TopViewRS: Vision-Language Models as Top-View Spatial Reasonerscited by 48
- 2024VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception of Geometric Informationcited by 39
- 2025CAPTURe: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Countingcited by 36
- 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generationcited by 31
- 2024VidHal: Benchmarking Temporal Hallucinations in Vision LLMscited by 19
- 2025A Survey on Efficient Vision-Language Modelscited by 19
- 2025ALLVB: All-in-One Long Video Understanding Benchmarkcited by 16
Built on by
Citing papers per year: 2025: 2; 2026: 20.
22 papers.
Sort:
By area:
- 2026A Very Big Video Reasoning Suitecited by 29
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Modelscited by 18
- 2026Demystifying Video Reasoningcited by 12
- 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generationcited by 9
- 2026Video Models Can Reason with Verifiable Rewardscited by 8
- 2026WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictorscited by 6
- 2025Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoningcited by 4
- 2026From Perception to Action: An Interactive Benchmark for Vision Reasoningcited by 4
- 2026MME-CoF-Pro: Evaluating Reasoning Coherence in Video Generative Models with Text and Visual Hintscited by 4
- 2026CollabVR: Collaborative Video Reasoning with Vision-Language and Video Generation Modelscited by 4
- 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimizationcited by 4
- 2026OmniGameArena: A Unified UE5 Benchmark for VLM Game Agents with Improvement Dynamicscited by 4
10 more
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 4
- 2026V-Bridge: Bridging Video Generative Priors to Versatile Few-shot Image Restorationcited by 3
- 2026On-Policy Adversarial Flow Distillation for Autoregressive Video Generationcited by 2
- 2026OpenCoF: Learning to Reason Through Video Generationcited by 2
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Modelscited by 2
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
- 2026Thinking in Video: Can Video Generators Really Reason About the Real World?cited by 1
- 2026Hierarchical Denoising For Multi-Step Visual Reasoningcited by 0
- 2026Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generationcited by 0
- 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Modelscited by 0
- 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models10 Sep 2026
- 2026Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generation2 Sep 2026
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning26 Aug 2026
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Models20 Aug 2026
- 2026Thinking in Video: Can Video Generators Really Reason About the Real World?20 Jul 2026
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence17 Jul 2026
- 2026Hierarchical Denoising For Multi-Step Visual Reasoning16 Jul 2026
- 2026OpenCoF: Learning to Reason Through Video Generation9 Jul 2026
- 2026OmniGameArena: A Unified UE5 Benchmark for VLM Game Agents with Improvement Dynamics8 Jun 2026
- 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimization1 Jun 2026
- 2026On-Policy Adversarial Flow Distillation for Autoregressive Video Generation25 May 2026
- 2026Video Models Can Reason with Verifiable Rewards14 May 2026
10 more
- 2026WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictors11 May 2026
- 2026CollabVR: Collaborative Video Reasoning with Vision-Language and Video Generation Models9 May 2026
- 2026MME-CoF-Pro: Evaluating Reasoning Coherence in Video Generative Models with Text and Visual Hints20 Mar 2026
- 2026Demystifying Video Reasoning17 Mar 2026
- 2026V-Bridge: Bridging Video Generative Priors to Versatile Few-shot Image Restoration13 Mar 2026
- 2026From Perception to Action: An Interactive Benchmark for Vision Reasoning24 Feb 2026
- 2026A Very Big Video Reasoning Suite23 Feb 2026
- 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation15 Jan 2026
- 2025Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoning31 Dec 2025
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Models30 Dec 2025
- 2026A Very Big Video Reasoning Suitecited by 29
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Modelscited by 18
- 2026Demystifying Video Reasoningcited by 12
- 2026Video Models Can Reason with Verifiable Rewardscited by 8
- 2026From Perception to Action: An Interactive Benchmark for Vision Reasoningcited by 4
- 2026MME-CoF-Pro: Evaluating Reasoning Coherence in Video Generative Models with Text and Visual Hintscited by 4
- 2026CollabVR: Collaborative Video Reasoning with Vision-Language and Video Generation Modelscited by 4
- 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimizationcited by 4
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 4
- 2026OpenCoF: Learning to Reason Through Video Generationcited by 2
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Modelscited by 2
- 2026Hierarchical Denoising For Multi-Step Visual Reasoningcited by 0
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning26 Aug 2026
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Models20 Aug 2026
- 2026Hierarchical Denoising For Multi-Step Visual Reasoning16 Jul 2026
- 2026OpenCoF: Learning to Reason Through Video Generation9 Jul 2026
- 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimization1 Jun 2026
- 2026Video Models Can Reason with Verifiable Rewards14 May 2026
- 2026CollabVR: Collaborative Video Reasoning with Vision-Language and Video Generation Models9 May 2026
- 2026MME-CoF-Pro: Evaluating Reasoning Coherence in Video Generative Models with Text and Visual Hints20 Mar 2026
- 2026Demystifying Video Reasoning17 Mar 2026
- 2026From Perception to Action: An Interactive Benchmark for Vision Reasoning24 Feb 2026
- 2026A Very Big Video Reasoning Suite23 Feb 2026
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Models30 Dec 2025
- 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generationcited by 9
- 2025Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoningcited by 4
- 2026V-Bridge: Bridging Video Generative Priors to Versatile Few-shot Image Restorationcited by 3
- 2026On-Policy Adversarial Flow Distillation for Autoregressive Video Generationcited by 2
- 2026Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generationcited by 0
- 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Modelscited by 0
- 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models10 Sep 2026
- 2026Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generation2 Sep 2026
- 2026On-Policy Adversarial Flow Distillation for Autoregressive Video Generation25 May 2026
- 2026V-Bridge: Bridging Video Generative Priors to Versatile Few-shot Image Restoration13 Mar 2026
- 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation15 Jan 2026
- 2025Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoning31 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Models
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmark
- 2025Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Tasks
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation
- 2025SciVideoBench: Benchmarking Scientific Video Reasoning in Large Multimodal Models
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligence
- 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning
- 2025VRBench: A Benchmark for Multi-Step Reasoning in Long Narrative Videos