Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Reasoning over dynamic visual content remains a central challenge for multimodal large language models. Recent thinking models generate explicit reasoning traces for interpretability; however, their reasoning often appears convincing while being logically inconsistent or weakly grounded in visual evidence. We identify and formalize these issues through two diagnostic metrics: Think Answer Consistency (TAC), which measures the alignment between reasoning and answers, and Video Attention Score (VAS), which captures the extent to which reasoning depends on visual versus textual cues. Analysis across 11 video reasoning benchmarks shows that current models rely heavily on linguistic priors rather than visual content. To address this, we propose a reinforcement learning approach that enhances both temporal precision and reasoning consistency. Our approach combines timestamp aware supervised fine tuning with Group Relative Policy Optimization (GRPO) guided by a novel Temporal Alignment Reward (TAR). This dual step post training stage encourages temporally aligned and causally coherent video reasoning. The resulting model, Video R2, achieves consistently higher TAC, VAS, and accuracy across multiple benchmarks, demonstrating that improvements in temporal alignment and reasoning coherence lead to more accurate and trustworthy video understanding. Code: https://github.com/mbzuai-oryx/Video-R2
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 66 of its 150 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
66 of 150 references.
Closest ancestors · 19
Same direction, newest first
- 2025Video Reasoning without Training19 Oct
- 2025Enhancing Video Large Language Models with Structured Multi-Video Collaborative Reasoning16 Sep
- 2025VideoMathQA: Benchmarking Mathematical Reasoning via Multimodal Understanding in Videos5 Jun
- 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning4 Jun
- 2025Reinforcing Video Reasoning with Focused Thinking30 May
- 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning20 May
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
- 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoning14 Mar
7 more
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLM27 Mar
- 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
Other references · 47
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Qwen Technical Reportcited by 3,273
35 more
- 2023Mistral 7Bcited by 3,065
- 2024Qwen2 Technical Reportcited by 2,076
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2024Mixtral of Expertscited by 1,785
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2024OpenAI o1 System Cardcited by 1,220
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
- 2024DeepSeek-V3 Technical Reportcited by 724
- 2024Phi-4 Technical Reportcited by 675
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
- 2023Textbooks Are All You Needcited by 561
- 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
- 2023The Falcon Series of Open Language Modelscited by 526
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
- 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 323
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
- 2024Pixtral 12Bcited by 174
- 2024ST-LLM: Large Language Models Are Effective Temporal Learnerscited by 126
- 2024VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understandingcited by 113
- 2025Vad-R1: Towards Video Anomaly Reasoning via Perception-to-Cognition Chain-of-Thoughtcited by 23
- 2024LLaVA-MR: Large Language-and-Vision Assistant for Video Moment Retrievalcited by 17
- 2025When Thinking Drifts: Evidential Grounding for Robust Video Reasoningcited by 15
- 2025SciVideoBench: Benchmarking Scientific Video Reasoning in Large Multimodal Modelscited by 11
- 2025VidBridge-R1: Bridging QA and Captioning for RL-based Video Understanding Models with Intermediate Proxy Taskscited by 10
- 2024Fewer Tokens and Fewer Videos: Extending Video Understanding Abilities in Large Vision-Language Modelscited by 6
- 2025Mobile-VideoGPT: Fast and Accurate Model for Mobile Video Understandingcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 6.
7 papers.
- 2025A Benchmark for Omni-Modal Reasoning in Long Videoscited by 5
- 2026MME-CoF-Pro: Evaluating Reasoning Coherence in Video Generative Models with Text and Visual Hintscited by 4
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 3
- 2026VTI-CoT: Visual-Textual Interleaved Chain of Thought for Video Reasoningcited by 1
- 2026See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understandingcited by 1
- 2026Video-FLAIR: Not Whether to Reason, But Howcited by 0
- 2026Locate Anything in Videos: Rethinking Efficient Generative Spatio-Temporal Video Groundingcited by 0
- 2026Locate Anything in Videos: Rethinking Efficient Generative Spatio-Temporal Video Grounding28 Aug 2026
- 2026Video-FLAIR: Not Whether to Reason, But How27 Aug 2026
- 2026See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understanding8 Jun 2026
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 2026VTI-CoT: Visual-Textual Interleaved Chain of Thought for Video Reasoning4 Jun 2026
- 2026MME-CoF-Pro: Evaluating Reasoning Coherence in Video Generative Models with Text and Visual Hints20 Mar 2026
- 2025A Benchmark for Omni-Modal Reasoning in Long Videos18 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2026Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning
- 2026CORA: Analyzing and bridging thinking-answer gap in Multimodal RLVR via Consistency-Oriented Reasoning Alignment
- 2026Reinforcing Consistency in Video MLLMs with Structured Rewards
- 2025Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learning
- 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1
- 2026Perception Before Reasoning: Dynamic Latent Reasoning for Video Understanding and Question Answering
- 2026Video-KTR: Reinforcing Video Reasoning via Key Token Attribution