mlsanityData to 7 Oct 2026

Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models

arXiv 2511.23478 ↗First posted 28 Nov 2025cs.CVcited by 7

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Reasoning over dynamic visual content remains a central challenge for multimodal large language models. Recent thinking models generate explicit reasoning traces for interpretability; however, their reasoning often appears convincing while being logically inconsistent or weakly grounded in visual evidence. We identify and formalize these issues through two diagnostic metrics: Think Answer Consistency (TAC), which measures the alignment between reasoning and answers, and Video Attention Score (VAS), which captures the extent to which reasoning depends on visual versus textual cues. Analysis across 11 video reasoning benchmarks shows that current models rely heavily on linguistic priors rather than visual content. To address this, we propose a reinforcement learning approach that enhances both temporal precision and reasoning consistency. Our approach combines timestamp aware supervised fine tuning with Group Relative Policy Optimization (GRPO) guided by a novel Temporal Alignment Reward (TAR). This dual step post training stage encourages temporally aligned and causally coherent video reasoning. The resulting model, Video R2, achieves consistently higher TAC, VAS, and accuracy across multiple benchmarks, demonstrating that improvements in temporal alignment and reasoning coherence lead to more accurate and trustworthy video understanding. Code: https://github.com/mbzuai-oryx/Video-R2

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 66 of its 150 references that are in the map. First posted on arXiv 28 Nov 2025.

Builds on

66 of 150 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025Video Reasoning without Training19 Oct
  2. 2025Enhancing Video Large Language Models with Structured Multi-Video Collaborative Reasoning16 Sep
  3. 2025VideoMathQA: Benchmarking Mathematical Reasoning via Multimodal Understanding in Videos5 Jun
  4. 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning4 Jun
  5. 2025Reinforcing Video Reasoning with Focused Thinking30 May
  6. 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning20 May
  7. 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
  8. 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
  9. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  10. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  11. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  12. 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoning14 Mar
7 more
  1. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  2. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
  3. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  4. 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov
  5. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  6. 2024An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLM27 Mar
  7. 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul

Other references · 47

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  7. 2025Qwen2.5-VL Technical Reportcited by 5,418
  8. 2024Qwen2.5 Technical Reportcited by 4,713
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  10. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  11. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  12. 2023Qwen Technical Reportcited by 3,273
35 more
  1. 2023Mistral 7Bcited by 3,065
  2. 2024Qwen2 Technical Reportcited by 2,076
  3. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  4. 2024Mixtral of Expertscited by 1,785
  5. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  6. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  7. 2024OpenAI o1 System Cardcited by 1,220
  8. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  9. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  10. 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
  11. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  12. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
  13. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
  14. 2024DeepSeek-V3 Technical Reportcited by 724
  15. 2024Phi-4 Technical Reportcited by 675
  16. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
  17. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
  18. 2023Textbooks Are All You Needcited by 561
  19. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
  20. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
  21. 2023The Falcon Series of Open Language Modelscited by 526
  22. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  23. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
  24. 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 323
  25. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
  26. 2024Pixtral 12Bcited by 174
  27. 2024ST-LLM: Large Language Models Are Effective Temporal Learnerscited by 126
  28. 2024VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understandingcited by 113
  29. 2025Vad-R1: Towards Video Anomaly Reasoning via Perception-to-Cognition Chain-of-Thoughtcited by 23
  30. 2024LLaVA-MR: Large Language-and-Vision Assistant for Video Moment Retrievalcited by 17
  31. 2025When Thinking Drifts: Evidential Grounding for Robust Video Reasoningcited by 15
  32. 2025SciVideoBench: Benchmarking Scientific Video Reasoning in Large Multimodal Modelscited by 11
  33. 2025VidBridge-R1: Bridging QA and Captioning for RL-based Video Understanding Models with Intermediate Proxy Taskscited by 10
  34. 2024Fewer Tokens and Fewer Videos: Extending Video Understanding Abilities in Large Vision-Language Modelscited by 6
  35. 2025Mobile-VideoGPT: Fast and Accurate Model for Mobile Video Understandingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs
  2. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning
  3. 2026CORA: Analyzing and bridging thinking-answer gap in Multimodal RLVR via Consistency-Oriented Reasoning Alignment
  4. 2026Reinforcing Consistency in Video MLLMs with Structured Rewards
  5. 2025Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learning
  6. 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1
  7. 2026Perception Before Reasoning: Dynamic Latent Reasoning for Video Understanding and Question Answering
  8. 2026Video-KTR: Reinforcing Video Reasoning via Key Token Attribution