mlsanityData to 14 Oct 2026

ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesis

arXiv 2509.23652 ↗First posted 28 Sep 2025cs.CV cs.AIcited by 26

On the map: LLM reasoning → Multimodal reasoning

also in 3 more
Abstract (arXiv)

While Reinforcement Learning with Verifiable Reward (RLVR) significantly advances image reasoning in Large Vision-Language Models (LVLMs), its application to complex video reasoning remains underdeveloped. This gap stems primarily from a critical data bottleneck: existing datasets lack the challenging, multi-hop questions and high-quality, video-grounded Chain-of-Thought (CoT) data necessary to effectively bootstrap RLVR. To address this, we introduce ReWatch, a large-scale dataset built to foster advanced video reasoning. We propose a novel multi-stage synthesis pipeline to synthesize its three components: ReWatch-Caption, ReWatch-QA, and ReWatch-CoT. A core innovation is our Multi-Agent ReAct framework for CoT synthesis, which simulates a human-like "re-watching" process to generate video-grounded reasoning traces by explicitly modeling information retrieval and verification. Building on this dataset, we develop ReWatch-R1 by post-training a strong baseline LVLM with Supervised Fine-Tuning (SFT) and our RLVR framework. This framework incorporates a novel Observation & Reasoning (O&R) reward mechanism that evaluates both the final answer's correctness and the reasoning's alignment with video content, directly penalizing hallucination. Our experiments show that ReWatch-R1 achieves state-of-the-art average performance on five challenging video reasoning benchmarks. Project Page: https://rewatch-r1.github.io

Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 58 references that are in the map. First posted on arXiv 28 Sep 2025.

Builds on

46 of 58 references.

Closest ancestors · 29

Same direction, newest first

  1. 2025Look Again, Think Slowly: Enhancing Visual Reflection in Vision-Language Models15 Sep
  2. 2025Self-Rewarding Vision-Language Model via Reasoning Decomposition27 Aug
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  4. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning6 Aug
  5. 2025ViTCoT: Video-Text Interleaved Chain-of-Thought for Boosting Video Understanding in Large Language Models14 Jul
  6. 2025Scaling RL to Long Videos10 Jul
  7. 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
  8. 2025Temporal Chain of Thought: Long-Video Understanding by Thinking in Frames1 Jul
  9. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning1 Jul
  10. 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning19 Jun
  11. 2025Video-CoT: A Comprehensive Dataset for Spatiotemporal Understanding of Videos Based on Chain-of-Thought10 Jun
  12. 2025VideoChat-A1: Thinking with Long Videos by Chain-of-Shot Reasoning6 Jun
17 more
  1. 2025VideoMathQA: Benchmarking Mathematical Reasoning via Multimodal Understanding in Videos5 Jun
  2. 2025Video-Skill-CoT: Skill-based Chain-of-Thoughts for Domain-Adaptive Video Reasoning4 Jun
  3. 2025Qwen Look Again: Guiding Vision-Language Reasoning Models to Re-attention Visual Information29 May
  4. 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start28 May
  5. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
  6. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  7. 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
  8. 2025MINERVA: Evaluating Complex Video Reasoning1 May
  9. 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning10 Apr
  10. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  11. 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R131 Mar
  12. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  13. 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoning17 Mar
  14. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  15. 2024Enhancing Video-LLM Reasoning via Agent-of-Thoughts Distillation2 Dec
  16. 2024VideoCoT: A Video Chain-of-Thought Dataset with Active Annotation Tool7 Jul
  17. 2024MMCTAgent: Multi-modal Critical Thinking Agent Framework for Complex Visual Reasoning28 May

Other references · 17

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  7. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
  8. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
  9. 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuningcited by 106
  10. 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 98
  11. 2025Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Modelscited by 64
  12. 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 61
5 more
  1. 2024VCA: Video Curious Agent for Long Video Understandingcited by 56
  2. 2025VideoExplorer: Think With Videos For Agentic Long-Video Understandingcited by 29
  3. 2025CoS: Chain-of-Shot Prompting for Long Video Understandingcited by 27
  4. 2025Unleashing Hour-Scale Video Training for Long Video-Language Understandingcited by 23
  5. 2025AV-Reasoner: Improving and Benchmarking Clue-Grounded Audio-Visual Counting for MLLMscited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 22.

26 papers.

Sort:

By area:

  1. 2025WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoningcited by 53
  2. 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigmcited by 42
  3. 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoningcited by 24
  4. 2025Conan: Progressive Learning to Reason Like a Detective over Multi-Scale Visual Evidencecited by 18
  5. 2026ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoningcited by 8
  6. 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videoscited by 7
  7. 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verificationcited by 7
  8. 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learningcited by 6
  9. 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 4
  10. 2026Find, Fix, Reason: Context Repair for Video Reasoningcited by 3
  11. 2026MedScope: Incentivizing "Think with Videos" for Clinical Reasoning via Coarse-to-Fine Tool Callingcited by 2
  12. 2026MedClaw: Heuristic Agent Harness for Long-Horizon Surgical Video Reasoningcited by 2
14 more
  1. 2026SagaQA: A Multi-hop Reasoning Benchmark for Long-form Narrative Understanding in TV Seriescited by 1
  2. 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understandingcited by 1
  3. 2026Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervisioncited by 1
  4. 2026One Skill Does Not Fit All: Automatic Discovery and Taxonomy-Guided Routing of Frame-Selection Skills for Long-Video Question Answeringcited by 1
  5. 2025Decoupling Perception from Reasoning for Hallucination-Resistant Video Understandingcited by 0
  6. 2026Act2See: Emergent Active Visual Perception for Video Reasoningcited by 0
  7. 2026EFlow: Learning Evidence Flow for Long-Video Reasoning with Adaptive Reflectioncited by 0
  8. 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoningcited by 0
  9. 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Modelscited by 0
  10. 2026Agentic Video Understanding: A Surveycited by 0
  11. 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnessescited by 0
  12. 2026VideoEvoHarness: Self Evolving Agent Harness from Unlabeled Videos for Video Understandingcited by 0
  13. 2026Open-o3-Video-v2: Seek, Ground, and Reason with Verifiable Spatio-Temporal Evidencecited by 0
  14. 2026Mitigating Video Hallucinations via Attention-Guided Representation Perturbationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understanding
  2. 2026EasyVideoR1: Easier RL for Video Understanding
  3. 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
  4. 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
  5. 2026Video Models Can Reason with Verifiable Rewards
  6. 2026video-SALMONN-R3: Learning to ReWatch, ReAsk, and ReAnswer for Efficient Video Understanding
  7. 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding
  8. 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting