ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesis
On the map: LLM reasoning → Multimodal reasoning
also in 3 more
Abstract (arXiv)
While Reinforcement Learning with Verifiable Reward (RLVR) significantly advances image reasoning in Large Vision-Language Models (LVLMs), its application to complex video reasoning remains underdeveloped. This gap stems primarily from a critical data bottleneck: existing datasets lack the challenging, multi-hop questions and high-quality, video-grounded Chain-of-Thought (CoT) data necessary to effectively bootstrap RLVR. To address this, we introduce ReWatch, a large-scale dataset built to foster advanced video reasoning. We propose a novel multi-stage synthesis pipeline to synthesize its three components: ReWatch-Caption, ReWatch-QA, and ReWatch-CoT. A core innovation is our Multi-Agent ReAct framework for CoT synthesis, which simulates a human-like "re-watching" process to generate video-grounded reasoning traces by explicitly modeling information retrieval and verification. Building on this dataset, we develop ReWatch-R1 by post-training a strong baseline LVLM with Supervised Fine-Tuning (SFT) and our RLVR framework. This framework incorporates a novel Observation & Reasoning (O&R) reward mechanism that evaluates both the final answer's correctness and the reasoning's alignment with video content, directly penalizing hallucination. Our experiments show that ReWatch-R1 achieves state-of-the-art average performance on five challenging video reasoning benchmarks. Project Page: https://rewatch-r1.github.io
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 58 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
46 of 58 references.
Closest ancestors · 29
Same direction, newest first
- 2025Look Again, Think Slowly: Enhancing Visual Reflection in Vision-Language Models15 Sep
- 2025Self-Rewarding Vision-Language Model via Reasoning Decomposition27 Aug
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning6 Aug
- 2025ViTCoT: Video-Text Interleaved Chain-of-Thought for Boosting Video Understanding in Large Language Models14 Jul
- 2025Scaling RL to Long Videos10 Jul
- 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
- 2025Temporal Chain of Thought: Long-Video Understanding by Thinking in Frames1 Jul
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning1 Jul
- 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning19 Jun
- 2025Video-CoT: A Comprehensive Dataset for Spatiotemporal Understanding of Videos Based on Chain-of-Thought10 Jun
- 2025VideoChat-A1: Thinking with Long Videos by Chain-of-Shot Reasoning6 Jun
17 more
- 2025VideoMathQA: Benchmarking Mathematical Reasoning via Multimodal Understanding in Videos5 Jun
- 2025Video-Skill-CoT: Skill-based Chain-of-Thoughts for Domain-Adaptive Video Reasoning4 Jun
- 2025Qwen Look Again: Guiding Vision-Language Reasoning Models to Re-attention Visual Information29 May
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start28 May
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
- 2025MINERVA: Evaluating Complex Video Reasoning1 May
- 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning10 Apr
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R131 Mar
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoning17 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2024Enhancing Video-LLM Reasoning via Agent-of-Thoughts Distillation2 Dec
- 2024VideoCoT: A Video Chain-of-Thought Dataset with Active Annotation Tool7 Jul
- 2024MMCTAgent: Multi-modal Critical Thinking Agent Framework for Complex Visual Reasoning28 May
Other references · 17
- 2023GPT-4 Technical Reportcited by 18,396
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
- 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuningcited by 106
- 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 98
- 2025Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Modelscited by 64
- 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 61
5 more
- 2024VCA: Video Curious Agent for Long Video Understandingcited by 56
- 2025VideoExplorer: Think With Videos For Agentic Long-Video Understandingcited by 29
- 2025CoS: Chain-of-Shot Prompting for Long Video Understandingcited by 27
- 2025Unleashing Hour-Scale Video Training for Long Video-Language Understandingcited by 23
- 2025AV-Reasoner: Improving and Benchmarking Clue-Grounded Audio-Visual Counting for MLLMscited by 16
Built on by
Citing papers per year: 2025: 4; 2026: 22.
26 papers.
Sort:
By area:
- 2025WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoningcited by 53
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigmcited by 42
- 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoningcited by 24
- 2025Conan: Progressive Learning to Reason Like a Detective over Multi-Scale Visual Evidencecited by 18
- 2026ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoningcited by 8
- 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videoscited by 7
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verificationcited by 7
- 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learningcited by 6
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 4
- 2026Find, Fix, Reason: Context Repair for Video Reasoningcited by 3
- 2026MedScope: Incentivizing "Think with Videos" for Clinical Reasoning via Coarse-to-Fine Tool Callingcited by 2
- 2026MedClaw: Heuristic Agent Harness for Long-Horizon Surgical Video Reasoningcited by 2
14 more
- 2026SagaQA: A Multi-hop Reasoning Benchmark for Long-form Narrative Understanding in TV Seriescited by 1
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understandingcited by 1
- 2026Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervisioncited by 1
- 2026One Skill Does Not Fit All: Automatic Discovery and Taxonomy-Guided Routing of Frame-Selection Skills for Long-Video Question Answeringcited by 1
- 2025Decoupling Perception from Reasoning for Hallucination-Resistant Video Understandingcited by 0
- 2026Act2See: Emergent Active Visual Perception for Video Reasoningcited by 0
- 2026EFlow: Learning Evidence Flow for Long-Video Reasoning with Adaptive Reflectioncited by 0
- 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoningcited by 0
- 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Modelscited by 0
- 2026Agentic Video Understanding: A Surveycited by 0
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnessescited by 0
- 2026VideoEvoHarness: Self Evolving Agent Harness from Unlabeled Videos for Video Understandingcited by 0
- 2026Open-o3-Video-v2: Seek, Ground, and Reason with Verifiable Spatio-Temporal Evidencecited by 0
- 2026Mitigating Video Hallucinations via Attention-Guided Representation Perturbationcited by 0
- 2026Mitigating Video Hallucinations via Attention-Guided Representation Perturbation14 Oct 2026
- 2026Open-o3-Video-v2: Seek, Ground, and Reason with Verifiable Spatio-Temporal Evidence13 Oct 2026
- 2026VideoEvoHarness: Self Evolving Agent Harness from Unlabeled Videos for Video Understanding11 Oct 2026
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnesses28 Sep 2026
- 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Models22 Sep 2026
- 2026Agentic Video Understanding: A Survey21 Sep 2026
- 2026One Skill Does Not Fit All: Automatic Discovery and Taxonomy-Guided Routing of Frame-Selection Skills for Long-Video Question Answering11 Sep 2026
- 2026Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervision3 Sep 2026
- 2026MedClaw: Heuristic Agent Harness for Long-Horizon Surgical Video Reasoning14 Aug 2026
- 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning8 Aug 2026
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding6 Aug 2026
- 2026EFlow: Learning Evidence Flow for Long-Video Reasoning with Adaptive Reflection1 Jul 2026
14 more
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 2026SagaQA: A Multi-hop Reasoning Benchmark for Long-form Narrative Understanding in TV Series2 Jun 2026
- 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning19 May 2026
- 2026Act2See: Emergent Active Visual Perception for Video Reasoning3 May 2026
- 2026Find, Fix, Reason: Context Repair for Video Reasoning17 Apr 2026
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verification2 Apr 2026
- 2026ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoning30 Mar 2026
- 2026MedScope: Incentivizing "Think with Videos" for Clinical Reasoning via Coarse-to-Fine Tool Calling11 Feb 2026
- 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videos8 Feb 2026
- 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoning30 Jan 2026
- 2025WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoning2 Dec 2025
- 2025Decoupling Perception from Reasoning for Hallucination-Resistant Video Understanding23 Nov 2025
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigm6 Nov 2025
- 2025Conan: Progressive Learning to Reason Like a Detective over Multi-Scale Visual Evidence23 Oct 2025
- 2025WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoningcited by 53
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigmcited by 42
- 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoningcited by 24
- 2025Conan: Progressive Learning to Reason Like a Detective over Multi-Scale Visual Evidencecited by 18
- 2026ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoningcited by 8
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 4
- 2026MedScope: Incentivizing "Think with Videos" for Clinical Reasoning via Coarse-to-Fine Tool Callingcited by 2
- 2026MedClaw: Heuristic Agent Harness for Long-Horizon Surgical Video Reasoningcited by 2
- 2026SagaQA: A Multi-hop Reasoning Benchmark for Long-form Narrative Understanding in TV Seriescited by 1
- 2025Decoupling Perception from Reasoning for Hallucination-Resistant Video Understandingcited by 0
- 2026Act2See: Emergent Active Visual Perception for Video Reasoningcited by 0
- 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Open-o3-Video-v2: Seek, Ground, and Reason with Verifiable Spatio-Temporal Evidence13 Oct 2026
- 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Models22 Sep 2026
- 2026MedClaw: Heuristic Agent Harness for Long-Horizon Surgical Video Reasoning14 Aug 2026
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 2026SagaQA: A Multi-hop Reasoning Benchmark for Long-form Narrative Understanding in TV Series2 Jun 2026
- 2026Act2See: Emergent Active Visual Perception for Video Reasoning3 May 2026
- 2026ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoning30 Mar 2026
- 2026MedScope: Incentivizing "Think with Videos" for Clinical Reasoning via Coarse-to-Fine Tool Calling11 Feb 2026
- 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoning30 Jan 2026
- 2025WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoning2 Dec 2025
- 2025Decoupling Perception from Reasoning for Hallucination-Resistant Video Understanding23 Nov 2025
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigm6 Nov 2025
12 newest of 13 All 13 (JSON)
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understandingcited by 1
- 2026One Skill Does Not Fit All: Automatic Discovery and Taxonomy-Guided Routing of Frame-Selection Skills for Long-Video Question Answeringcited by 1
- 2026EFlow: Learning Evidence Flow for Long-Video Reasoning with Adaptive Reflectioncited by 0
- 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoningcited by 0
- 2026VideoEvoHarness: Self Evolving Agent Harness from Unlabeled Videos for Video Understandingcited by 0
- 2026Mitigating Video Hallucinations via Attention-Guided Representation Perturbationcited by 0
- 2026Mitigating Video Hallucinations via Attention-Guided Representation Perturbation14 Oct 2026
- 2026VideoEvoHarness: Self Evolving Agent Harness from Unlabeled Videos for Video Understanding11 Oct 2026
- 2026One Skill Does Not Fit All: Automatic Discovery and Taxonomy-Guided Routing of Frame-Selection Skills for Long-Video Question Answering11 Sep 2026
- 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning8 Aug 2026
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding6 Aug 2026
- 2026EFlow: Learning Evidence Flow for Long-Video Reasoning with Adaptive Reflection1 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understanding
- 2026EasyVideoR1: Easier RL for Video Understanding
- 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
- 2026Video Models Can Reason with Verifiable Rewards
- 2026video-SALMONN-R3: Learning to ReWatch, ReAsk, and ReAnswer for Efficient Video Understanding
- 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding
- 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting