Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent advances in image reasoning methods, particularly "Thinking with Images", have demonstrated remarkable success in Multimodal Large Language Models (MLLMs); however, this dynamic reasoning paradigm has not yet been extended to video reasoning tasks. In this paper, we propose Video-Thinker, which empowers MLLMs to think with videos by autonomously leveraging their intrinsic "grounding" and "captioning" capabilities to generate reasoning clues throughout the inference process. To spark this capability, we construct Video-Thinker-10K, a curated dataset featuring autonomous tool usage within chain-of-thought reasoning sequences. Our training strategy begins with Supervised Fine-Tuning (SFT) to learn the reasoning format, followed by Group Relative Policy Optimization (GRPO) to strengthen this reasoning capability. Through this approach, Video-Thinker enables MLLMs to autonomously navigate grounding and captioning tasks for video reasoning, eliminating the need for constructing and calling external tools. Extensive experiments demonstrate that Video-Thinker achieves significant performance gains on both in-domain tasks and challenging out-of-domain video reasoning benchmarks, including Video-Holmes, CG-Bench-Reasoning, and VRBench. Our Video-Thinker-7B substantially outperforms existing baselines such as Video-R1 and establishes state-of-the-art performance among 7B-sized MLLMs.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 54 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
45 of 54 references.
Closest ancestors · 19
Same direction, newest first
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
- 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning19 Jun
- 2025VRBench: A Benchmark for Multi-Step Reasoning in Long Narrative Videos12 Jun
- 2025VisioMath: Benchmarking Figure-based Mathematical Reasoning in LMMs7 Jun
- 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
- 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency2 Jun
- 2025Reinforcing Video Reasoning with Focused Thinking30 May
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025Visual Agentic Reinforcement Fine-Tuning20 May
- 2025MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning15 May
- 2025IV-Bench: A Benchmark for Image-Grounded Video Perception and Reasoning in Multimodal LLMs21 Apr
7 more
- 2025VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Search12 Apr
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024Enhancing Video-LLM Reasoning via Agent-of-Thoughts Distillation2 Dec
- 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition7 May
- 2022Visual Programming: Compositional visual reasoning without training18 Nov
Other references · 26
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2025Qwen2.5-Omni Technical Reportcited by 704
- 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
- 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 498
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
14 more
- 2024STAR: A Benchmark for Situated Reasoning in Real-World Videoscited by 213
- 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 188
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Explorationcited by 99
- 2024CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understandingcited by 82
- 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 55
- 2024MC-LLaVA: Multi-Concept Personalized Vision-Language Modelcited by 53
- 2025Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videoscited by 49
- 2024LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Modelcited by 43
- 2025Unhackable Temporal Rewarding for Scalable Video MLLMscited by 33
- 2019TutorialVQA: Question Answering Dataset for Tutorial Videoscited by 20
- 2024II-Bench: An Image Implication Understanding Benchmark for Multimodal Large Language Modelscited by 15
- 2025PuzzleBench: A Fully Dynamic Evaluation Framework for Large Multimodal Models on Puzzle Solvingcited by 15
- 2025ScaleLong: A Multi-Timescale Benchmark for Long Video Understandingcited by 7
Built on by
Citing papers per year: 2025: 5; 2026: 27.
32 papers.
Sort:
By area:
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understandingcited by 26
- 2025AdaTooler-V: Adaptive Tool-Use for Images and Videoscited by 20
- 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoningcited by 20
- 2026Thinking in Streaming Videocited by 14
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attentioncited by 9
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026VideoBrain: Learning Adaptive Frame Sampling for Long Video Understandingcited by 7
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learningcited by 6
- 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videoscited by 6
- 2026EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Modelscited by 6
20 more
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verificationcited by 6
- 2026EVA: Efficient Reinforcement Learning for End-to-End Video Agentcited by 5
- 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learningcited by 5
- 2025Boosting Reasoning in Large Multimodal Models via Activation Replaycited by 4
- 2026Video-Based Reward Modeling for Computer-Use Agentscited by 3
- 2026Query-Conditioned Evidential Keyframe Sampling for MLLM-Based Long-Form Video Understandingcited by 3
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 3
- 2026VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocationcited by 1
- 2026VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understandingcited by 1
- 2026See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understandingcited by 1
- 2026OmniReasoner: Thinking with Long Audio-Video via Native Tool Usecited by 1
- 2026Online Video Agent Harness for Long Video Understandingcited by 1
- 2026STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Modelscited by 0
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligencecited by 0
- 2026Rubrics on Trial: Evolving Rubrics from a Single Query via Synthetic Pairwise Evidencecited by 0
- 2026Perception Before Reasoning: Dynamic Latent Reasoning for Video Understanding and Question Answeringcited by 0
- 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoningcited by 0
- 2026Zero-MELO: Test-Time Evidence Calibration with Multimodal LLMs for Zero-Shot Micro-Gesture Recognitioncited by 0
- 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Modelscited by 0
- 2026VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understandingcited by 0
- 2026VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understanding7 Oct 2026
- 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Models22 Sep 2026
- 2026Online Video Agent Harness for Long Video Understanding11 Sep 2026
- 2026Zero-MELO: Test-Time Evidence Calibration with Multimodal LLMs for Zero-Shot Micro-Gesture Recognition14 Aug 2026
- 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoning7 Aug 2026
- 2026Perception Before Reasoning: Dynamic Latent Reasoning for Video Understanding and Question Answering4 Aug 2026
- 2026OmniReasoner: Thinking with Long Audio-Video via Native Tool Use21 Jul 2026
- 2026Rubrics on Trial: Evolving Rubrics from a Single Query via Synthetic Pairwise Evidence16 Jul 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understanding8 Jun 2026
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 2026VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding3 Jun 2026
20 more
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence29 May 2026
- 2026STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Models25 May 2026
- 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning19 May 2026
- 2026VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocation15 May 2026
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agents12 Apr 2026
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verification2 Apr 2026
- 2026Query-Conditioned Evidential Keyframe Sampling for MLLM-Based Long-Form Video Understanding1 Apr 2026
- 2026EVA: Efficient Reinforcement Learning for End-to-End Video Agent24 Mar 2026
- 2026Thinking in Streaming Video13 Mar 2026
- 2026EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Models12 Mar 2026
- 2026Video-Based Reward Modeling for Computer-Use Agents10 Mar 2026
- 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videos8 Feb 2026
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attention5 Feb 2026
- 2026VideoBrain: Learning Adaptive Frame Sampling for Long Video Understanding4 Feb 2026
- 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoning30 Jan 2026
- 2025AdaTooler-V: Adaptive Tool-Use for Images and Videos18 Dec 2025
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learning15 Dec 2025
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding5 Dec 2025
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling25 Nov 2025
- 2025Boosting Reasoning in Large Multimodal Models via Activation Replay25 Nov 2025
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
- 2025AdaTooler-V: Adaptive Tool-Use for Images and Videoscited by 20
- 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoningcited by 20
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attentioncited by 9
- 2026EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Modelscited by 6
- 2025Boosting Reasoning in Large Multimodal Models via Activation Replaycited by 4
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 3
- 2026See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understandingcited by 1
- 2026OmniReasoner: Thinking with Long Audio-Video via Native Tool Usecited by 1
- 2026STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Modelscited by 0
- 2026Perception Before Reasoning: Dynamic Latent Reasoning for Video Understanding and Question Answeringcited by 0
- 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Models22 Sep 2026
- 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoning7 Aug 2026
- 2026Perception Before Reasoning: Dynamic Latent Reasoning for Video Understanding and Question Answering4 Aug 2026
- 2026OmniReasoner: Thinking with Long Audio-Video via Native Tool Use21 Jul 2026
- 2026See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understanding8 Jun 2026
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 2026STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Models25 May 2026
- 2026EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Models12 Mar 2026
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attention5 Feb 2026
- 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoning30 Jan 2026
- 2025AdaTooler-V: Adaptive Tool-Use for Images and Videos18 Dec 2025
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling25 Nov 2025
12 newest of 13 All 13 (JSON)
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understandingcited by 26
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videoscited by 6
- 2026Video-Based Reward Modeling for Computer-Use Agentscited by 3
- 2026Online Video Agent Harness for Long Video Understandingcited by 1
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligencecited by 0
- 2026VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understandingcited by 0
- 2026VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understanding7 Oct 2026
- 2026Online Video Agent Harness for Long Video Understanding11 Sep 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence29 May 2026
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agents12 Apr 2026
- 2026Video-Based Reward Modeling for Computer-Use Agents10 Mar 2026
- 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videos8 Feb 2026
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding5 Dec 2025
- 2026VideoBrain: Learning Adaptive Frame Sampling for Long Video Understandingcited by 7
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verificationcited by 6
- 2026EVA: Efficient Reinforcement Learning for End-to-End Video Agentcited by 5
- 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learningcited by 5
- 2026Query-Conditioned Evidential Keyframe Sampling for MLLM-Based Long-Form Video Understandingcited by 3
- 2026VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocationcited by 1
- 2026Zero-MELO: Test-Time Evidence Calibration with Multimodal LLMs for Zero-Shot Micro-Gesture Recognitioncited by 0
- 2026Zero-MELO: Test-Time Evidence Calibration with Multimodal LLMs for Zero-Shot Micro-Gesture Recognition14 Aug 2026
- 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning19 May 2026
- 2026VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocation15 May 2026
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verification2 Apr 2026
- 2026Query-Conditioned Evidential Keyframe Sampling for MLLM-Based Long-Form Video Understanding1 Apr 2026
- 2026EVA: Efficient Reinforcement Learning for End-to-End Video Agent24 Mar 2026
- 2026VideoBrain: Learning Adaptive Frame Sampling for Long Video Understanding4 Feb 2026
- 2026Thinking in Streaming Videocited by 14
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learningcited by 6
- 2026VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understandingcited by 1
- 2026Rubrics on Trial: Evolving Rubrics from a Single Query via Synthetic Pairwise Evidencecited by 0
- 2026Rubrics on Trial: Evolving Rubrics from a Single Query via Synthetic Pairwise Evidence16 Jul 2026
- 2026VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding3 Jun 2026
- 2026Thinking in Streaming Video13 Mar 2026
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learning15 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning
- 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting
- 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
- 2026AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning
- 2025Rethinking Chain-of-Thought Reasoning for Videos
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning
- 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoning
- 2025OneThinker: All-in-one Reasoning Model for Image and Video