mlsanityData to 7 Oct 2026

Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learning

arXiv 2510.23473 ↗First posted 27 Oct 2025cs.CVcited by 32

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Recent advances in image reasoning methods, particularly "Thinking with Images", have demonstrated remarkable success in Multimodal Large Language Models (MLLMs); however, this dynamic reasoning paradigm has not yet been extended to video reasoning tasks. In this paper, we propose Video-Thinker, which empowers MLLMs to think with videos by autonomously leveraging their intrinsic "grounding" and "captioning" capabilities to generate reasoning clues throughout the inference process. To spark this capability, we construct Video-Thinker-10K, a curated dataset featuring autonomous tool usage within chain-of-thought reasoning sequences. Our training strategy begins with Supervised Fine-Tuning (SFT) to learn the reasoning format, followed by Group Relative Policy Optimization (GRPO) to strengthen this reasoning capability. Through this approach, Video-Thinker enables MLLMs to autonomously navigate grounding and captioning tasks for video reasoning, eliminating the need for constructing and calling external tools. Extensive experiments demonstrate that Video-Thinker achieves significant performance gains on both in-domain tasks and challenging out-of-domain video reasoning benchmarks, including Video-Holmes, CG-Bench-Reasoning, and VRBench. Our Video-Thinker-7B substantially outperforms existing baselines such as Video-R1 and establishes state-of-the-art performance among 7B-sized MLLMs.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 54 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

45 of 54 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
  2. 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning19 Jun
  3. 2025VRBench: A Benchmark for Multi-Step Reasoning in Long Narrative Videos12 Jun
  4. 2025VisioMath: Benchmarking Figure-based Mathematical Reasoning in LMMs7 Jun
  5. 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
  6. 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency2 Jun
  7. 2025Reinforcing Video Reasoning with Focused Thinking30 May
  8. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
  9. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  10. 2025Visual Agentic Reinforcement Fine-Tuning20 May
  11. 2025MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning15 May
  12. 2025IV-Bench: A Benchmark for Image-Grounded Video Perception and Reasoning in Multimodal LLMs21 Apr
7 more
  1. 2025VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Search12 Apr
  2. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  3. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  4. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  5. 2024Enhancing Video-LLM Reasoning via Agent-of-Thoughts Distillation2 Dec
  6. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition7 May
  7. 2022Visual Programming: Compositional visual reasoning without training18 Nov

Other references · 26

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  7. 2025Qwen2.5-Omni Technical Reportcited by 704
  8. 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
  9. 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 498
  10. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  11. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
  12. 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
14 more
  1. 2024STAR: A Benchmark for Situated Reasoning in Real-World Videoscited by 213
  2. 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 188
  3. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
  4. 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Explorationcited by 99
  5. 2024CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understandingcited by 82
  6. 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 55
  7. 2024MC-LLaVA: Multi-Concept Personalized Vision-Language Modelcited by 53
  8. 2025Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videoscited by 49
  9. 2024LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Modelcited by 43
  10. 2025Unhackable Temporal Rewarding for Scalable Video MLLMscited by 33
  11. 2019TutorialVQA: Question Answering Dataset for Tutorial Videoscited by 20
  12. 2024II-Bench: An Image Implication Understanding Benchmark for Multimodal Large Language Modelscited by 15
  13. 2025PuzzleBench: A Fully Dynamic Evaluation Framework for Large Multimodal Models on Puzzle Solvingcited by 15
  14. 2025ScaleLong: A Multi-Timescale Benchmark for Long Video Understandingcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 27.

32 papers.

Sort:

By area:

  1. 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
  2. 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understandingcited by 26
  3. 2025AdaTooler-V: Adaptive Tool-Use for Images and Videoscited by 20
  4. 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoningcited by 20
  5. 2026Thinking in Streaming Videocited by 14
  6. 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
  7. 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attentioncited by 9
  8. 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
  9. 2026VideoBrain: Learning Adaptive Frame Sampling for Long Video Understandingcited by 7
  10. 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learningcited by 6
  11. 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videoscited by 6
  12. 2026EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Modelscited by 6
20 more
  1. 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verificationcited by 6
  2. 2026EVA: Efficient Reinforcement Learning for End-to-End Video Agentcited by 5
  3. 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learningcited by 5
  4. 2025Boosting Reasoning in Large Multimodal Models via Activation Replaycited by 4
  5. 2026Video-Based Reward Modeling for Computer-Use Agentscited by 3
  6. 2026Query-Conditioned Evidential Keyframe Sampling for MLLM-Based Long-Form Video Understandingcited by 3
  7. 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 3
  8. 2026VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocationcited by 1
  9. 2026VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understandingcited by 1
  10. 2026See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understandingcited by 1
  11. 2026OmniReasoner: Thinking with Long Audio-Video via Native Tool Usecited by 1
  12. 2026Online Video Agent Harness for Long Video Understandingcited by 1
  13. 2026STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Modelscited by 0
  14. 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligencecited by 0
  15. 2026Rubrics on Trial: Evolving Rubrics from a Single Query via Synthetic Pairwise Evidencecited by 0
  16. 2026Perception Before Reasoning: Dynamic Latent Reasoning for Video Understanding and Question Answeringcited by 0
  17. 2026Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoningcited by 0
  18. 2026Zero-MELO: Test-Time Evidence Calibration with Multimodal LLMs for Zero-Shot Micro-Gesture Recognitioncited by 0
  19. 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Modelscited by 0
  20. 2026VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understandingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning
  2. 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting
  3. 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
  4. 2026AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning
  5. 2025Rethinking Chain-of-Thought Reasoning for Videos
  6. 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning
  7. 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoning
  8. 2025OneThinker: All-in-one Reasoning Model for Image and Video