VideoExplorer: Think With Videos For Agentic Long-Video Understanding
Not on the map. Why?
Abstract (arXiv)
Long-video understanding~(LVU) is a challenging problem in computer vision. Existing methods either downsample frames for single-pass reasoning, sacrificing fine-grained details, or depend on textual reasoning over task-agnostic representations, hindering task-specific perception and exploration. In this paper, we propose VideoExplorer, a framework grounded in the principle of ``thinking with video'', which naturally intertwines planning, temporal grounding, and scalable perception into a coherent reasoning process. Rather than reasoning over a static context, VideoExplorer iteratively formulates sub-questions, locates relevant moments, and performs task-oriented, temporally scalable video understanding until reaching the final answer, enabling faithful, efficient, and interpretable reasoning. To address the lack of LVU training resources, we construct a long-video reasoning dataset using difficulty-adaptive sampling to ensure high-quality trajectories on complex tasks. Building on this dataset, we design a two-stage training pipeline: supervised trajectory initialization followed by trajectory-level preference optimization, encouraging adaptive temporal grounding and iterative information integration guided by downstream rewards. Extensive evaluations on popular long-video understanding and reasoning benchmarks demonstrate VideoExplorer's significant advantage over existing baselines, highlighting its robustness, adaptability, and efficiency. Our code is made publicly available in this repository(https://github.com/yhy-2000/VideoDeepResearch).
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 12 Jun 2025.
Builds on
22 of 31 references.
References · 22
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023Visual Instruction Tuningcited by 7,792
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
- 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 386
- 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 366
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 323
10 more
- 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 242
- 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 212
- 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 210
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
- 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoningcited by 59
- 2025VideoAgent2: Enhancing the LLM-Based Agent System for Long-Form Video Understanding by Uncertainty-Aware CoTcited by 36
- 2025Unleashing Hour-Scale Video Training for Long Video-Language Understandingcited by 21
- 2025VideoMultiAgents: A Multi-Agent Framework for Video Question Answeringcited by 16
- 2025MASR: Self-Reflective Reasoning through Multimodal Hierarchical Attention Focusing for Agent-based Video Understandingcited by 4
Built on by
Citing papers per year: 2025: 9; 2026: 20.
29 papers.
Sort:
By area:
- 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challengescited by 58
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understandingcited by 26
- 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoningcited by 24
- 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesiscited by 22
- 2026OmniGAIA: Towards Native Omni-Modal AI Agentscited by 21
- 2026Agentic Very Long Video Understandingcited by 19
- 2025Video-CoM: Interactive Video Reasoning via Chain of Manipulationscited by 9
- 2025Video-Browser: Towards Agentic Open-web Video Browsingcited by 9
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Modelscited by 8
- 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoningcited by 7
- 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understandingcited by 6
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learningcited by 6
17 more
- 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videoscited by 6
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verificationcited by 6
- 2026VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authoritycited by 5
- 2026SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaborationcited by 4
- 2026Visual Agentic Memory: Enabling Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrievalcited by 2
- 2026TRACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understandingcited by 2
- 2026Beyond Closed-Pool Video Retrieval: A Benchmark and Agent Framework for Real-World Video Search and Moment Localizationcited by 1
- 2026ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Groundingcited by 1
- 2026SagaQA: A Multi-hop Reasoning Benchmark for Long-form Narrative Understanding in TV Seriescited by 1
- 2026Incentivizing Vision Language Models to Search for Long Video Question Answeringcited by 1
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMscited by 1
- 2026MAG-3D: Multi-Agent Grounded Reasoning for 3D Understandingcited by 0
- 2026LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Modelscited by 0
- 2026Counterfactual Sensitivity Is Not Repairability: Auditing Replay Probes for Video Evidencecited by 0
- 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applicationscited by 0
- 2026AdaVDR: Adaptive Tool Use and Reflection for Video Deep Researchcited by 0
- 2026Agentic Video Understanding: A Surveycited by 0
- 2026Agentic Video Understanding: A Survey21 Sep 2026
- 2026AdaVDR: Adaptive Tool Use and Reflection for Video Deep Research26 Aug 2026
- 2026TRACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understanding23 Aug 2026
- 2026Counterfactual Sensitivity Is Not Repairability: Auditing Replay Probes for Video Evidence16 Aug 2026
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs14 Jul 2026
- 2026Incentivizing Vision Language Models to Search for Long Video Question Answering3 Jul 2026
- 2026LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Models1 Jul 2026
- 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications28 Jun 2026
- 2026SagaQA: A Multi-hop Reasoning Benchmark for Long-form Narrative Understanding in TV Series2 Jun 2026
- 2026Visual Agentic Memory: Enabling Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrieval15 May 2026
- 2026ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Grounding13 May 2026
- 2026VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority12 May 2026
17 more
- 2026MAG-3D: Multi-Agent Grounded Reasoning for 3D Understanding10 Apr 2026
- 2026SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaboration6 Apr 2026
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verification2 Apr 2026
- 2026OmniGAIA: Towards Native Omni-Modal AI Agents26 Feb 2026
- 2026Beyond Closed-Pool Video Retrieval: A Benchmark and Agent Framework for Real-World Video Search and Moment Localization10 Feb 2026
- 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videos8 Feb 2026
- 2026Agentic Very Long Video Understanding26 Jan 2026
- 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoning22 Jan 2026
- 2025Video-Browser: Towards Agentic Open-web Video Browsing28 Dec 2025
- 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoning26 Dec 2025
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learning15 Dec 2025
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding5 Dec 2025
- 2025Video-CoM: Interactive Video Reasoning via Chain of Manipulations28 Nov 2025
- 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding18 Nov 2025
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Models6 Oct 2025
- 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesis28 Sep 2025
- 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challenges3 Aug 2025
- 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challengescited by 58
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understandingcited by 26
- 2026OmniGAIA: Towards Native Omni-Modal AI Agentscited by 21
- 2026Agentic Very Long Video Understandingcited by 19
- 2025Video-Browser: Towards Agentic Open-web Video Browsingcited by 9
- 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understandingcited by 6
- 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videoscited by 6
- 2026VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authoritycited by 5
- 2026Visual Agentic Memory: Enabling Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrievalcited by 2
- 2026Beyond Closed-Pool Video Retrieval: A Benchmark and Agent Framework for Real-World Video Search and Moment Localizationcited by 1
- 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applicationscited by 0
- 2026Agentic Video Understanding: A Surveycited by 0
- 2026Agentic Video Understanding: A Survey21 Sep 2026
- 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications28 Jun 2026
- 2026Visual Agentic Memory: Enabling Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrieval15 May 2026
- 2026VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority12 May 2026
- 2026OmniGAIA: Towards Native Omni-Modal AI Agents26 Feb 2026
- 2026Beyond Closed-Pool Video Retrieval: A Benchmark and Agent Framework for Real-World Video Search and Moment Localization10 Feb 2026
- 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videos8 Feb 2026
- 2026Agentic Very Long Video Understanding26 Jan 2026
- 2025Video-Browser: Towards Agentic Open-web Video Browsing28 Dec 2025
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding5 Dec 2025
- 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding18 Nov 2025
- 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challenges3 Aug 2025
- 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoningcited by 24
- 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesiscited by 22
- 2025Video-CoM: Interactive Video Reasoning via Chain of Manipulationscited by 9
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Modelscited by 8
- 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoningcited by 7
- 2026ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Groundingcited by 1
- 2026SagaQA: A Multi-hop Reasoning Benchmark for Long-form Narrative Understanding in TV Seriescited by 1
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMscited by 1
- 2026MAG-3D: Multi-Agent Grounded Reasoning for 3D Understandingcited by 0
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs14 Jul 2026
- 2026SagaQA: A Multi-hop Reasoning Benchmark for Long-form Narrative Understanding in TV Series2 Jun 2026
- 2026ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Grounding13 May 2026
- 2026MAG-3D: Multi-Agent Grounded Reasoning for 3D Understanding10 Apr 2026
- 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoning22 Jan 2026
- 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoning26 Dec 2025
- 2025Video-CoM: Interactive Video Reasoning via Chain of Manipulations28 Nov 2025
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Models6 Oct 2025
- 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesis28 Sep 2025
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verificationcited by 6
- 2026Incentivizing Vision Language Models to Search for Long Video Question Answeringcited by 1
- 2026LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Modelscited by 0
- 2026Incentivizing Vision Language Models to Search for Long Video Question Answering3 Jul 2026
- 2026LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Models1 Jul 2026
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verification2 Apr 2026
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learningcited by 6
- 2026SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaborationcited by 4
- 2026TRACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understandingcited by 2
- 2026Counterfactual Sensitivity Is Not Repairability: Auditing Replay Probes for Video Evidencecited by 0
- 2026AdaVDR: Adaptive Tool Use and Reflection for Video Deep Researchcited by 0
- 2026AdaVDR: Adaptive Tool Use and Reflection for Video Deep Research26 Aug 2026
- 2026TRACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understanding23 Aug 2026
- 2026Counterfactual Sensitivity Is Not Repairability: Auditing Replay Probes for Video Evidence16 Aug 2026
- 2026SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaboration6 Apr 2026
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learning15 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling
- 2026Think, Then Verify: A Hypothesis-Verification Multi-Agent Framework for Long Video Understanding
- 2026MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanism
- 2026VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding
- 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
- 2026Temporal Tree of Thought: Reasoning-Guided Visual Cue Search for Long-Video Understanding
- 2024VideoINSTA: Zero-shot Long Video Understanding via Informative Spatial-Temporal Reasoning with LLMs