VideoSeek: Long-Horizon Video Agent with Tool-Guided Seeking
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Video agentic models have advanced challenging video-language tasks. However, most agentic approaches still heavily rely on greedy parsing over densely sampled video frames, resulting in high computational cost. We present VideoSeek, a long-horizon video agent that leverages video logic flow to actively seek answer-critical evidence instead of exhaustively parsing the full video. This insight allows the model to use far fewer frames while maintaining, or even improving, its video understanding capability. VideoSeek operates in a think-act-observe loop with a well-designed toolkit for collecting multi-granular video observations. This design enables query-aware exploration over accumulated observations and supports practical video understanding and reasoning. Experiments on four challenging video understanding and reasoning benchmarks demonstrate that VideoSeek achieves strong accuracy while using far fewer frames than prior video agents and standalone LMMs. Notably, VideoSeek achieves a 10.2 absolute points improvement on LVBench over its base model, GPT-5, while using 93% fewer frames. Further analysis highlights the significance of leveraging video logic flow, strong reasoning capability, and the complementary roles of toolkit design.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 56 of its 72 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
56 of 72 references.
Closest ancestors · 5
Same direction, newest first
- 2025MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agents14 Aug
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent7 Aug
- 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understanding23 May
- 2024VCA: Video Curious Agent for Long Video Understanding12 Dec
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agent15 Mar
Other references · 51
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
38 more
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
- 2017Dense-Captioning Events in Videoscited by 789
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
- 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 386
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
- 2017Temporal Relational Reasoning in Videoscited by 324
- 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 320
- 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 248
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 242
- 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 210
- 2023Video Understanding with Large Language Models: A Surveycited by 203
- 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensioncited by 134
- 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 133
- 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 122
- 2021AGQA: A Benchmark for Compositional Spatio-Temporal Reasoningcited by 120
- 2024HourVideo: 1-Hour Video-Language Understandingcited by 110
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 107
- 2024Apollo: An Exploration of Video Understanding in Large Multimodal Modelscited by 87
- 2025A Survey on Vision-Language-Action Models for Autonomous Drivingcited by 72
- 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 67
- 2024DrVideo: Document Retrieval Based Long Video Understandingcited by 63
- 2023VideoXum: Cross-modal Visual and Textural Summarization of Videoscited by 41
- 2025SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understandingcited by 30
- 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1cited by 24
- 2025MR. Video: "MapReduce" is the Principle for Long Video Understandingcited by 23
- 2025Unleashing Hour-Scale Video Training for Long Video-Language Understandingcited by 21
- 2024Grounding Partially-Defined Events in Multimodal Datacited by 10
- 2024Real-Time Multimodal Cognitive Assistant for Emergency Medical Servicescited by 8
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
By area:
- 2026MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanismcited by 6
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 3
- 2026StreamScout: Learning When to Look Deeper for Streaming Video Understandingcited by 2
- 2026ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Groundingcited by 1
- 2026Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understandingcited by 1
- 2026Online Video Agent Harness for Long Video Understandingcited by 1
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understandingcited by 0
- 2026LAVE: Latent Visual Evidence-Enhanced Planning for Video Tool-use Agentscited by 0
- 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoningcited by 0
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understandingcited by 0
- 2026Agentic Video Understanding: A Surveycited by 0
- 2026Video-RSI: Recursive Self-Improvement of Video Understanding Agents via Harness Evolutioncited by 0
- 2026VidHarness: Evolving Agent Harnesses for Cost-Efficient Long Video Understanding29 Sep 2026
- 2026VideoLoop: Looped Working Memory Against Semantic Thrashing in Long-Form Video Agents29 Sep 2026
- 2026Video-RSI: Recursive Self-Improvement of Video Understanding Agents via Harness Evolution29 Sep 2026
- 2026Agentic Video Understanding: A Survey21 Sep 2026
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understanding17 Sep 2026
- 2026Online Video Agent Harness for Long Video Understanding11 Sep 2026
- 2026StreamScout: Learning When to Look Deeper for Streaming Video Understanding31 Aug 2026
- 2026Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understanding21 Aug 2026
- 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning8 Aug 2026
- 2026LAVE: Latent Visual Evidence-Enhanced Planning for Video Tool-use Agents5 Aug 2026
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding4 Aug 2026
- 2026MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanism5 Jun 2026
- 2026MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanismcited by 6
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 3
- 2026ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Groundingcited by 1
- 2026VideoLoop: Looped Working Memory Against Semantic Thrashing in Long-Form Video Agentscited by 0
- 2026VideoLoop: Looped Working Memory Against Semantic Thrashing in Long-Form Video Agents29 Sep 2026
- 2026MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanism5 Jun 2026
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 2026ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Grounding13 May 2026
- 2026StreamScout: Learning When to Look Deeper for Streaming Video Understandingcited by 2
- 2026Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understandingcited by 1
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understandingcited by 0
- 2026LAVE: Latent Visual Evidence-Enhanced Planning for Video Tool-use Agentscited by 0
- 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoningcited by 0
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understandingcited by 0
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understanding17 Sep 2026
- 2026StreamScout: Learning When to Look Deeper for Streaming Video Understanding31 Aug 2026
- 2026Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understanding21 Aug 2026
- 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning8 Aug 2026
- 2026LAVE: Latent Visual Evidence-Enhanced Planning for Video Tool-use Agents5 Aug 2026
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding4 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Think, Then Verify: A Hypothesis-Verification Multi-Agent Framework for Long Video Understanding
- 2024Adaptive Video Understanding Agent: Enhancing efficiency with dynamic frame sampling and feedback-driven reasoning
- 2026Watching, Reasoning, and Searching: A Video Deep Research Benchmark on Open Web for Agentic Video Reasoning
- 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding
- 2026VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding
- 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoning
- 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoning
- 2026VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority