mlsanityData to 7 Oct 2026

VideoSeek: Long-Horizon Video Agent with Tool-Guided Seeking

arXiv 2603.20185 ↗First posted 20 Mar 2026cs.CV cs.AI cs.CLcited by 14

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Video agentic models have advanced challenging video-language tasks. However, most agentic approaches still heavily rely on greedy parsing over densely sampled video frames, resulting in high computational cost. We present VideoSeek, a long-horizon video agent that leverages video logic flow to actively seek answer-critical evidence instead of exhaustively parsing the full video. This insight allows the model to use far fewer frames while maintaining, or even improving, its video understanding capability. VideoSeek operates in a think-act-observe loop with a well-designed toolkit for collecting multi-granular video observations. This design enables query-aware exploration over accumulated observations and supports practical video understanding and reasoning. Experiments on four challenging video understanding and reasoning benchmarks demonstrate that VideoSeek achieves strong accuracy while using far fewer frames than prior video agents and standalone LMMs. Notably, VideoSeek achieves a 10.2 absolute points improvement on LVBench over its base model, GPT-5, while using 93% fewer frames. Further analysis highlights the significance of leveraging video logic flow, strong reasoning capability, and the complementary roles of toolkit design.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 56 of its 72 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

56 of 72 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agents14 Aug
  2. 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent7 Aug
  3. 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understanding23 May
  4. 2024VCA: Video Curious Agent for Long Video Understanding12 Dec
  5. 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agent15 Mar

Other references · 51

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2025Qwen2.5-VL Technical Reportcited by 5,418
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  10. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  11. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  12. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
38 more
  1. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  2. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  3. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  4. 2023VideoChat: Chat-Centric Video Understandingcited by 851
  5. 2017Dense-Captioning Events in Videoscited by 789
  6. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
  7. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
  8. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  9. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
  10. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  11. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
  12. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
  13. 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 386
  14. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
  15. 2017Temporal Relational Reasoning in Videoscited by 324
  16. 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 320
  17. 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
  18. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 248
  19. 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 242
  20. 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 210
  21. 2023Video Understanding with Large Language Models: A Surveycited by 203
  22. 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensioncited by 134
  23. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 133
  24. 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 122
  25. 2021AGQA: A Benchmark for Compositional Spatio-Temporal Reasoningcited by 120
  26. 2024HourVideo: 1-Hour Video-Language Understandingcited by 110
  27. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 107
  28. 2024Apollo: An Exploration of Video Understanding in Large Multimodal Modelscited by 87
  29. 2025A Survey on Vision-Language-Action Models for Autonomous Drivingcited by 72
  30. 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 67
  31. 2024DrVideo: Document Retrieval Based Long Video Understandingcited by 63
  32. 2023VideoXum: Cross-modal Visual and Textural Summarization of Videoscited by 41
  33. 2025SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understandingcited by 30
  34. 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1cited by 24
  35. 2025MR. Video: "MapReduce" is the Principle for Long Video Understandingcited by 23
  36. 2025Unleashing Hour-Scale Video Training for Long Video-Language Understandingcited by 21
  37. 2024Grounding Partially-Defined Events in Multimodal Datacited by 10
  38. 2024Real-Time Multimodal Cognitive Assistant for Emergency Medical Servicescited by 8

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 14.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Think, Then Verify: A Hypothesis-Verification Multi-Agent Framework for Long Video Understanding
  2. 2024Adaptive Video Understanding Agent: Enhancing efficiency with dynamic frame sampling and feedback-driven reasoning
  3. 2026Watching, Reasoning, and Searching: A Video Deep Research Benchmark on Open Web for Agentic Video Reasoning
  4. 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding
  5. 2026VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding
  6. 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoning
  7. 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoning
  8. 2026VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority