VideoResearcher: Self-Improving Tool Design for Long-Video Understanding
Not on the map. Why?
Abstract (arXiv)
Video agents have made substantial progress in long-video understanding. Yet effective video-agent systems require costly, time-consuming manual design and trial and error. Current self-improvement methods either refine low-impact prompts, recombine predefined micro-tools, or struggle with convergence in harness optimization. To bridge this gap, we target high-impact video-tool with VideoResearcher, a training-free multi-agent framework that autonomously designs, tests, and refines tools for video understanding, like a human researcher. VideoResearcher operates through dual Solving and Evolving loops: it analyzes tool-use trajectories to identify capability gaps, coordinates specialized agents to develop and validate executable tools, and reuses evolved tools to strengthen evidence acquisition in subsequent video reasoning. Through iterative tool refinement and validation, it progressively strengthens evidence acquisition without updating model parameters. VideoResearcher achieves state-of-the-art performance among self-improving agents and approaches the human-designed upper bound, demonstrating a training-free paradigm for long-video understanding that expands agent capabilities through autonomous tool development while reducing costly manual engineering.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 73 of its 78 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
73 of 78 references.
References · 73
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
38 more
- 2024Long Context Transfer from Language to Visioncited by 502
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
- 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 386
- 2024Automated Design of Agentic Systemscited by 360
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 323
- 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 320
- 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2023Large Language Models as Tool Makerscited by 293
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 285
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 242
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
- 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understandingcited by 223
- 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 210
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 161
- 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensioncited by 134
- 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
- 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agentscited by 120
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 117
- 2024HourVideo: 1-Hour Video-Language Understandingcited by 110
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 107
- 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systemscited by 96
- 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 94
- 2024DyCoke: Dynamic Compression of Tokens for Fast Video Large Language Modelscited by 93
- 2023CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Modelscited by 90
- 2024Apollo: An Exploration of Video Understanding in Large Multimodal Modelscited by 87
- 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 67
- 2024DrVideo: Document Retrieval Based Long Video Understandingcited by 63
- 2025VideoRAG: Retrieval-Augmented Generation over Video Corpuscited by 55
- 2024VCA: Video Curious Agent for Long Video Understandingcited by 54
- 2024Offline Training of Language Model Agents with Functions as Learnable Weightscited by 47
50 most cited of 73 All 73 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning
- 2026Video-RSI: Recursive Self-Improvement of Video Understanding Agents via Harness Evolution
- 2026Agentic Video Understanding: A Survey
- 2026ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Grounding
- 2026VideoResearchAgent: Grounded Task Synthesis and Sim-to-Real RL for Open-Web Video Research
- 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding
- 2026Verify, Don't Trust: Agentic Model Development for Video Discovery Retrieval at Scale
- 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning