mlsanityData to 7 Oct 2026

VideoResearcher: Self-Improving Tool Design for Long-Video Understanding

arXiv 2609.19664 ↗First posted 17 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Video agents have made substantial progress in long-video understanding. Yet effective video-agent systems require costly, time-consuming manual design and trial and error. Current self-improvement methods either refine low-impact prompts, recombine predefined micro-tools, or struggle with convergence in harness optimization. To bridge this gap, we target high-impact video-tool with VideoResearcher, a training-free multi-agent framework that autonomously designs, tests, and refines tools for video understanding, like a human researcher. VideoResearcher operates through dual Solving and Evolving loops: it analyzes tool-use trajectories to identify capability gaps, coordinates specialized agents to develop and validate executable tools, and reuses evolved tools to strengthen evidence acquisition in subsequent video reasoning. Through iterative tool refinement and validation, it progressively strengthens evidence acquisition without updating model parameters. VideoResearcher achieves state-of-the-art performance among self-improving agents and approaches the human-designed upper bound, demonstrating a training-free paradigm for long-video understanding that expands agent capabilities through autonomous tool development while reducing costly manual engineering.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 73 of its 78 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

73 of 78 references.

References · 73

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  6. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  7. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  8. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  9. 2023VideoChat: Chat-Centric Video Understandingcited by 851
  10. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  11. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
  12. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
38 more
  1. 2024Long Context Transfer from Language to Visioncited by 502
  2. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
  3. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  4. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
  5. 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 386
  6. 2024Automated Design of Agentic Systemscited by 360
  7. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
  8. 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 323
  9. 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 320
  10. 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
  11. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
  12. 2023Large Language Models as Tool Makerscited by 293
  13. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
  14. 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 285
  15. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  16. 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 242
  17. 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
  18. 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understandingcited by 223
  19. 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 210
  20. 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
  21. 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 161
  22. 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensioncited by 134
  23. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
  24. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
  25. 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agentscited by 120
  26. 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 117
  27. 2024HourVideo: 1-Hour Video-Language Understandingcited by 110
  28. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 107
  29. 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systemscited by 96
  30. 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 94
  31. 2024DyCoke: Dynamic Compression of Tokens for Fast Video Large Language Modelscited by 93
  32. 2023CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Modelscited by 90
  33. 2024Apollo: An Exploration of Video Understanding in Large Multimodal Modelscited by 87
  34. 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 67
  35. 2024DrVideo: Document Retrieval Based Long Video Understandingcited by 63
  36. 2025VideoRAG: Retrieval-Augmented Generation over Video Corpuscited by 55
  37. 2024VCA: Video Curious Agent for Long Video Understandingcited by 54
  38. 2024Offline Training of Language Model Agents with Functions as Learnable Weightscited by 47

50 most cited of 73 All 73 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning
  2. 2026Video-RSI: Recursive Self-Improvement of Video Understanding Agents via Harness Evolution
  3. 2026Agentic Video Understanding: A Survey
  4. 2026ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Grounding
  5. 2026VideoResearchAgent: Grounded Task Synthesis and Sim-to-Real RL for Open-Web Video Research
  6. 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding
  7. 2026Verify, Don't Trust: Agentic Model Development for Video Discovery Retrieval at Scale
  8. 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning