mlsanityData to 7 Oct 2026

Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent

arXiv 2608.03979 ↗First posted 4 Aug 2026cs.CV cs.AIcited by 2

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

We introduce Video-DeepResearch (Video-DR), extending multimodal agents from static images to continuous video streams, a setting that demands dense spatiotemporal grounding coupled with open-web exploration. Preliminary evaluations reveal two critical bottlenecks in current models: (1) modality bias, where agents bypass visual tools in favor of textual search, and (2) parametric knowledge leakage, where models rely on internal memory rather than genuine tool-augmented execution. To address these challenges, we propose Video-DR, featuring a decoupled perception-exploration pipeline with stage-wise tool unlocking that compels exhaustive cross-frame visual grounding prior to web retrieval. Our framework adopts a two-stage training recipe: supervised fine-tuning followed by Group Relative Policy Optimization (GRPO), enabling autonomous exploration that breaks the imitation-learning ceiling. Furthermore, we curate Video-DR-Bench, a human-AI collaborative benchmark comprising 200 complex, multi-hop VQA instances. Empirical results demonstrate that our Video-DeepResearch-35B-A3B establishes a new state-of-the-art of 64.0% average accuracy, surpassing proprietary Claude-4.5-Sonnet (59.0%) by 5.0 points and significantly outperforming GPT-5 (52.5%) and Gemini 2.5 Pro (57.5%). The 30B-A3B variant achieves 59.3%, competitive with Claude-4.5-Sonnet and demonstrating the effectiveness of our training paradigm even at compact scale. Code: https://github.com/Osilly/Vision-DeepResearch.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 33 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

23 of 33 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Gen-Searcher: Reinforcing Agentic Search for Image Generation30 Mar

Other references · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  3. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  4. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
  5. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
  6. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
  7. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
  8. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
  9. 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 203
  10. 2016FVQA: Fact-based Visual Question Answeringcited by 181
  11. 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 147
  12. 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 120
10 more
  1. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 107
  2. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 88
  3. 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 67
  4. 2025Sekai: A Video Dataset towards World Explorationcited by 64
  5. 2025DeepMMSearch-R1: Empowering Multimodal LLMs in Multimodal Web Searchcited by 41
  6. 2024InfiniBench: A Benchmark for Large Multi-Modal Models in Long-Form Movies and TV Showscited by 20
  7. 2025VideoUFO: A Million-Scale User-Focused Dataset for Text-to-Video Generationcited by 20
  8. 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agentscited by 18
  9. 2025STAGE: Stable and Generalizable GRPO for Autoregressive Image Generationcited by 15
  10. 2026MMOU: A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videoscited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning
  2. 2026VideoResearchAgent: Grounded Task Synthesis and Sim-to-Real RL for Open-Web Video Research
  3. 2026DeepImageSearch: Benchmarking Multimodal Agents for Context-Aware Image Retrieval in Visual Histories
  4. 2025Video-Browser: Towards Agentic Open-web Video Browsing
  5. 2026Verify, Don't Trust: Agentic Model Development for Video Discovery Retrieval at Scale
  6. 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understanding
  7. 2026DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents
  8. 2026LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO