mlsanityData to 7 Oct 2026

VideoResearchAgent: Grounded Task Synthesis and Sim-to-Real RL for Open-Web Video Research

arXiv 2610.04911 ↗First posted 4 Oct 2026cs.AI cs.CVcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents also fits: Web, search, and research agents

Abstract (arXiv)

Existing deep research agents are designed primarily for text- and image-based web sources, while video reasoning systems typically assume that relevant videos are provided in advance. We study open-web video research, where an agent must autonomously discover relevant videos, navigate their temporal content, and ground answers in visual evidence. Training such agents at scale is challenging as live video interaction is slow and unreliable, whereas fixed local simulation can induce retrieval-specific shortcuts that fail to transfer to the open web. We introduce VideoResearchAgent, a scalable training framework to address these challenges. First, we introduce controllable task synthesis pipeline to synthesize multi-hop research tasks from timestamped visual evidence while filtering text-only shortcuts. Second, we build a field-aligned local video simulator that preserves deployment-facing search and watch interactions while accelerating video search by a factor of 34.5-64.6. Third, we introduce Retrieval-Domain-Randomized GRPO (RDR-GRPO), which diversifies candidate rankings, distractors, metadata, and result structure during training to reduce overfitting to simulated retrieval. On Video-BrowseComp, the VideoResearchAgent trained using Qwen3.5-4B achieves 40.48% accuracy, comparable to Gemini-3-Flash-Preview, while reducing cumulative API-token consumption by 74.9% relative to the untrained model. Together, these results establish an accurate and efficient training recipe for open-web video research.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. First posted on arXiv 4 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent
  2. 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning
  3. 2026Watching, Reasoning, and Searching: A Video Deep Research Benchmark on Open Web for Agentic Video Reasoning
  4. 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understanding
  5. 2025Video-Browser: Towards Agentic Open-web Video Browsing
  6. 2026Verify, Don't Trust: Agentic Model Development for Video Discovery Retrieval at Scale
  7. 2026VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement
  8. 2026AdaVDR: Adaptive Tool Use and Reflection for Video Deep Research