AdaVDR: Adaptive Tool Use and Reflection for Video Deep Research
Not on the map. Why?
Abstract (arXiv)
Video deep research aims to answer questions by jointly understanding video content and retrieving external knowledge from the open Web. However, these tasks often require diverse and multi-step tool-use trajectories, which may lead to unnecessary video tool calls, incurring additional costs and failure risk. In this paper, we propose AdaVDR, an adaptive video deep research agent with adaptive tool use and reflection, which selects tools based on task and model capabilities while backtracking when needed. To this end, we develop a data construction pipeline that builds adaptive tool-use trajectories according to task types and model capabilities. Specifically, we construct QA pairs that require both video and external information, and organize the information acquisition processes into task-specific tool-use trajectories. We then apply model-conditioned tool necessity filtering to remove tools that can be bypassed using video understanding and internal knowledge of the model. Based on this pipeline, we construct a training dataset with adaptive trajectories and perform SFT on them to initialize these capabilities of AdaVDR. To further improve adaptive capabilities, we propose NASA-GRPO, a necessity-aware segment-guided credit assignment method, which evaluates segment-guided evidence contribution and tool necessity to construct normalized tool-level rewards. We also construct VDR-EE, a benchmark built using the proposed pipeline. Experiments show that AdaVDR outperforms the base model by 15.20 and 29.00 percentage points on VDR-EE and the existing VideoDR, respectively, demonstrating its superiority.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 35 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
33 of 35 references.
References · 33
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024GPT-4o System Cardcited by 4,588
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2025OpenAI GPT-5 System Cardcited by 989
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2025Qwen3-Omni Technical Reportcited by 497
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
21 more
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 186
- 2026Qwen3.5-Omni Technical Reportcited by 174
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
- 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 124
- 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 98
- 2025EgoLife: Towards Egocentric Life Assistantcited by 91
- 2025Sekai: A Video Dataset towards World Explorationcited by 67
- 2025LVAgent: Long Video Understanding by Multi-Round Dynamical Collaboration of MLLM Agentscited by 58
- 2024VCA: Video Curious Agent for Long Video Understandingcited by 56
- 2026REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agentscited by 49
- 2024CityWalker: Learning Embodied Urban Navigation from Web-Scale Videoscited by 41
- 2025VideoAgent2: Enhancing the LLM-Based Agent System for Long-Form Video Understanding by Uncertainty-Aware CoTcited by 38
- 2026Vision-DeepResearch: Incentivizing DeepResearch Capability in Multimodal Large Language Modelscited by 37
- 2025VideoExplorer: Think With Videos For Agentic Long-Video Understandingcited by 29
- 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agentscited by 21
- 2026Watching, Reasoning, and Searching: A Video Deep Research Benchmark on Open Web for Agentic Video Reasoningcited by 14
- 2025Video-Browser: Towards Agentic Open-web Video Browsingcited by 10
- 2026HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agentscited by 10
- 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoningcited by 9
- 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoningcited by 8
- 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learningcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Thinking Beyond Videos: Unifying Video Reasoning and Deep Research for Open-World Video Agents
- 2026VideoResearchAgent: Grounded Task Synthesis and Sim-to-Real RL for Open-Web Video Research
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understanding
- 2026Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent
- 2026Verify, Don't Trust: Agentic Model Development for Video Discovery Retrieval at Scale
- 2026VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement
- 2026Mr.LHDR: A Benchmark for Multimodal Real-World Long-Horizon Deep Research Agents
- 2025AdaVideoRAG: Omni-Contextual Adaptive Retrieval-Augmented Efficient Long Video Understanding