DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents
On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG
also in 1 more
Abstract (arXiv)
Multimodal large language models (MLLMs) have advanced visual understanding and reasoning, yet their static parametric knowledge limits their ability to address knowledge-intensive and dynamically evolving open-world problems. To move beyond this limitation, multimodal deep search has emerged as a key direction for open-world information access, evolving from single-turn factual retrieval toward long-horizon, multi-turn search guided by visual evidence. However, existing methods typically confine vision to the input or answer stage, overlooking its role in intermediate reasoning, and lack designs tailored to long-horizon interaction. Consequently, visual evidence rarely drives continued retrieval, constraining both interaction depth and reasoning span. To address these limitations, we propose DeepVoyager-VL, a long-horizon multimodal deep-search framework for vision-in-the-loop search. Specifically, we construct a multimodal event graph to drive data synthesis, yielding problems with intermediate visual dependencies and long reasoning chains. We then design an agent framework for active visual acquisition and on-demand image loading. Finally, we fine-tune models on the synthesized data without reinforcement learning. Extensive experiments across ten multimodal search benchmarks demonstrate the effectiveness of our method.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 41 of its 48 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
41 of 48 references.
Closest ancestors · 4
Same direction, newest first
- 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning13 Jun
- 2026VisBrowse-Bench: Benchmarking Visual-Native Search for Multimodal Browsing Agents17 Mar
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Models2 Feb
- 2025DeepMMSearch-R1: Empowering Multimodal LLMs in Multimodal Web Search14 Oct
Other references · 37
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
25 more
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 246
- 2024VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documentscited by 245
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
- 2022MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Textcited by 220
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
- 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 188
- 2025Thyme: Think Beyond Imagescited by 167
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
- 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 120
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 119
- 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 103
- 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 101
- 2025PyVision: Agentic Vision with Dynamic Toolingcited by 79
- 2025SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Modelscited by 66
- 2025Glyph: Scaling Context Windows via Visual-Text Compressioncited by 49
- 2026REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agentscited by 49
- 2025MMSearch-Plus: Benchmarking Provenance-Aware Search for Multimodal Browsing Agentscited by 38
- 2025Skywork-R1V4: Toward Agentic Multimodal Intelligence through Interleaved Thinking with Images and DeepResearchcited by 27
- 2025Seeking and Updating with Live Visual Knowledgecited by 24
- 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agentscited by 21
- 2026MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baselinecited by 20
- 2026InterLV-Search: Benchmarking Interleaved Multimodal Agentic Searchcited by 5
- 2026SimpleSearch-VL: A Simple Recipe for Multimodal Agentic Deep Searchcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Vision-DeepResearch: Incentivizing DeepResearch Capability in Multimodal Large Language Models
- 2026Towards Long-horizon Agentic Multimodal Search
- 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Management
- 2026VisLens: Single-Pass Interpretable Visual Search for Multimodal LLMs
- 2026LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO
- 2024Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
- 2026DeepImageSearch: Benchmarking Multimodal Agents for Context-Aware Image Retrieval in Visual Histories
- 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models