mlsanityData to 14 Oct 2026

DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents

arXiv 2608.01827 ↗First posted 3 Aug 2026cs.CV cs.AIcited by 2

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

also in 1 more
Abstract (arXiv)

Multimodal large language models (MLLMs) have advanced visual understanding and reasoning, yet their static parametric knowledge limits their ability to address knowledge-intensive and dynamically evolving open-world problems. To move beyond this limitation, multimodal deep search has emerged as a key direction for open-world information access, evolving from single-turn factual retrieval toward long-horizon, multi-turn search guided by visual evidence. However, existing methods typically confine vision to the input or answer stage, overlooking its role in intermediate reasoning, and lack designs tailored to long-horizon interaction. Consequently, visual evidence rarely drives continued retrieval, constraining both interaction depth and reasoning span. To address these limitations, we propose DeepVoyager-VL, a long-horizon multimodal deep-search framework for vision-in-the-loop search. Specifically, we construct a multimodal event graph to drive data synthesis, yielding problems with intermediate visual dependencies and long reasoning chains. We then design an agent framework for active visual acquisition and on-demand image loading. Finally, we fine-tune models on the synthesized data without reinforcement learning. Extensive experiments across ten multimodal search benchmarks demonstrate the effectiveness of our method.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 41 of its 48 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

41 of 48 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning13 Jun
  2. 2026VisBrowse-Bench: Benchmarking Visual-Native Search for Multimodal Browsing Agents17 Mar
  3. 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Models2 Feb
  4. 2025DeepMMSearch-R1: Empowering Multimodal LLMs in Multimodal Web Search14 Oct

Other references · 37

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2024GPT-4o System Cardcited by 4,588
  7. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  8. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  9. 2025Qwen3-VL Technical Reportcited by 2,793
  10. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  11. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  12. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
25 more
  1. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
  2. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
  3. 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 246
  4. 2024VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documentscited by 245
  5. 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
  6. 2022MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Textcited by 220
  7. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
  8. 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 188
  9. 2025Thyme: Think Beyond Imagescited by 167
  10. 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
  11. 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 120
  12. 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 119
  13. 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 103
  14. 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 101
  15. 2025PyVision: Agentic Vision with Dynamic Toolingcited by 79
  16. 2025SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Modelscited by 66
  17. 2025Glyph: Scaling Context Windows via Visual-Text Compressioncited by 49
  18. 2026REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agentscited by 49
  19. 2025MMSearch-Plus: Benchmarking Provenance-Aware Search for Multimodal Browsing Agentscited by 38
  20. 2025Skywork-R1V4: Toward Agentic Multimodal Intelligence through Interleaved Thinking with Images and DeepResearchcited by 27
  21. 2025Seeking and Updating with Live Visual Knowledgecited by 24
  22. 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agentscited by 21
  23. 2026MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baselinecited by 20
  24. 2026InterLV-Search: Benchmarking Interleaved Multimodal Agentic Searchcited by 5
  25. 2026SimpleSearch-VL: A Simple Recipe for Multimodal Agentic Deep Searchcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Vision-DeepResearch: Incentivizing DeepResearch Capability in Multimodal Large Language Models
  2. 2026Towards Long-horizon Agentic Multimodal Search
  3. 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Management
  4. 2026VisLens: Single-Pass Interpretable Visual Search for Multimodal LLMs
  5. 2026LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO
  6. 2024Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
  7. 2026DeepImageSearch: Benchmarking Multimodal Agents for Context-Aware Image Retrieval in Visual Histories
  8. 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models