VSearcher: Long-Horizon Multimodal Search Agent via Reinforcement Learning
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Large models are increasingly becoming autonomous agents that interact with real-world environments and use external tools to augment their static capabilities. However, most recent progress has focused on text-only large language models, which are limited to a single modality and therefore have narrower application scenarios. On the other hand, multimodal large models, while offering stronger perceptual capabilities, remain limited to static knowledge and lack the ability to access and leverage up-to-date web information. In this paper, we propose VSearcher, turning static multimodal model into multimodal search agent capable of long-horizon, multi-turn tool use in real-world web environments, including text search, image search, and web browsing, via reinforcement learning. Specifically, we introduce Iterative Injection Data Synthesis pipeline to generate large-scale, complex multimodal QA questions, which are further filtered with comprehensive metrics to ensure high quality and sufficient difficulty. We then adopt an SFT-then-RL training pipeline to turn base multimodal models to agent capable of multi-turn tool calling in real-world web environments. Besides, we propose a multimodal search benchmark MM-SearchExam dedicated to evaluating search capabilities of multimodal search agents, which proves highly challenging for recent proprietary models. Extensive evaluations across multiple multimodal search benchmarks reveal effectiveness of our method. VSearcher achieves superior performance compared to recent multimodal search agents and even surpasses several proprietary models on multimodal web search tasks.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 32 of its 37 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
32 of 37 references.
Closest ancestors · 2
Same direction, newest first
- 2025DeepEyesV2: Toward Agentic Multimodal Model7 Nov
- 2024Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent5 Nov
Other references · 30
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
18 more
- 2024The Power of Noise: Redefining Retrieval for RAG Systemscited by 281
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
- 2023Multimodal Large Language Models: A Surveycited by 195
- 2024MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGIcited by 193
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 149
- 2025Deep Research Agents: A Systematic Examination And Roadmapcited by 128
- 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 124
- 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 101
- 2024A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trendscited by 84
- 2024A Survey on Benchmarks of Multimodal Large Language Modelscited by 82
- 2024VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimationcited by 73
- 2025Deep Research: A Survey of Autonomous Research Agentscited by 66
- 2025A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applicationscited by 50
- 2025DeepMMSearch-R1: Empowering Multimodal LLMs in Multimodal Web Searchcited by 42
- 2025Creativity in LLM-based Multi-Agent Systems: A Surveycited by 23
- 2025WebLeaper: Empowering Efficiency and Efficacy in WebAgent via Enabling Info-Rich Seekingcited by 18
- 2025Uncertainty-o: One Model-agnostic Framework for Unveiling Uncertainty in Large Multimodal Modelscited by 5
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoningcited by 8
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulationcited by 5
- 2026VisDocAgentBench: Benchmarking Agents for Visually Rich Document Retrievalcited by 0
- 2026SkillRubric: Co-Evolving Actor Guidance and Evaluator Rubrics for Multimodal Agentscited by 0
- 2026Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agentscited by 0
- 2026SCAD: Structured Credit Assignment and Distillation for Long-Horizon Agentscited by 0
- 2026Long-MDR: Long-Context Reinforcement Learning for Multimodal Deep-Research Agentscited by 0
- 2026Neos: Learning to Interleave Search and Visual Reasoningcited by 0
- 2026Neos: Learning to Interleave Search and Visual Reasoning12 Oct 2026
- 2026Long-MDR: Long-Context Reinforcement Learning for Multimodal Deep-Research Agents4 Oct 2026
- 2026SCAD: Structured Credit Assignment and Distillation for Long-Horizon Agents2 Oct 2026
- 2026Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agents1 Oct 2026
- 2026SkillRubric: Co-Evolving Actor Guidance and Evaluator Rubrics for Multimodal Agents28 Sep 2026
- 2026VisDocAgentBench: Benchmarking Agents for Visually Rich Document Retrieval18 Aug 2026
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation7 Jul 2026
- 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning13 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026ProMMSearchAgent: A Generalizable Multimodal Search Agent Trained with Process-Oriented Rewards
- 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agents
- 2024OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization
- 2026Eliciting Self-Verification in Multimodal Reasoning Agents with Reinforcement Learning
- 2026LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO
- 2024Multimodal Query Suggestion with Multi-Agent Reinforcement Learning from Human Feedback
- 2026UNIBROWSE: A Data-to-Agent Framework for Multimodal BrowseComp
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environments