HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agents
On the map: Deep reinforcement learning methods → RL training of language and agent models
Abstract (arXiv)
Existing multimodal search agents process target entities sequentially, issuing one tool call per entity and accumulating redundant interaction rounds whenever a query decomposes into independent sub-retrievals. We argue that effective multimodal agents should search wider rather than longer: dispatching multiple grounded queries concurrently within a round. To this end, we present HyperEyes, a parallel multimodal search agent that fuses visual grounding and retrieval into a single atomic action, enabling concurrent search across multiple entities while treating inference efficiency as a first-class training objective. HyperEyes is trained in two stages. For cold-start supervision, we develop a Parallel-Amenable Data Synthesis Pipeline covering visual multi-entity and textual multi-constraint queries, curating efficiency-oriented trajectories via Progressive Rejection Sampling. Building on this, our central contribution, a Dual-Grained Efficiency-Aware Reinforcement Learning framework, operates at two levels. At the macro level, we propose TRACE (Tool-use Reference-Adaptive Cost Efficiency), a trajectory-level reward whose reference is monotonically tightened during training to suppress superfluous tool calls without restricting genuine multi-hop search. At the micro level, we adapt On-Policy Distillation to inject dense token-level corrective signals from an external teacher on failed rollouts, mitigating the credit-assignment deficiency of sparse outcome rewards. Since existing benchmarks evaluate accuracy as the sole metric, omitting inference cost, we introduce IMEB, a human-curated benchmark of 300 instances that jointly evaluates search capability and efficiency. Across six benchmarks, HyperEyes-30B surpasses the strongest comparable open-source agent by 9.9% in accuracy with 5.3x fewer tool-call rounds on average.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 34 of its 44 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
34 of 44 references.
References · 34
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024GPT-4o System Cardcited by 4,588
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
- 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023PaLM 2 Technical Reportcited by 1,162
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
22 more
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 309
- 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 223
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
- 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 124
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 119
- 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 101
- 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 81
- 2025DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RLcited by 55
- 2026REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agentscited by 49
- 2025DeepMMSearch-R1: Empowering Multimodal LLMs in Multimodal Web Searchcited by 42
- 2025MMSearch-Plus: Benchmarking Provenance-Aware Search for Multimodal Browsing Agentscited by 38
- 2026Vision-DeepResearch: Incentivizing DeepResearch Capability in Multimodal Large Language Modelscited by 37
- 2024INQUIRE: A Natural World Text-to-Image Retrieval Benchmarkcited by 33
- 2025Skywork-R1V4: Toward Agentic Multimodal Intelligence through Interleaved Thinking with Images and DeepResearchcited by 27
- 2025ParallelSearch: Train your LLMs to Decompose Query and Search Sub-queries in Parallel with Reinforcement Learningcited by 26
- 2025Seeking and Updating with Live Visual Knowledgecited by 24
- 2025Open Data Synthesis For Deep Researchcited by 16
- 2025Same or Not? Enhancing Visual Perception in Vision-Language Modelscited by 5
- 2025Hybrid Deep Searcher: Scalable Parallel and Sequential Search Reasoningcited by 4
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026VistaHop: Benchmarking Long-Horizon Visual DeepSearchcited by 3
- 2026StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understandingcited by 3
- 2026SimpleSearch-VL: A Simple Recipe for Multimodal Agentic Deep Searchcited by 2
- 2026WeAgent-MMSearch: Native Text-Vision Interaction for Multimodal Search Agentscited by 1
- 2026HindSearch: Trajectory-Level Hindsight Critique for Search-Augmented Reinforcement Learningcited by 0
- 2026Thinking Beyond Videos: Unifying Video Reasoning and Deep Research for Open-World Video Agentscited by 0
- 2026AdaVDR: Adaptive Tool Use and Reflection for Video Deep Researchcited by 0
- 2026Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agentscited by 0
- 2026SCAD: Structured Credit Assignment and Distillation for Long-Horizon Agentscited by 0
- 2026Long-MDR: Long-Context Reinforcement Learning for Multimodal Deep-Research Agentscited by 0
- 2026Long-MDR: Long-Context Reinforcement Learning for Multimodal Deep-Research Agents4 Oct 2026
- 2026SCAD: Structured Credit Assignment and Distillation for Long-Horizon Agents2 Oct 2026
- 2026Selection-Based Structured Reasoning: Toward Efficient Multimodal Search Agents1 Oct 2026
- 2026WeAgent-MMSearch: Native Text-Vision Interaction for Multimodal Search Agents28 Aug 2026
- 2026AdaVDR: Adaptive Tool Use and Reflection for Video Deep Research26 Aug 2026
- 2026Thinking Beyond Videos: Unifying Video Reasoning and Deep Research for Open-World Video Agents24 Aug 2026
- 2026StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding6 Aug 2026
- 2026HindSearch: Trajectory-Level Hindsight Critique for Search-Augmented Reinforcement Learning3 Aug 2026
- 2026SimpleSearch-VL: A Simple Recipe for Multimodal Agentic Deep Search30 Jun 2026
- 2026VistaHop: Benchmarking Long-Horizon Visual DeepSearch2 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026ProMMSearchAgent: A Generalizable Multimodal Search Agent Trained with Process-Oriented Rewards
- 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agents
- 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Management
- 2026VSearcher: Long-Horizon Multimodal Search Agent via Reinforcement Learning
- 2026Neos: Learning to Interleave Search and Visual Reasoning
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation
- 2026MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baseline
- 2026LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO