mlsanityData to 14 Oct 2026

HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agents

arXiv 2605.07177 ↗First posted 8 May 2026cs.LG cs.AIcited by 10

On the map: Deep reinforcement learning methods → RL training of language and agent models

Abstract (arXiv)

Existing multimodal search agents process target entities sequentially, issuing one tool call per entity and accumulating redundant interaction rounds whenever a query decomposes into independent sub-retrievals. We argue that effective multimodal agents should search wider rather than longer: dispatching multiple grounded queries concurrently within a round. To this end, we present HyperEyes, a parallel multimodal search agent that fuses visual grounding and retrieval into a single atomic action, enabling concurrent search across multiple entities while treating inference efficiency as a first-class training objective. HyperEyes is trained in two stages. For cold-start supervision, we develop a Parallel-Amenable Data Synthesis Pipeline covering visual multi-entity and textual multi-constraint queries, curating efficiency-oriented trajectories via Progressive Rejection Sampling. Building on this, our central contribution, a Dual-Grained Efficiency-Aware Reinforcement Learning framework, operates at two levels. At the macro level, we propose TRACE (Tool-use Reference-Adaptive Cost Efficiency), a trajectory-level reward whose reference is monotonically tightened during training to suppress superfluous tool calls without restricting genuine multi-hop search. At the micro level, we adapt On-Policy Distillation to inject dense token-level corrective signals from an external teacher on failed rollouts, mitigating the credit-assignment deficiency of sparse outcome rewards. Since existing benchmarks evaluate accuracy as the sole metric, omitting inference cost, we introduce IMEB, a human-curated benchmark of 300 instances that jointly evaluates search capability and efficiency. Across six benchmarks, HyperEyes-30B surpasses the strongest comparable open-source agent by 9.9% in accuracy with 5.3x fewer tool-call rounds on average.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 34 of its 44 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

34 of 44 references.

References · 34

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2024GPT-4o System Cardcited by 4,588
  7. 2025Qwen3-VL Technical Reportcited by 2,793
  8. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  9. 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
  10. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  11. 2023PaLM 2 Technical Reportcited by 1,162
  12. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
22 more
  1. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
  2. 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
  3. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  4. 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 309
  5. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 223
  6. 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
  7. 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 124
  8. 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 119
  9. 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 101
  10. 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 81
  11. 2025DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RLcited by 55
  12. 2026REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agentscited by 49
  13. 2025DeepMMSearch-R1: Empowering Multimodal LLMs in Multimodal Web Searchcited by 42
  14. 2025MMSearch-Plus: Benchmarking Provenance-Aware Search for Multimodal Browsing Agentscited by 38
  15. 2026Vision-DeepResearch: Incentivizing DeepResearch Capability in Multimodal Large Language Modelscited by 37
  16. 2024INQUIRE: A Natural World Text-to-Image Retrieval Benchmarkcited by 33
  17. 2025Skywork-R1V4: Toward Agentic Multimodal Intelligence through Interleaved Thinking with Images and DeepResearchcited by 27
  18. 2025ParallelSearch: Train your LLMs to Decompose Query and Search Sub-queries in Parallel with Reinforcement Learningcited by 26
  19. 2025Seeking and Updating with Live Visual Knowledgecited by 24
  20. 2025Open Data Synthesis For Deep Researchcited by 16
  21. 2025Same or Not? Enhancing Visual Perception in Vision-Language Modelscited by 5
  22. 2025Hybrid Deep Searcher: Scalable Parallel and Sequential Search Reasoningcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ProMMSearchAgent: A Generalizable Multimodal Search Agent Trained with Process-Oriented Rewards
  2. 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agents
  3. 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Management
  4. 2026VSearcher: Long-Horizon Multimodal Search Agent via Reinforcement Learning
  5. 2026Neos: Learning to Interleave Search and Visual Reasoning
  6. 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation
  7. 2026MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baseline
  8. 2026LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO