mlsanityData to 13 Oct 2026

Visual Parallel Search: Learning to Search High-Resolution Images with Parallel Tile Inspection and Adaptive Zoom

arXiv 2609.37002 ↗First posted 29 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

High-resolution visual question answering often fails because a multimodal model does not acquire the small, spatially localized evidence needed to answer a question. Sequential zooming can recover detail, but it asks the main model to choose a region before obtaining a reliable overview. We introduce VPS, a visual parallel-search framework in which a main agent first invokes grid_search to inspect image tiles in parallel with question-conditioned sub-agents, and then adaptively invokes zoom_in on a precise or merged region. The same interface supports both training-free inference and post-training of the main and sub-agents. Across five benchmark splits and three model sizes, VPS improves mean accuracy over dedicated zoom-only search in 14 of 15 same-model comparisons, with gains up to 8.0 points and especially strong improvements for smaller main models. ZoomBench retains an approximately 3.2-point gain at every tested size. We further develop a supervision pipeline with hint-free verification and a paired role-specific GRPO surrogate for learning the controller and tile-reader roles. SFT improves observed accuracy on all five benchmark splits, including a 4.17-point gain on HR-Bench 4K. Role-specific RL further reshapes search behavior: main-only RL reduces mean tool use from 2.65 to 2.11 with similar pass@1 in an internal four-response evaluation, while external accuracy changes are mixed. Joint training reveals an asymmetry between local evidence reading and global search control. Together, these results support VPS as an effective inference-time scaffold and a trainable decomposition for visual evidence acquisition.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 18 of its 25 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

18 of 25 references.

References · 18

  1. 2017Proximal Policy Optimization Algorithmscited by 14,592
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,231
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,180
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
  5. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,118
  6. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 470
  7. 2024AFlow: Automating Agentic Workflow Generationcited by 413
  8. 2024Automated Design of Agentic Systemscited by 380
  9. 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 153
  10. 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 116
  11. 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Explorationcited by 101
  12. 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 101
6 more
  1. 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 48
  2. 2025TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoningcited by 34
  3. 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestrationcited by 32
  4. 2026MAS-Orchestra: Understanding and Improving Multi-Agent Reasoning Through Holistic Orchestration and Controlled Benchmarkscited by 28
  5. 2026Thinking With Tools, Not With Pixels: Tool Calls as Text Scaffolds for Visual Reasoningcited by 3
  6. 2026Small Model as Master Orchestrator: Learning Unified Agent-Tool Orchestration with Parallel Subtask Decompositioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ProMSA:Progressive Multimodal Search Agents for Knowledge-Based Visual Question Answering
  2. 2025Progressive Multimodal Search and Reasoning for Knowledge-Intensive Visual Question Answering
  3. 2026ReVA: A Region-Aware Visual Assistant for Visually Grounded Question Answering
  4. 2026Look Twice: Training-Free Evidence Highlighting for Knowledge-based Visual Question Answering
  5. 2024Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark
  6. 2025UR-Bench: A Benchmark for Multi-Hop Reasoning over Ultra-High-Resolution Images
  7. 2025FOCUS: Internal MLLM Representations for Efficient Fine-Grained Visual Question Answering
  8. 2026Head-Aware Visual Cropping: Enhancing Fine-Grained VQA with Attention-Guided Subimage