mlsanityData to 14 Oct 2026

The Perceptual Bandwidth Bottleneck in Vision-Language Models: Active Visual Reasoning via Sequential Experimental Design

arXiv 2605.01345 ↗First posted 2 May 2026cs.CV cs.AI cs.LGcited by 3

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Visual perception in modern Vision-Language Models (VLMs) is constrained by a perceptual bandwidth bottleneck: a broad field of view preserves global context but sacrifices the fine-grained details required for complex reasoning. We argue that high-resolution visual reasoning is therefore not only semantic reasoning but also task-relevant evidence acquisition under limited perceptual bandwidth. Inspired by active vision and information foraging, we formalise this process as sequential Bayesian optimal experimental design (S-BOED), where an agent decides which visual evidence to acquire before answering. Since exact Bayesian inference is intractable in continuous gigapixel spaces, we derive a tractable coverage--resolution objective as a proxy for task-relevant information gain. We instantiate this framework with FOVEA, a training-free procedure that refines VLM crop proposals through evidence-oriented probing. Experiments on high-resolution benchmarks show consistent gains over direct and ReAct-style baselines, with particularly strong improvements in search-dominated remote-sensing settings.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 53 references that are in the map. First posted on arXiv 2 May 2026.

Builds on

24 of 53 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Latent Chain-of-Thought for Visual Reasoning27 Oct
  2. 2025Latent Visual Reasoning29 Sep
  3. 2025Thyme: Think Beyond Images15 Aug
  4. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
  5. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learning13 May

Other references · 19

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  5. 2025Qwen3-VL Technical Reportcited by 2,793
  6. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  7. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  8. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  9. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
  10. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
  11. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 223
  12. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 116
7 more
  1. 2024OpenR: An Open Source Framework for Advanced Reasoning with Large Language Modelscited by 94
  2. 2024Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Modelscited by 39
  3. 2025BED-LLM: Intelligent Information Gathering with LLMs and Bayesian Experimental Designcited by 24
  4. 2025Active Task Disambiguation with LLMscited by 23
  5. 2025Retrieval-Augmented Perception: High-Resolution Image Perception Meets Visual RAGcited by 23
  6. 2025A Principle of Targeted Intervention for Multi-Agent Reinforcement Learningcited by 3
  7. 2024Attaining Human`s Desirable Outcomes in Human-AI Interaction via Structural Causal Gamescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ViThinker: Active Vision-Language Reasoning via Dynamic Perceptual Querying
  2. 2026Position: The Systemic Lack of Agency in Visual Reasoning
  3. 2025VisRes Bench: On Evaluating the Visual Reasoning Capabilities of VLMs
  4. 2026Foveated Reasoning: Stateful, Action-based Visual Focusing for Vision-Language Models
  5. 2026Test-time Scaling over Perception: Resolving the Grounding Paradox in Thinking with Images
  6. 2026MM-OPD: Towards One More Bottleneck Between Perception and Reasoning
  7. 2026PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seeking
  8. 2026Act2See: Emergent Active Visual Perception for Video Reasoning