Thinking Once Is Enough: Intermediate-Layer Evidence Routing for High-Resolution VQA
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
High-resolution visual question answering (HR-VQA) is often treated as a problem of insufficient evidence acquisition, where failing multimodal large language models must inspect images again through cropping, re-encoding, or multi-round search. We show that this view is incomplete: in many cases, fine-grained evidence has already survived visual encoding and become identifiable and influential within an intermediate-layer routing window, but is later diluted before answer generation. We propose Thinking-Once, a training-free, single-visual-pass evidence-routing method that reconstructs question-conditioned attention at this window, preserves core entity tokens and compact background context, and routes this evidence to later layers without extra visual encoding. Across five base models, Thinking-Once consistently improves or matches the corresponding base setting, increasing the average scores on V^*Bench, HRBench-4K, and HRBench-8K by textit+3.1, textit+3.0, and textit+2.7 points while reducing the average peak memory by about 4,GB. On Qwen2.5-VL-7B, it improves the three benchmarks by textit+9.9, textit+4.6, and textit+5.5 points, raising the cross-benchmark mean from 72.5 to 79.1. With the ZwZ-8B base model, Thinking-Once reaches a mean score of 82.7. Against 11 open-source HR-VQA baselines, it obtains the best or tied-best score on all three benchmark averages and the best overall mean; for example, compared with DeepScan, it reduces V^*Bench inference time by 97.2% while improving the cross-benchmark mean from 77.8 to 79.1. These results show that HR-VQA can be improved by routing already encoded evidence rather than repeatedly acquiring new visual inputs. Code is available in the appendix.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 90 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
9 of 90 references.
Closest ancestors · 1
Same direction, newest first
- 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMs21 May
Other references · 8
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 50
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 36
- 2026What Does Vision Tool-Use Reinforcement Learning Really Learn? Disentangling Tool-Induced and Intrinsic Effects for Crop-and-Zoomcited by 9
- 2026TRIO: Token Reduction via Inference-Objective Guidance for Efficient Vision-Language Modelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Pay More Attention To Text In High-Resolution MLLMscited by 0
- 2026Pay More Attention To Text In High-Resolution MLLMs20 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Look Twice: Training-Free Evidence Highlighting for Knowledge-based Visual Question Answering
- 2026Look Where It Counts: A Free, Label-Free Visual Evidence Signal for Fine-Grained Vision-Language Reasoning
- 2025Seeing but Not Believing: Probing the Disconnect Between Visual Attention and Answer Correctness in VLMs
- 2026ConFoThinking: Consolidated Focused Attention Driven Thinking for Visual Question Answering
- 2025CoTBox-TTT: Grounding Medical VQA with Visual Chain-of-Thought Boxes During Test-time Training
- 2022Guiding Visual Question Answering with Attention Priors
- 2026SAFE-G: Structure-aware Faithful Evidence-guided Generation for Knowledge-based Visual Question Answering
- 2026Seeing is not Enough: Vision-Language Models Perceive Evidence but Fail to Act