mlsanityData to 14 Oct 2026

Thinking Once Is Enough: Intermediate-Layer Evidence Routing for High-Resolution VQA

arXiv 2607.27830 ↗First posted 30 Jul 2026cs.CVcited by 1

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

High-resolution visual question answering (HR-VQA) is often treated as a problem of insufficient evidence acquisition, where failing multimodal large language models must inspect images again through cropping, re-encoding, or multi-round search. We show that this view is incomplete: in many cases, fine-grained evidence has already survived visual encoding and become identifiable and influential within an intermediate-layer routing window, but is later diluted before answer generation. We propose Thinking-Once, a training-free, single-visual-pass evidence-routing method that reconstructs question-conditioned attention at this window, preserves core entity tokens and compact background context, and routes this evidence to later layers without extra visual encoding. Across five base models, Thinking-Once consistently improves or matches the corresponding base setting, increasing the average scores on V^*Bench, HRBench-4K, and HRBench-8K by textit+3.1, textit+3.0, and textit+2.7 points while reducing the average peak memory by about 4,GB. On Qwen2.5-VL-7B, it improves the three benchmarks by textit+9.9, textit+4.6, and textit+5.5 points, raising the cross-benchmark mean from 72.5 to 79.1. With the ZwZ-8B base model, Thinking-Once reaches a mean score of 82.7. Against 11 open-source HR-VQA baselines, it obtains the best or tied-best score on all three benchmark averages and the best overall mean; for example, compared with DeepScan, it reduces V^*Bench inference time by 97.2% while improving the cross-benchmark mean from 77.8 to 79.1. These results show that HR-VQA can be improved by routing already encoded evidence rather than repeatedly acquiring new visual inputs. Code is available in the appendix.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 90 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

9 of 90 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMs21 May

Other references · 8

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  5. 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 50
  6. 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 36
  7. 2026What Does Vision Tool-Use Reinforcement Learning Really Learn? Disentangling Tool-Induced and Intrinsic Effects for Crop-and-Zoomcited by 9
  8. 2026TRIO: Token Reduction via Inference-Objective Guidance for Efficient Vision-Language Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Look Twice: Training-Free Evidence Highlighting for Knowledge-based Visual Question Answering
  2. 2026Look Where It Counts: A Free, Label-Free Visual Evidence Signal for Fine-Grained Vision-Language Reasoning
  3. 2025Seeing but Not Believing: Probing the Disconnect Between Visual Attention and Answer Correctness in VLMs
  4. 2026ConFoThinking: Consolidated Focused Attention Driven Thinking for Visual Question Answering
  5. 2025CoTBox-TTT: Grounding Medical VQA with Visual Chain-of-Thought Boxes During Test-time Training
  6. 2022Guiding Visual Question Answering with Attention Priors
  7. 2026SAFE-G: Structure-aware Faithful Evidence-guided Generation for Knowledge-based Visual Question Answering
  8. 2026Seeing is not Enough: Vision-Language Models Perceive Evidence but Fail to Act