mlsanityData to 14 Oct 2026

Deeper Thought, Weaker Aim: Understanding and Mitigating Perceptual Impairment during Reasoning in Multimodal Large Language Models

arXiv 2603.14184 ↗First posted 15 Mar 2026cs.CV cs.AIcited by 5

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Multimodal large language models (MLLMs) often suffer from perceptual impairments under extended reasoning modes, particularly in visual question answering (VQA) tasks. We identify attention dispersion as the underlying cause: during multi-step reasoning, the model's visual attention becomes scattered and drifts away from question-relevant regions, effectively "losing focus" on the visual input. To better understand this phenomenon, we analyze the attention maps of MLLMs and observe that reasoning prompts significantly reduce attention to regions critical for answering the question. We further find a strong correlation between the model's overall attention on image tokens and the spatial dispersiveness of its attention within the image. Leveraging this insight, we propose a training-free Visual Region-Guided Attention (VRGA) framework that selects visual heads based on an entropy-focus criterion and reweights their attention, effectively guiding the model to focus on question-relevant regions during reasoning. Extensive experiments on vision-language benchmarks demonstrate that our method effectively alleviates perceptual degradation, leading to improvements in visual grounding and reasoning accuracy while providing interpretable insights into how MLLMs process visual information.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 14 of its 31 references that are in the map. First posted on arXiv 15 Mar 2026.

Builds on

14 of 31 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025GSM8K-V: Can Vision Language Models Solve Grade School Math Word Problems in Visual Contexts29 Sep
  2. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  3. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
  4. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar

Other references · 10

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  3. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  4. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
  5. 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 650
  6. 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 176
  7. 2025See What You Are Told: Visual Attention Sink in Large Multimodal Modelscited by 132
  8. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 86
  9. 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Trainingcited by 51
  10. 2025SCP-116K: A High-Quality Problem-Solution Dataset and a Generalized Pipeline for Automated Extraction in the Higher Education Science Domaincited by 31

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Revisiting Visual Understanding in Multimodal Reasoning through a Lens of Image Perturbation
  2. 2026Do MLLMs Really See It: Reinforcing Visual Attention in Multimodal LLMs
  3. 2025Focusing by Contrastive Attention: Enhancing VLMs' Visual Reasoning
  4. 2026Mind What Matters for Reasoning: Aligning Cross-Modal Attention via Selective Probability Mass Concentration
  5. 2025Fast or Slow? Integrating Fast Intuition and Deliberate Thinking for Enhancing Visual Question Answering
  6. 2026From Narrow to Panoramic Vision: Attention-Guided Cold-Start Reshapes Multimodal Reasoning
  7. 2022Guiding Visual Question Answering with Attention Priors
  8. 2025Investigating The Functional Roles of Attention Heads in Vision Language Models: Evidence for Reasoning Modules