mlsanityData to 14 Oct 2026

Bad Seeing or Bad Thinking? Rewarding Perception for Multimodal Reasoning

arXiv 2605.14054 ↗First posted 13 May 2026cs.AI cs.CVcited by 7

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Achieving robust perception-reasoning synergy is a central goal for advanced Vision-Language Models (VLMs). Recent advancements have pursued this goal via architectural designs or agentic workflows. However, these approaches are often limited by static textual reasoning or complicated by the significant compute and engineering burden of external agentic complexity. Worse, this heavy investment does not yield proportional gains, often witnessing a "seesaw effect" on perception and reasoning. This motivates a fundamental rethinking of the true bottleneck. In this paper, we argue that the root cause of this trade-off is an ambiguity in modality credit assignment: when a VLM fails, is it due to flawed perception ("bad seeing") or flawed logic ("bad thinking")? To resolve this, we introduce a reinforcement learning framework that improves perception-reasoning synergy by reliably rewarding the perception fidelity. We explicitly decompose the generation process into interleaved perception and reasoning steps. This decoupling enables targeted supervision on perception. Crucially, we introduce Perception Verification (PV), leveraging a "blindfolded reasoning" proxy to reward perceptual fidelity independently of reasoning outcomes. Furthermore, to scale training across free-form VL tasks, we propose Structured Verbal Verification, which replaces high-variance LLM judging with structured algorithmic execution. These techniques are integrated into a Modality-Aware Credit Assignment (MoCA) mechanism, which routes rewards to the specific source of error -- either bad seeing or bad thinking -- enabling a single VLM to achieve simultaneous performance gains across a wide task spectrum.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 31 of its 46 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

31 of 46 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025MiMo-VL Technical Report4 Jun
  2. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
  3. 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMs21 May
  4. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  5. 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
  6. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  7. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct

Other references · 24

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  6. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  7. 2016Deep Variational Information Bottleneckcited by 930
  8. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
  9. 2021InfographicVQAcited by 437
  10. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
  11. 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
  12. 2024Aligning Modalities in Vision Large Language Models via Preference Fine-tuningcited by 198
12 more
  1. 2024MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizationscited by 183
  2. 2023SlideVQA: A Dataset for Document Visual Question Answering on Multiple Imagescited by 179
  3. 2023Document Understanding Dataset and Evaluation (DUDE)cited by 135
  4. 2025VerlTool: Towards Holistic Agentic Reinforcement Learning with Tool Usecited by 96
  5. 2025Emergent Hierarchical Reasoning in LLMs through Reinforcement Learningcited by 42
  6. 2025VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Searchcited by 35
  7. 2025Reverse-Engineered Reasoning for Open-Ended Generationcited by 32
  8. 2025To Code or not to Code? Adaptive Tool Integration for Math Language Models via Expectation-Maximizationcited by 25
  9. 2026Thinking with Blueprints: Assisting Vision-Language Models in Spatial Reasoning via Structured Object Representationcited by 21
  10. 2026RationalRewards: Reasoning Rewards Scale Visual Generation Both Training and Test Timecited by 14
  11. 2025CogDoc: Towards Unified thinking in Documentscited by 3
  12. 2025Language-Driven Object-Oriented Two-Stage Method for Scene Graph Anticipationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Perceptual-Evidence Anchored Reinforced Learning for Multimodal Reasoning
  2. 2025VTPerception-R1: Enhancing Multimodal Reasoning via Explicit Visual and Textual Perceptual Grounding
  3. 2026PDCR: Perception-Decomposed Confidence Reward for Vision-Language Reasoning
  4. 2026Thinking with Deltas: Incentivizing Reinforcement Learning via Differential Visual Reasoning Policy
  5. 2025Perception-R1: Advancing Multimodal Reasoning Capabilities of MLLMs via Visual Perception Reward
  6. 2026Bridging Perception and Reasoning: Token Reweighting for RLVR in Multimodal LLMs
  7. 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
  8. 2026Disentangling Perception and Reasoning in Multimodal LLMs via Reward Design