Addressing Overthinking in Large Vision-Language Models via Gated Perception-Reasoning Optimization
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Large Vision-Language Models (LVLMs) have exhibited strong reasoning capabilities through chain-of-thought mechanisms that generate step-by-step rationales. However, such slow-thinking approaches often lead to overthinking, where models produce excessively verbose responses even for simple queries, resulting in test-time inefficiency and even degraded accuracy. Prior work has attempted to mitigate this issue via adaptive reasoning strategies, but these methods largely overlook a fundamental bottleneck: visual perception failures. We argue that stable reasoning critically depends on low-level visual grounding, and that reasoning errors often originate from imperfect perception rather than insufficient deliberation. To address this limitation, we propose Gated Perception-Reasoning Optimization (GPRO), a meta-reasoning controller that dynamically routes computation among three decision paths at each generation step: a lightweight fast path, a slow perception path for re-examining visual inputs, and a slow reasoning path for internal self-reflection. To learn this distinction, we derive large-scale failure attribution supervision from approximately 790k samples, using teacher models to distinguish perceptual hallucinations from reasoning errors. We then train the controller with multi-objective reinforcement learning to optimize the trade-off between task accuracy and computational cost under uncertainty. Experiments on five benchmarks demonstrate that GPRO substantially improves both accuracy and efficiency, outperforming recent slow-thinking methods while generating significantly shorter responses.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 43 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
36 of 43 references.
Closest ancestors · 14
Same direction, newest first
- 2025CodeV: Code with Images for Faithful Visual Reasoning via Tool-Aware Policy Optimization24 Nov
- 2025MM-R1: Unleashing the Power of Unified Multimodal Large Language Models for Personalized Image Generation15 Aug
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Boosting the Generalization and Reasoning of Vision Language Models with Curriculum Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
- 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
- 2024Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models25 Jun
2 more
Other references · 22
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
10 more
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 171
- 2024Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal Large Language Modelscited by 72
- 2025Fast-Slow Thinking GRPO for Large Vision-Language Model Reasoningcited by 34
- 2025Variation in Verification: Understanding Verification Dynamics in Large Language Modelscited by 18
- 2025Mitigating Forgetting Between Supervised and Reinforcement Learning Yields Stronger Reasonerscited by 14
- 2025What Makes a Good Curriculum? Disentangling the Effects of Data Ordering on LLM Mathematical Reasoningcited by 10
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Behavior Knowledge Merge in Reinforced Agentic Modelscited by 10
- 2026SPARC: Separating Perception And Reasoning Circuits for Test-time Scaling of VLMscited by 6
- 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessmentcited by 1
- 2026MIRROR: Learning from the Other View for Multi-Modal Reasoningcited by 1
- 2026Collapse, Not Complexity: Failure-Conditioned Decomposition Repair for End-to-End Document Parsingcited by 0
- 2026Certified Interface Aliases: Exact Collisions in Vision-Language Preprocessing, and When They Existcited by 0
- 2026Certified Interface Aliases: Exact Collisions in Vision-Language Preprocessing, and When They Exist26 Sep 2026
- 2026Collapse, Not Complexity: Failure-Conditioned Decomposition Repair for End-to-End Document Parsing20 Sep 2026
- 2026MIRROR: Learning from the Other View for Multi-Modal Reasoning23 Jul 2026
- 2026SPARC: Separating Perception And Reasoning Circuits for Test-time Scaling of VLMs6 Feb 2026
- 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment30 Jan 2026
- 2026Behavior Knowledge Merge in Reinforced Agentic Models20 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Qwen Look Again: Guiding Vision-Language Reasoning Models to Re-attention Visual Information
- 2024Reflective Instruction Tuning: Mitigating Hallucinations in Large Vision-Language Models
- 2025More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Models
- 2026Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Models
- 2026From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models
- 2026Dual-Latent Memory Routing for Vision-Language Reasoning
- 2026ViThinker: Active Vision-Language Reasoning via Dynamic Perceptual Querying
- 2025Journey Before Destination: On the importance of Visual Faithfulness in Slow Thinking