mlsanityData to 7 Oct 2026

From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models

arXiv 2605.20177 ↗First posted 19 May 2026cs.CL cs.CVcited by 5

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Recent advances in vision-language models (VLMs) emphasize long chain-of-thought reasoning; yet, we find that their performance on visual tasks is primarily limited by a lack of visual perception as opposed to reasoning itself. In this work, we systematically study the interplay between perception and reasoning in VLM post-training by decomposing their capabilities into three separate training stages: visual perception, visual reasoning, and textual reasoning, incorporating specialized training data. We demonstrate that visual perception (a) requires targeted optimization with specialized data; (b) serves as a fundamental scaffold that should be solidified through staged training before refining visual reasoning; and (c) is more effectively learned via RL than caption-based SFT. Our experiments across multiple VLMs demonstrate that staged training consistently improves both visual perception and reasoning performance over merged training. Notably, models trained with our approach achieve 1.5% higher reasoning accuracy with 20.8% shorter reasoning traces, suggesting that superior perception reduces the need for excessive reasoning. Furthermore, we show that this capability-based staging represents a new curriculum dimension orthogonal to traditional difficulty-based curricula, and combining both yields further additive gains. Our staged-training models achieve superior performance among open-weight VLMs, establishing advanced results on several visual math and perception (e.g., +5.2% on WeMath and +3.7% on RealWorldQA) tasks compared with the base counterpart.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 72 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

46 of 72 references.

Closest ancestors · 21

Same direction, newest first

  1. 2026Can Textual Reasoning Improve the Performance of MLLMs on Fine-grained Visual Classification?11 Jan
  2. 2025PuzzleCraft: Exploration-Aware Curriculum Learning for Puzzle-Based RLVR in VLMs16 Dec
  3. 2025OneThinker: All-in-one Reasoning Model for Image and Video2 Dec
  4. 2025VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning21 Nov
  5. 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources25 Sep
  6. 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning9 Jun
  7. 2025GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking1 Jun
  8. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  9. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  10. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  11. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
  12. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
9 more
  1. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
  2. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
  3. 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov
  4. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  5. 2024Improve Vision Language Model Chain-of-thought Reasoning21 Oct
  6. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
  7. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  8. 2022CLEVR-Math: A Dataset for Compositional Language, Visual and Mathematical Reasoning10 Aug
  9. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar

Other references · 25

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  4. 2025Qwen3-VL Technical Reportcited by 2,534
  5. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  6. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
  7. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
  8. 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 702
  9. 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 450
  10. 2021InfographicVQAcited by 430
  11. 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 214
  12. 2023G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Modelcited by 208
13 more
  1. 2024ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Modelscited by 204
  2. 2024Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Modelscited by 138
  3. 2025MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphscited by 105
  4. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 84
  5. 2019GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question Answeringcited by 77
  6. 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learningcited by 68
  7. 2024Let's Learn Step by Step: Enhancing In-Context Learning Ability with Curriculum Learningcited by 47
  8. 2024VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception of Geometric Informationcited by 39
  9. 2024Do Vision-Language Models Really Understand Visual Language?cited by 29
  10. 2025MedVLThinker: Simple Baselines for Multimodal Medical Reasoningcited by 26
  11. 2025SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Datacited by 19
  12. 2024Enhancing Descriptive Captions with Visual Attributes for Multimodal Perceptioncited by 9
  13. 2026NoReGeo: Non-Reasoning Geometry Benchmarkcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Perception Before Reasoning: Two-Stage Reinforcement Learning for Visual Reasoning in Vision-Language Models
  2. 2025Learning to See Before Seeing: Demystifying LLM Visual Priors from Language Pre-training
  3. 2025See, Think, Learn: A Self-Taught Multimodal Reasoner
  4. 2025Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging
  5. 2025A Cognitive Paradigm Approach to Probe the Perception-Reasoning Interface in VLMs
  6. 2026Reasoning Dynamics and the Limits of Monitoring Modality Reliance in Vision-Language Models
  7. 2026Improving Reasoning in Vision-Language Models via Perception Verified Self-Training
  8. 2026See Further, Think Deeper: Advancing VLM's Reasoning Ability with Low-level Visual Cues and Reflection