mlsanityData to 14 Oct 2026

Position: Reasoning After Perception Means Reasoning Without Vision

arXiv 2507.16863 ↗First posted 21 Jul 2025cs.CV cs.AI cs.CLcited by 8

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

A common belief in multimodal research is that the perceptual weaknesses of vision--language models can be compensated by stronger language reasoning (e.g., chain-of-thought, in-context learning, or external tools). We challenge this assumption. We argue that for a broad class of visual tasks hard to specify in language, failures stem from a structural fatality where the temporal decision of textitwhen to reason strictly dictates the spatial constraint of textitwhere reasoning takes place. When visual reasoning is deferred to language generation, current architectures do not merely delay computation; they displace it from the continuous visual representation to a discrete textual space. Consequently, the sequential ``Perception-then-Reasoning'' paradigm degenerates perception into a passive, one-off feature encoding process, rendering it functionally equivalent to ``Reasoning-in-Text-Space'', where task-critical spatial signals are collapsed before reasoning begins. We substantiate this claim with the Turing Eye Test (TET): tasks that must be resolved in visual space and are hard to verbalize; results show text-only reasoning cannot remedy these perceptual failures. Our findings suggest rethinking the architectural divide: shifting from reasoning textitabout perception to reasoning textitwithin perception. This facilitates actively reasoning-driven perception that operates directly on pixel-level visual representations, rather than within a collapsed textual space.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 53 of its 92 references that are in the map. First posted on arXiv 21 Jul 2025.

Builds on

53 of 92 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Use25 May
  2. 2025Caption This, Reason That: VLMs Caught in the Middle24 May
  3. 2025v1: Learning to Point Visual Tokens for Multimodal Grounded Reasoning24 May
  4. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  5. 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systems17 May
  6. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learning13 May
  7. 2025Kimi-VL Technical Report10 Apr
  8. 2025VIPER: Visual Perception and Explainable Reasoning for Sequential Decision-Making19 Mar
  9. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  10. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  11. 2025Forgotten Polygons: Multimodal Large Language Models are Shape-Blind21 Feb
  12. 2025Mitigating Visual Knowledge Forgetting in MLLM Instruction-tuning via Modality-decoupled Gradient Descent17 Feb
5 more
  1. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
  2. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
  3. 2024From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning Tasks4 Jun
  4. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  5. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb

Other references · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  7. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  8. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  9. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  10. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  11. 2024OpenAI o1 System Cardcited by 1,244
  12. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
24 more
  1. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  3. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  4. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  5. 2025Qwen2.5-Omni Technical Reportcited by 736
  6. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  7. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
  8. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  9. 2025Seed1.5-VL Technical Reportcited by 373
  10. 2021Attention Bottlenecks for Multimodal Fusioncited by 361
  11. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  12. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
  13. 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 176
  14. 2023Investigating the Catastrophic Forgetting in Multimodal Large Language Modelscited by 119
  15. 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 86
  16. 2024MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learningcited by 69
  17. 2025Analyzing and Boosting the Power of Fine-Grained Visual Recognition for Multi-modal Large Language Modelscited by 31
  18. 2025GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoningcited by 25
  19. 2024SMoLoRA: Exploring and Defying Dual Catastrophic Forgetting in Continual Visual Instruction Tuningcited by 19
  20. 2024EAGLE: Elevating Geometric Reasoning through LLM-empowered Visual Instruction Tuningcited by 16
  21. 2025Human Cognitive Benchmarks Reveal Foundational Visual Gaps in MLLMscited by 13
  22. 2025Hidden in plain sight: VLMs overlook their visual representationscited by 12
  23. 2025Hallucination at a Glance: Controlled Visual Edits and Fine-Grained Multimodal Learningcited by 11
  24. 2025Efficient Vocabulary-Free Fine-Grained Visual Recognition in the Age of Multimodal LLMscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 5.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Models
  2. 2026Reasoning Dynamics and the Limits of Monitoring Modality Reliance in Vision-Language Models
  3. 2025Learning When to Look: A Disentangled Curriculum for Strategic Perception in Multimodal Reasoning
  4. 2026MM-OPD: Towards One More Bottleneck Between Perception and Reasoning
  5. 2026The Last Visible Pixel: Probing Fine-Scale Perception in Vision-Language Models
  6. 2026From Perception to Integration: Revisiting the Internal Dynamics of Reasoning in Vision-Language Models
  7. 2026Look on Demand: A Cognitive Scheduling Framework for Visual Evidence Acquisition in Multimodal Reasoning
  8. 2025Mind with Eyes: from Language Reasoning to Multimodal Reasoning