Thinking with Visual Abstract: Enhancing Multimodal Reasoning via Visual Abstraction
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Images usually convey richer detail than text, but often include redundant information, which potentially downgrades multimodal reasoning performance. When faced with lengthy or complex messages, humans tend to employ abstract thinking to convert them into simple and concise abstracts. Inspired by this cognitive strategy, we introduce a novel paradigm to elicit the ability to Think with Visual Abstract (VAT), by prompting Multimodal Large Language Models (MLLMs) with visual abstract instead of explicit verbal thoughts or elaborate guidance, permitting a more efficient visual reasoning mechanism via concentrated perception. VAT encourages models to focus on more essential visual elements, concepts and structural features by undermining redundant information compared with explicit thinking methods, such as Chain-of-thought (CoT) and tool-using approaches, that increase the complexity of reasoning process via inserting verbose intermediate steps and external knowledge. Experimental results show that VAT consistently empowers different MLLMs in visual perception and reasoning tasks. VAT achieves an average gain of 2.21% over GPT-5 baseline, surpassing the gain of CoT, demonstrating that VAT better enhances multimodal task performance of MLLMs. Additionally, VAT spends fewer tokens while achieving higher performance. These findings highlight the effectiveness of visual abstract thinking and encourage further exploration of more diverse reasoning paradigms from the perspective of human cognition.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 23 of its 68 references that are in the map. First posted on arXiv 26 May 2025.
Builds on
23 of 68 references.
Closest ancestors · 6
Same direction, newest first
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025KARL: Knowledge-Aware Reasoning and Reinforcement Learning for Knowledge-Intensive Visual Grounding17 Mar
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
- 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models22 May
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action20 Mar
Other references · 17
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
- 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 172
- 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 116
- 2022PromptCap: Prompt-Guided Task-Aware Image Captioningcited by 104
- 2019Photo-Sketching: Inferring Contour Drawings from Imagescited by 67
- 2024Large Language Model Agent in Financial Trading: A Surveycited by 60
- 2024Reducing Tool Hallucination via Reliability Alignmentcited by 37
- 2018SketchyScene: Richly-Annotated Scene Sketchescited by 32
- 2024SketchAgent: Language-Driven Sequential Sketch Generationcited by 30
5 more
- 2022A Sketch Is Worth a Thousand Words: Image Retrieval with Text and Sketchcited by 28
- 2024AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaborationcited by 26
- 2025Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Modelscited by 22
- 2024ActiView: Evaluating Active Perception Ability for Multimodal Large Language Modelscited by 11
- 2025CoSpace: Benchmarking Continuous Space Perception Ability for Vision-Language Modelscited by 1
Built on by
Citing papers per year: 2025: 9; 2026: 6.
15 papers.
Sort:
By area:
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2025Latent Visual Reasoningcited by 99
- 2025PyVision: Agentic Vision with Dynamic Toolingcited by 71
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmarkcited by 41
- 2025Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoningcited by 28
- 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Spacecited by 20
- 2025Faithful-First Reasoning, Planning, and Acting for Multimodal LLMscited by 7
- 2025Thinking with Images via Self-Calling Agentcited by 4
- 2026See Further, Think Deeper: Advancing VLM's Reasoning Ability with Low-level Visual Cues and Reflectioncited by 3
- 2026Generative Visual Chain-of-Thought for Image Editingcited by 2
- 2025ChainV: Atomic Visual Hints Make Multimodal Reasoning Shorter and Bettercited by 1
- 2026GeoMathCode: Understanding Interleaved Math-Code Reasoning for Geometry Problem Solvingcited by 0
- 2026Resolving State-Representation Mismatch: State-Space Visual Reasoning for Open-Loop VLA Planning27 Sep 2026
- 2026IQA-T1: Tool-based Visual Evidence Reasoning for Image Quality Assessment14 Jul 2026
- 2026Segmentation before Answering: Pixel Grounding for MLLM Visual Reasoning7 Jul 2026
- 2026GeoMathCode: Understanding Interleaved Math-Code Reasoning for Geometry Problem Solving25 May 2026
- 2026See Further, Think Deeper: Advancing VLM's Reasoning Ability with Low-level Visual Cues and Reflection27 Apr 2026
- 2026Generative Visual Chain-of-Thought for Image Editing2 Mar 2026
- 2025Thinking with Images via Self-Calling Agent9 Dec 2025
- 2025ChainV: Atomic Visual Hints Make Multimodal Reasoning Shorter and Better21 Nov 2025
- 2025Faithful-First Reasoning, Planning, and Acting for Multimodal LLMs11 Nov 2025
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmark30 Oct 2025
- 2025Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoning14 Oct 2025
- 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space14 Oct 2025
3 more
- 2025Latent Visual Reasoning29 Sep 2025
- 2025PyVision: Agentic Vision with Dynamic Tooling10 Jul 2025
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun 2025
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2025Latent Visual Reasoningcited by 99
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmarkcited by 41
- 2025Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoningcited by 28
- 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Spacecited by 20
- 2025Faithful-First Reasoning, Planning, and Acting for Multimodal LLMscited by 7
- 2025Thinking with Images via Self-Calling Agentcited by 4
- 2026See Further, Think Deeper: Advancing VLM's Reasoning Ability with Low-level Visual Cues and Reflectioncited by 3
- 2026Generative Visual Chain-of-Thought for Image Editingcited by 2
- 2025ChainV: Atomic Visual Hints Make Multimodal Reasoning Shorter and Bettercited by 1
- 2026GeoMathCode: Understanding Interleaved Math-Code Reasoning for Geometry Problem Solvingcited by 0
- 2026Segmentation before Answering: Pixel Grounding for MLLM Visual Reasoningcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Resolving State-Representation Mismatch: State-Space Visual Reasoning for Open-Loop VLA Planning27 Sep 2026
- 2026IQA-T1: Tool-based Visual Evidence Reasoning for Image Quality Assessment14 Jul 2026
- 2026Segmentation before Answering: Pixel Grounding for MLLM Visual Reasoning7 Jul 2026
- 2026GeoMathCode: Understanding Interleaved Math-Code Reasoning for Geometry Problem Solving25 May 2026
- 2026See Further, Think Deeper: Advancing VLM's Reasoning Ability with Low-level Visual Cues and Reflection27 Apr 2026
- 2026Generative Visual Chain-of-Thought for Image Editing2 Mar 2026
- 2025Thinking with Images via Self-Calling Agent9 Dec 2025
- 2025ChainV: Atomic Visual Hints Make Multimodal Reasoning Shorter and Better21 Nov 2025
- 2025Faithful-First Reasoning, Planning, and Acting for Multimodal LLMs11 Nov 2025
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmark30 Oct 2025
- 2025Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoning14 Oct 2025
- 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space14 Oct 2025
12 newest of 14 All 14 (JSON)
- 2025PyVision: Agentic Vision with Dynamic Toolingcited by 71
- 2025PyVision: Agentic Vision with Dynamic Tooling10 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thought
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning
- 2026Look on Demand: A Cognitive Scheduling Framework for Visual Evidence Acquisition in Multimodal Reasoning
- 2025Thinking with Generated Images
- 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
- 2025Learning When to Look: A Disentangled Curriculum for Strategic Perception in Multimodal Reasoning
- 2026See2Think: Do Multimodal Models Really Use Intermediate Visual States?
- 2026Distilling Visual Reasoning into Text Space