MentalThink: Shaping Thoughts in Mental SVG World
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
We introduce MentalThink, a visual-symbolic reasoning paradigm that equips Multimodal LLMs (MLLMs) with an executable mechanism for "mental" visualization. The core of MentalThink is a think-with-SVG pipeline, where the model learns to generate, render, and interpret scalable vector graphics (SVG) code as an intermediate visual representation for multi-turn reasoning. By creating structured vector sketches, the model can externalize spatial hypotheses, inspect them through deterministic rendering, and reason within a constrained geometric space, effectively mimicking the human process of mental imagery. We instantiate this paradigm through a two-stage training framework, combining Supervised Fine-Tuning (SFT) for SVG syntactic alignment with multi-turn Reinforcement Learning (RL) to encourage iterative inspection, revision, and refinement of intermediate visual hypotheses. Extensive evaluations demonstrate that MentalThink achieves superior performance on spatial understanding and reasoning benchmarks (e.g., 55.1% on VSIBench, 76.0% on MindCube), showing that executable vector graphics provide a verifiable visual workspace for dynamic perspective taking, visual reflection, and compositional scene construction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 51 of its 65 references that are in the map. First posted on arXiv 3 Jul 2026.
Builds on
51 of 65 references.
Closest ancestors · 14
Same direction, newest first
- 2025Thyme: Think Beyond Images15 Aug
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision7 Aug
- 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning1 Jul
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
- 2025MiMo-VL Technical Report4 Jun
- 2025Grounded Reinforcement Learning for Visual Reasoning29 May
- 2025Thinking with Generated Images28 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
2 more
Other references · 37
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025OpenAI GPT-5 System Cardcited by 989
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
25 more
- 2025Seed1.5-VL Technical Reportcited by 373
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
- 2025ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Modelscited by 194
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 183
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 159
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 136
- 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Modelscited by 118
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 114
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 114
- 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Modelscited by 90
- 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 86
- 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 74
- 2025Kwai Keye-VL 1.5 Technical Reportcited by 73
- 2023ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuningcited by 65
- 2023Merlin:Empowering Multimodal LLMs with Foresight Mindscited by 46
- 2025Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learningcited by 41
- 2026STEP3-VL-10B Technical Reportcited by 32
- 2025Learning to See Before Seeing: Demystifying LLM Visual Priors from Language Pre-trainingcited by 23
- 2025SpaceVista: All-Scale Visual Spatial Reasoning from mm to kmcited by 19
- 2025Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Taskscited by 13
- 2025SpatialViz-Bench: A Cognitively-Grounded Benchmark for Diagnosing Spatial Visualization in MLLMscited by 12
- 2026SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environmentscited by 5
- 2025Why Does Reasoning Length Converge? Unveiling the Underfitting-Overfitting Trade-off in Chain-of-Thoughtcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Multimodal Thinking with Renderable Programs
- 2025VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Search
- 2025VCode: a Multimodal Coding Benchmark with SVG as Symbolic Visual Representation
- 2025Reason-SVG: Enhancing Structured Reasoning for Vector Graphics Generation with Reinforcement Learning
- 2026Do multimodal models imagine electric sheep?
- 2026MentisOculi: Revealing the Limits of Reasoning with Mental Imagery
- 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
- 2025Monet: Reasoning in Latent Visual Space Beyond Images and Language