mlsanityData to 14 Oct 2026

MentalThink: Shaping Thoughts in Mental SVG World

arXiv 2607.03530 ↗First posted 3 Jul 2026cs.AIcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

We introduce MentalThink, a visual-symbolic reasoning paradigm that equips Multimodal LLMs (MLLMs) with an executable mechanism for "mental" visualization. The core of MentalThink is a think-with-SVG pipeline, where the model learns to generate, render, and interpret scalable vector graphics (SVG) code as an intermediate visual representation for multi-turn reasoning. By creating structured vector sketches, the model can externalize spatial hypotheses, inspect them through deterministic rendering, and reason within a constrained geometric space, effectively mimicking the human process of mental imagery. We instantiate this paradigm through a two-stage training framework, combining Supervised Fine-Tuning (SFT) for SVG syntactic alignment with multi-turn Reinforcement Learning (RL) to encourage iterative inspection, revision, and refinement of intermediate visual hypotheses. Extensive evaluations demonstrate that MentalThink achieves superior performance on spatial understanding and reasoning benchmarks (e.g., 55.1% on VSIBench, 76.0% on MindCube), showing that executable vector graphics provide a verifiable visual workspace for dynamic perspective taking, visual reflection, and compositional scene construction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 51 of its 65 references that are in the map. First posted on arXiv 3 Jul 2026.

Builds on

51 of 65 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025Thyme: Think Beyond Images15 Aug
  2. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision7 Aug
  3. 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
  4. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning1 Jul
  5. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
  6. 2025MiMo-VL Technical Report4 Jun
  7. 2025Grounded Reinforcement Learning for Visual Reasoning29 May
  8. 2025Thinking with Generated Images28 May
  9. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  10. 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
  11. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  12. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
2 more
  1. 2025Retrieval-Based Interleaved Visual Chain-of-Thought in Real-World Driving Scenarios8 Jan
  2. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb

Other references · 37

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  5. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  6. 2025OpenAI GPT-5 System Cardcited by 989
  7. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  8. 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
  9. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  10. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
  11. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  12. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
25 more
  1. 2025Seed1.5-VL Technical Reportcited by 373
  2. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
  3. 2025ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Modelscited by 194
  4. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 183
  5. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
  6. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 159
  7. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 136
  8. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Modelscited by 118
  9. 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 114
  10. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 114
  11. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
  12. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Modelscited by 90
  13. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 86
  14. 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 74
  15. 2025Kwai Keye-VL 1.5 Technical Reportcited by 73
  16. 2023ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuningcited by 65
  17. 2023Merlin:Empowering Multimodal LLMs with Foresight Mindscited by 46
  18. 2025Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learningcited by 41
  19. 2026STEP3-VL-10B Technical Reportcited by 32
  20. 2025Learning to See Before Seeing: Demystifying LLM Visual Priors from Language Pre-trainingcited by 23
  21. 2025SpaceVista: All-Scale Visual Spatial Reasoning from mm to kmcited by 19
  22. 2025Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Taskscited by 13
  23. 2025SpatialViz-Bench: A Cognitively-Grounded Benchmark for Diagnosing Spatial Visualization in MLLMscited by 12
  24. 2026SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environmentscited by 5
  25. 2025Why Does Reasoning Length Converge? Unveiling the Underfitting-Overfitting Trade-off in Chain-of-Thoughtcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Multimodal Thinking with Renderable Programs
  2. 2025VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Search
  3. 2025VCode: a Multimodal Coding Benchmark with SVG as Symbolic Visual Representation
  4. 2025Reason-SVG: Enhancing Structured Reasoning for Vector Graphics Generation with Reinforcement Learning
  5. 2026Do multimodal models imagine electric sheep?
  6. 2026MentisOculi: Revealing the Limits of Reasoning with Mental Imagery
  7. 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
  8. 2025Monet: Reasoning in Latent Visual Space Beyond Images and Language