SpatialASM: Internalizing Active Mentalization for Spatial Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
When solving complex spatial reasoning tasks, ordinary humans naturally revisit the scenes from task-relevant viewpoints and mentally reconstruct the spatial layouts from those viewpoints. But can Large Vision-Language Models (LVLMs) proactively think in the same way? We term this ability Active Spatial Mentalization (ASM), an intrinsic component of visual intelligence that remains substantially underdeveloped in current LVLMs. To bridge this gap, we introduce SpatialASM, a scalable framework to internalize ASM into LVLMs through training-time spatial simulation. SpatialASM employs an allocentric novel-view generator to ground hypothetical viewpoints in visual evidence and produces two complementary forms of supervision: i) explicit ASM trajectories that teach LVLMs when and how to adaptively invoke view planning and imagination during spatial reasoning, and ii) automatically-constructed perspective-taking tasks that further strengthens viewpoint-conditioned scene imagination. On seven benchmarks spanning relatively perception-oriented spatial understanding to more challenging tasks requiring multi-image, cross-view and viewpoint-transformation reasoning, SpatialASM yields performance gain on LVLMs of four LVLM backbones in spatial reasoning while retaining their original general vision capabilities. The experimental results demonstrate that our approach improves average accuracy across the seven spatial benchmarks. And the synthesis of ASM trajectories provides a scalable pathway to alleviate the scarcity of spatial Chain-of-Thought (CoT) supervision for eliciting active viewpoint exploration and mental scene simulation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 73 of its 81 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
73 of 81 references.
Closest ancestors · 25
Same direction, newest first
- 2026SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them30 Jul
- 2026OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mapping1 Jul
- 2026SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning11 Jun
- 2026Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulators4 Jun
- 2026Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models2 Jun
- 2026World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning29 Apr
- 2026When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoning9 Feb
- 2026Thinking with Geometry: Active Geometry Integration for Spatial Reasoning5 Feb
- 2026CityCube: Benchmarking Cross-view Spatial Reasoning on Vision-Language Models in Urban Environments20 Jan
- 2026Think3D: Thinking with Space for Spatial Reasoning19 Jan
- 2025SpatialDreamer: Incentivizing Spatial Reasoning via Active Mental Imagery8 Dec
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
13 more
- 2025How Well Do Vision--Language Models Understand Cities? A Comparative Study on Spatial Reasoning from Street-View Images29 Aug
- 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoning16 Jul
- 2025InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models23 Jun
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
- 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
- 2025Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery Simulation24 Apr
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2025Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models12 Feb
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
- 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoning30 Oct
Other references · 48
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2024Genie: Generative Interactive Environmentscited by 747
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
36 more
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2023Recognize Anything: A Strong Image Tagging Modelcited by 309
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 138
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 114
- 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 107
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 94
- 2025Visual Spatial Tuningcited by 89
- 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 82
- 2025Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learningcited by 41
- 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 38
- 2026WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluationcited by 37
- 2025ATLaS: Agent Tuning via Learning Critical Stepscited by 31
- 2025SITE: towards Spatial Intelligence Thorough Evaluationcited by 29
- 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loopcited by 26
- 2025BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoningcited by 21
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Modelscited by 19
- 2026S-Agent: Spatial Tool-Use Elicits Reasoning for Spatial Intelligencecited by 11
- 2026SpatialEdit: Benchmarking Fine-Grained Image Spatial Editingcited by 10
- 2026CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioningcited by 8
- 2025Toward Ambulatory Vision: Learning Visually-Grounded Active View Selectioncited by 6
- 2026Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligencecited by 6
- 2026OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligencecited by 6
- 2026A Definition and Roadmap for World Modelscited by 5
- 2026Intern-S2-Preview: Scientific Agentic Foundation Modelcited by 4
- 2026DocScope: Benchmarking Verifiable Reasoning for Trustworthy Long-Document Understandingcited by 3
- 2026Planning with the Viewscited by 3
- 2026GeoWorld-VLM: Geometry from World Models for Vision-Language Modelscited by 1
- 2026VAMPS: Visual-Assisted Mathematical Problem Solving Benchmarkcited by 1
- 2026SciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understandingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
- 2026Thinking with Novel Views: A Systematic Analysis of Generative-Augmented Spatial Intelligence
- 2026WM-VLM: Probing Internal World Models for Interleaved Visual-Textual Reasoning
- 2025Reasoning Path and Latent State Analysis for Multi-view Visual Spatial Reasoning: A Cognitive Science Perspective
- 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models
- 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
- 2026When More Is Less: A Systematic Analysis of Spatial and Commonsense Information for Visual Spatial Reasoning
- 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods