Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Spatial reasoning, which requires ability to perceive and manipulate spatial relationships in the 3D world, is a fundamental aspect of human intelligence, yet remains a persistent challenge for Multimodal large language models (MLLMs). While existing surveys often categorize recent progress based on input modality (e.g., text, image, video, or 3D), we argue that spatial ability is not solely determined by the input format. Instead, our survey introduces a taxonomy that organizes spatial intelligence from cognitive aspect and divides tasks in terms of reasoning complexity, linking them to several cognitive functions. We map existing benchmarks across text only, vision language, and embodied settings onto this taxonomy, and review evaluation metrics and methodologies for assessing spatial reasoning ability. This cognitive perspective enables more principled cross-task comparisons and reveals critical gaps between current model capabilities and human-like reasoning. In addition, we analyze methods for improving spatial ability, spanning both training-based and reasoning-based approaches. This dual perspective analysis clarifies their respective strengths, uncovers complementary mechanisms. By surveying tasks, benchmarks, and recent advances, we aim to provide new researchers with a comprehensive understanding of the field and actionable directions for future research.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 74 of its 140 references that are in the map. First posted on arXiv 14 Nov 2025.
Builds on
74 of 140 references.
Closest ancestors · 22
Same direction, newest first
- 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenes8 Sep
- 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture2 Sep
- 2025Can Large Language Models Integrate Spatial Data? Empirical Insights into Reasoning Strengths and Computational Weaknesses7 Aug
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
- 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
- 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Models22 May
- 2025SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Data29 Apr
- 2025Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learning17 Apr
- 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaverse24 Mar
- 2025Open3D-VQA: A Benchmark for Comprehensive Spatial Reasoning with Multimodal Large Language Model in Open Space14 Mar
- 2025Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas3 Mar
10 more
- 2025SoFar: Language-Grounded Orientation Bridges Spatial Reasoning and Object Manipulation18 Feb
- 2025Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models12 Feb
- 2025Visual Agentic AI for Spatial Reasoning with a Dynamic API10 Feb
- 2025Schema-Guided Scene-Graph Reasoning based on Multi-Agent Large Language Model System5 Feb
- 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning17 Jan
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec
- 2024Dspy-based Neural-Symbolic Pipeline to Enhance Spatial Reasoning in LLMs27 Nov
- 2024Reasoning Paths with Reference Objects Elicit Quantitative Spatial Reasoning in Large Vision-Language Models15 Sep
- 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning18 Mar
Other references · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Visual Instruction Tuningcited by 7,792
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2022A ConvNet for the 2020scited by 3,545
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
38 more
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2015VQA: Visual Question Answeringcited by 2,489
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2023GPTScore: Evaluate as You Desirecited by 357
- 2015Towards AI-Complete Question Answering: A Set of Prerequisite Toy Taskscited by 309
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
- 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 258
- 2024STAR: A Benchmark for Situated Reasoning in Real-World Videoscited by 213
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 204
- 2023Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Followingcited by 192
- 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 178
- 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
- 2023LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmarkcited by 169
- 2021Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completioncited by 111
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
- 2020A Benchmark for Systematic Generalization in Grounded Language Understandingcited by 108
- 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 106
- 2023LLM-Eval: Unified Multi-Dimensional Automatic Evaluation for Open-Domain Conversations with Large Language Modelscited by 100
- 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 91
- 2023Automatic Evaluation of Attribution by Large Language Modelscited by 70
- 2024Strong Model Collapsecited by 62
- 20253D Aware Region Prompted Vision Language Modelcited by 31
- 2024Agent3D-Zero: An Agent for Zero-shot 3D Understandingcited by 29
- 2025Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluationcited by 26
- 2024Uni3D-LLM: Unifying Point Cloud Perception, Generation and Editing with Large Language Modelscited by 24
- 2021Success Weighted by Completion Time: A Dynamics-Aware Evaluation Criteria for Embodied Navigationcited by 21
- 2025Unfolding Spatial Cognition: Evaluating Multimodal Models on Visual Simulationscited by 21
- 2024RevisEval: Improving LLM-as-a-Judge via Response-Adapted Referencescited by 19
- 2023Advances in Embodied Navigation Using Large Language Models: A Surveycited by 14
- 2025Towards Visuospatial Cognition via Hierarchical Fusion of Visual Expertscited by 11
- 2024A Comprehensive Survey on Visual Question Answering Datasets and Algorithmscited by 8
- 2023Improving Vision-and-Language Reasoning via Spatial Relations Modelingcited by 5
- 2021When and Why does a Model Fail? A Human-in-the-loop Error Detection Framework for Sentiment Analysiscited by 4
- 2024Integrating Large Language Models with Multimodal Virtual Reality Interfaces to Support Collaborative Human-Robot Construction Workcited by 2
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 21.
22 papers.
Sort:
By area:
- 2025SpatialTree: How Spatial Abilities Branch Out in MLLMscited by 11
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environmentscited by 6
- 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Taskscited by 6
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama Worldcited by 5
- 2026CRAFT: Grounded Multi-Agent Coordination Under Partial Informationcited by 3
- 2026ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Modelscited by 3
- 2026EAGOR: Embodied Reasoning in Omni-directioncited by 3
- 2026ArchSIBench: Benchmarking the Architectural Spatial Intelligence of Vision-Language Modelscited by 2
- 2026Predicting Camera Pose from Perspective Descriptions for Spatial Reasoningcited by 1
- 2026Uncovering and Shaping the Latent Representation of 3D Scene Topology in Vision-Language Modelscited by 1
- 2026SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenescited by 1
- 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoningcited by 1
10 more
- 2026ViTaB-A: Evaluating Multimodal Large Language Models on Visual Table Attributioncited by 0
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsingcited by 0
- 2026VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesiscited by 0
- 2026SSR3D-LLM: Structured Spatial Reasoning via Latent Steps for Fine-Grained Grounding in Unified 3D-LLMscited by 0
- 2026Spatial Reasoning via Modality Switching Between Language and Symbolic Representationscited by 0
- 2026Evaluation of Multilingual Ability to Use Spatial Deictic Expressions in Vision-Language Modelscited by 0
- 2026Blind-Spots-Bench: Evaluating Blind Spots in Multimodal Modelscited by 0
- 2026A Statistical Audit of Physical AI Benchmark Redundancycited by 0
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoningcited by 0
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Drivingcited by 0
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving7 Oct 2026
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoning28 Sep 2026
- 2026A Statistical Audit of Physical AI Benchmark Redundancy26 Aug 2026
- 2026Blind-Spots-Bench: Evaluating Blind Spots in Multimodal Models9 Jul 2026
- 2026Evaluation of Multilingual Ability to Use Spatial Deictic Expressions in Vision-Language Models8 Jul 2026
- 2026EAGOR: Embodied Reasoning in Omni-direction7 Jul 2026
- 2026Spatial Reasoning via Modality Switching Between Language and Symbolic Representations30 Jun 2026
- 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning10 Jun 2026
- 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Tasks8 Jun 2026
- 2026SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes29 May 2026
- 2026SSR3D-LLM: Structured Spatial Reasoning via Latent Steps for Fine-Grained Grounding in Unified 3D-LLMs27 May 2026
- 2026VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesis21 May 2026
10 more
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing21 May 2026
- 2026ArchSIBench: Benchmarking the Architectural Spatial Intelligence of Vision-Language Models20 May 2026
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama World13 May 2026
- 2026ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models11 May 2026
- 2026Uncovering and Shaping the Latent Representation of 3D Scene Topology in Vision-Language Models8 May 2026
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments24 Apr 2026
- 2026CRAFT: Grounded Multi-Agent Coordination Under Partial Information26 Mar 2026
- 2026ViTaB-A: Evaluating Multimodal Large Language Models on Visual Table Attribution17 Feb 2026
- 2026Predicting Camera Pose from Perspective Descriptions for Spatial Reasoning5 Feb 2026
- 2025SpatialTree: How Spatial Abilities Branch Out in MLLMs23 Dec 2025
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environmentscited by 6
- 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Taskscited by 6
- 2026ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Modelscited by 3
- 2026EAGOR: Embodied Reasoning in Omni-directioncited by 3
- 2026Predicting Camera Pose from Perspective Descriptions for Spatial Reasoningcited by 1
- 2026SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenescited by 1
- 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoningcited by 1
- 2026VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesiscited by 0
- 2026SSR3D-LLM: Structured Spatial Reasoning via Latent Steps for Fine-Grained Grounding in Unified 3D-LLMscited by 0
- 2026Spatial Reasoning via Modality Switching Between Language and Symbolic Representationscited by 0
- 2026Evaluation of Multilingual Ability to Use Spatial Deictic Expressions in Vision-Language Modelscited by 0
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving7 Oct 2026
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoning28 Sep 2026
- 2026Evaluation of Multilingual Ability to Use Spatial Deictic Expressions in Vision-Language Models8 Jul 2026
- 2026EAGOR: Embodied Reasoning in Omni-direction7 Jul 2026
- 2026Spatial Reasoning via Modality Switching Between Language and Symbolic Representations30 Jun 2026
- 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning10 Jun 2026
- 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Tasks8 Jun 2026
- 2026SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes29 May 2026
- 2026SSR3D-LLM: Structured Spatial Reasoning via Latent Steps for Fine-Grained Grounding in Unified 3D-LLMs27 May 2026
- 2026VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesis21 May 2026
- 2026ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models11 May 2026
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments24 Apr 2026
12 newest of 13 All 13 (JSON)
- 2026ArchSIBench: Benchmarking the Architectural Spatial Intelligence of Vision-Language Modelscited by 2
- 2026Uncovering and Shaping the Latent Representation of 3D Scene Topology in Vision-Language Modelscited by 1
- 2026ViTaB-A: Evaluating Multimodal Large Language Models on Visual Table Attributioncited by 0
- 2026ArchSIBench: Benchmarking the Architectural Spatial Intelligence of Vision-Language Models20 May 2026
- 2026Uncovering and Shaping the Latent Representation of 3D Scene Topology in Vision-Language Models8 May 2026
- 2026ViTaB-A: Evaluating Multimodal Large Language Models on Visual Table Attribution17 Feb 2026
- 2025SpatialTree: How Spatial Abilities Branch Out in MLLMscited by 11
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama Worldcited by 5
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsingcited by 0
- 2026Blind-Spots-Bench: Evaluating Blind Spots in Multimodal Modelscited by 0
- 2026A Statistical Audit of Physical AI Benchmark Redundancycited by 0
- 2026A Statistical Audit of Physical AI Benchmark Redundancy26 Aug 2026
- 2026Blind-Spots-Bench: Evaluating Blind Spots in Multimodal Models9 Jul 2026
- 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsing21 May 2026
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama World13 May 2026
- 2025SpatialTree: How Spatial Abilities Branch Out in MLLMs23 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
- 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition
- 202511Plus-Bench: Demystifying Multimodal LLM Spatial Reasoning with Cognitive-Inspired Analysis
- 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
- 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models
- 2026SpatialText: A Pure-Text Cognitive Benchmark for Spatial Understanding in Large Language Models
- 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
- 2026From Where Things Are to What They Are For: Benchmarking Spatial-Functional Intelligence in Multimodal LLMs