mlsanityData to 7 Oct 2026

Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods

arXiv 2511.15722 ↗First posted 14 Nov 2025cs.AIcited by 22

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Spatial reasoning, which requires ability to perceive and manipulate spatial relationships in the 3D world, is a fundamental aspect of human intelligence, yet remains a persistent challenge for Multimodal large language models (MLLMs). While existing surveys often categorize recent progress based on input modality (e.g., text, image, video, or 3D), we argue that spatial ability is not solely determined by the input format. Instead, our survey introduces a taxonomy that organizes spatial intelligence from cognitive aspect and divides tasks in terms of reasoning complexity, linking them to several cognitive functions. We map existing benchmarks across text only, vision language, and embodied settings onto this taxonomy, and review evaluation metrics and methodologies for assessing spatial reasoning ability. This cognitive perspective enables more principled cross-task comparisons and reveals critical gaps between current model capabilities and human-like reasoning. In addition, we analyze methods for improving spatial ability, spanning both training-based and reasoning-based approaches. This dual perspective analysis clarifies their respective strengths, uncovers complementary mechanisms. By surveying tasks, benchmarks, and recent advances, we aim to provide new researchers with a comprehensive understanding of the field and actionable directions for future research.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 74 of its 140 references that are in the map. First posted on arXiv 14 Nov 2025.

Builds on

74 of 140 references.

Closest ancestors · 22

Same direction, newest first

  1. 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenes8 Sep
  2. 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture2 Sep
  3. 2025Can Large Language Models Integrate Spatial Data? Empirical Insights into Reasoning Strengths and Computational Weaknesses7 Aug
  4. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
  5. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
  6. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  7. 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Models22 May
  8. 2025SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Data29 Apr
  9. 2025Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learning17 Apr
  10. 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaverse24 Mar
  11. 2025Open3D-VQA: A Benchmark for Comprehensive Spatial Reasoning with Multimodal Large Language Model in Open Space14 Mar
  12. 2025Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas3 Mar
10 more
  1. 2025SoFar: Language-Grounded Orientation Bridges Spatial Reasoning and Object Manipulation18 Feb
  2. 2025Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models12 Feb
  3. 2025Visual Agentic AI for Spatial Reasoning with a Dynamic API10 Feb
  4. 2025Schema-Guided Scene-Graph Reasoning based on Multi-Agent Large Language Model System5 Feb
  5. 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning17 Jan
  6. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  7. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec
  8. 2024Dspy-based Neural-Symbolic Pipeline to Enhance Spatial Reasoning in LLMs27 Nov
  9. 2024Reasoning Paths with Reference Objects Elicit Quantitative Spatial Reasoning in Large Vision-Language Models15 Sep
  10. 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning18 Mar

Other references · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  10. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  11. 2022A ConvNet for the 2020scited by 3,545
  12. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
38 more
  1. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  2. 2015VQA: Visual Question Answeringcited by 2,489
  3. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  4. 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
  5. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
  6. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  7. 2023GPTScore: Evaluate as You Desirecited by 357
  8. 2015Towards AI-Complete Question Answering: A Set of Prerequisite Toy Taskscited by 309
  9. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
  10. 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 258
  11. 2024STAR: A Benchmark for Situated Reasoning in Real-World Videoscited by 213
  12. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  13. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 204
  14. 2023Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Followingcited by 192
  15. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 178
  16. 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
  17. 2023LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmarkcited by 169
  18. 2021Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completioncited by 111
  19. 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
  20. 2020A Benchmark for Systematic Generalization in Grounded Language Understandingcited by 108
  21. 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 106
  22. 2023LLM-Eval: Unified Multi-Dimensional Automatic Evaluation for Open-Domain Conversations with Large Language Modelscited by 100
  23. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 91
  24. 2023Automatic Evaluation of Attribution by Large Language Modelscited by 70
  25. 2024Strong Model Collapsecited by 62
  26. 20253D Aware Region Prompted Vision Language Modelcited by 31
  27. 2024Agent3D-Zero: An Agent for Zero-shot 3D Understandingcited by 29
  28. 2025Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluationcited by 26
  29. 2024Uni3D-LLM: Unifying Point Cloud Perception, Generation and Editing with Large Language Modelscited by 24
  30. 2021Success Weighted by Completion Time: A Dynamics-Aware Evaluation Criteria for Embodied Navigationcited by 21
  31. 2025Unfolding Spatial Cognition: Evaluating Multimodal Models on Visual Simulationscited by 21
  32. 2024RevisEval: Improving LLM-as-a-Judge via Response-Adapted Referencescited by 19
  33. 2023Advances in Embodied Navigation Using Large Language Models: A Surveycited by 14
  34. 2025Towards Visuospatial Cognition via Hierarchical Fusion of Visual Expertscited by 11
  35. 2024A Comprehensive Survey on Visual Question Answering Datasets and Algorithmscited by 8
  36. 2023Improving Vision-and-Language Reasoning via Spatial Relations Modelingcited by 5
  37. 2021When and Why does a Model Fail? A Human-in-the-loop Error Detection Framework for Sentiment Analysiscited by 4
  38. 2024Integrating Large Language Models with Multimodal Virtual Reality Interfaces to Support Collaborative Human-Robot Construction Workcited by 2

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 21.

22 papers.

Sort:

By area:

  1. 2025SpatialTree: How Spatial Abilities Branch Out in MLLMscited by 11
  2. 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environmentscited by 6
  3. 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Taskscited by 6
  4. 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama Worldcited by 5
  5. 2026CRAFT: Grounded Multi-Agent Coordination Under Partial Informationcited by 3
  6. 2026ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Modelscited by 3
  7. 2026EAGOR: Embodied Reasoning in Omni-directioncited by 3
  8. 2026ArchSIBench: Benchmarking the Architectural Spatial Intelligence of Vision-Language Modelscited by 2
  9. 2026Predicting Camera Pose from Perspective Descriptions for Spatial Reasoningcited by 1
  10. 2026Uncovering and Shaping the Latent Representation of 3D Scene Topology in Vision-Language Modelscited by 1
  11. 2026SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenescited by 1
  12. 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoningcited by 1
10 more
  1. 2026ViTaB-A: Evaluating Multimodal Large Language Models on Visual Table Attributioncited by 0
  2. 2026MPDocBench-Parse: Benchmarking Practical Multi-page Document Parsingcited by 0
  3. 2026VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesiscited by 0
  4. 2026SSR3D-LLM: Structured Spatial Reasoning via Latent Steps for Fine-Grained Grounding in Unified 3D-LLMscited by 0
  5. 2026Spatial Reasoning via Modality Switching Between Language and Symbolic Representationscited by 0
  6. 2026Evaluation of Multilingual Ability to Use Spatial Deictic Expressions in Vision-Language Modelscited by 0
  7. 2026Blind-Spots-Bench: Evaluating Blind Spots in Multimodal Modelscited by 0
  8. 2026A Statistical Audit of Physical AI Benchmark Redundancycited by 0
  9. 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoningcited by 0
  10. 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Drivingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
  2. 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition
  3. 202511Plus-Bench: Demystifying Multimodal LLM Spatial Reasoning with Cognitive-Inspired Analysis
  4. 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
  5. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models
  6. 2026SpatialText: A Pure-Text Cognitive Benchmark for Spatial Understanding in Large Language Models
  7. 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
  8. 2026From Where Things Are to What They Are For: Benchmarking Spatial-Functional Intelligence in Multimodal LLMs