SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligence
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Existing evaluations of multimodal large language models (MLLMs) on spatial intelligence are typically fragmented and limited in scope. In this work, we aim to conduct a holistic assessment of the spatial understanding capabilities of modern MLLMs and propose complementary data-driven and agent-based solutions. Specifically, we make the following contributions: (i) we introduce SpatialScore, to our knowledge, the most comprehensive and diverse benchmark for multimodal spatial intelligence to date. It covers multiple visual data types, input modalities, and question-answering formats, and contains approximately 5K manually verified samples spanning 30 distinct tasks; (ii) using SpatialScore, we extensively evaluate 49 representative MLLMs, revealing persistent challenges and a substantial gap between current models and human-level spatial intelligence; (iii) to advance model capabilities, we construct SpatialCorpus, a large-scale training resource with 331K multimodal QA samples that supports fine-tuning on spatial reasoning tasks and significantly improves the performance of existing models (e.g., Qwen3-VL); (iv) to complement this data-driven route with a training-free paradigm, we develop SpatialAgent, a multi-agent system equipped with 12 specialized spatial perception tools that supports both Plan-Execute and ReAct reasoning, enabling substantial gains in spatial reasoning without additional model training. Extensive experiments and in-depth analyses demonstrate the effectiveness of our benchmark, corpus, and agent framework. We expect these resources to serve as a solid foundation for advancing MLLMs toward human-level spatial intelligence. All data, code, and models will be released to the research community.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 72 of its 112 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
72 of 112 references.
Closest ancestors · 16
Same direction, newest first
- 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Models1 May
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?31 Mar
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3D29 Mar
- 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMs17 Mar
- 2025Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models12 Feb
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding27 Jan
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics25 Nov
- 2024SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language Models11 Oct
- 2024Reasoning Paths with Reference Objects Elicit Quantitative Spatial Reasoning in Large Vision-Language Models15 Sep
- 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models21 Jun
4 more
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Models19 Jun
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
- 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoning30 Oct
Other references · 56
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
38 more
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Depth Anything V2cited by 1,422
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
- 2023VILA: On Pre-training for Visual Language Modelscited by 692
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 598
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 2025Kimi-VL Technical Reportcited by 388
- 2022Visual Spatial Reasoningcited by 293
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
- 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 218
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 160
- 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Modelscited by 146
- 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 139
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 115
- 2024LamRA: Large Multimodal Model as Your Advanced Retrieval Assistantcited by 106
- 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 84
- 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 82
- 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoningcited by 68
- 2024MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Modelscited by 67
- 2019SpatialSense: An Adversarially Crowdsourced Benchmark for Spatial Relation Recognitioncited by 55
- 2024Orient Anything: Learning Robust Object Orientation Estimation from Rendering 3D Modelscited by 45
- 2024Cubify Anything: Scaling Indoor 3D Object Detectioncited by 39
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 18.
24 papers.
Sort:
By area:
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarkscited by 33
- 2025Geometrically-Constrained Agent for Spatial Reasoningcited by 26
- 2025Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Modelscited by 12
- 2025Mixture-of-Visual-Thoughts: Exploring Context-Adaptive Reasoning Mode Selection for General Visual Reasoningcited by 7
- 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Taskscited by 7
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environmentscited by 6
- 2026RieMind: Geometry-Grounded Spatial Agent for Scene Understandingcited by 4
- 2026MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photoscited by 4
- 2026Self-Evolving Neuro-Symbolic Skills for Tool-Augmented Spatial Reasoningcited by 4
- 2025Transductive Visual Programming: Evolving Tool Libraries from Experience for Spatial Reasoningcited by 3
- 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Modelscited by 3
- 2026MapTab: A Diagnostic Benchmark for Long-Horizon Multi-Criteria Multimodal Reasoning on Heterogeneous Topological Graphscited by 3
12 more
- 2026MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Modelcited by 3
- 2026Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Textcited by 2
- 2026ViewFusion: Structured Spatial Thinking Chains for Multi-View Reasoningcited by 1
- 2026Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoningcited by 1
- 2025SpatialGeo:Boosting Spatial Reasoning in Multimodal LLMs via Geometry-Semantics Fusioncited by 0
- 2026LenGuard-GPC: Length Guarding with Guided-Prompt Consistency for Spatial Reasoning Reinforce Learningcited by 0
- 2026CollabFlow: Recursive Self-Improvement of Agent Collaborationcited by 0
- 2026From Sight to Foresight: Predictive Spatial Reasoning in Vision-Language Modelscited by 0
- 2026Mind the Spatial Gap: A Benchmark for Geospatial Reasoning and Constrained Spatial Editingcited by 0
- 2026HumanPhys: A Human-Centric Physical-World Perception Benchmark for Real-World Visual Reasoningcited by 0
- 2026What Makes a Good Visual Representation for Spatial Understanding in MLLMs?cited by 0
- 2026The Gap Is in the Geometry: A Convergent Meta-Analysis of Multi-Facet Aerial and Remote Sensing Video Understandingcited by 0
- 2026The Gap Is in the Geometry: A Convergent Meta-Analysis of Multi-Facet Aerial and Remote Sensing Video Understanding13 Oct 2026
- 2026What Makes a Good Visual Representation for Spatial Understanding in MLLMs?13 Oct 2026
- 2026HumanPhys: A Human-Centric Physical-World Perception Benchmark for Real-World Visual Reasoning10 Oct 2026
- 2026Mind the Spatial Gap: A Benchmark for Geospatial Reasoning and Constrained Spatial Editing9 Oct 2026
- 2026From Sight to Foresight: Predictive Spatial Reasoning in Vision-Language Models2 Oct 2026
- 2026CollabFlow: Recursive Self-Improvement of Agent Collaboration29 Sep 2026
- 2026Self-Evolving Neuro-Symbolic Skills for Tool-Augmented Spatial Reasoning8 Aug 2026
- 2026Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Text23 Jul 2026
- 2026LenGuard-GPC: Length Guarding with Guided-Prompt Consistency for Spatial Reasoning Reinforce Learning19 Jul 2026
- 2026MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photos1 Jul 2026
- 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Tasks8 Jun 2026
- 2026Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoning5 Jun 2026
12 more
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments24 Apr 2026
- 2026MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Model19 Mar 2026
- 2026RieMind: Geometry-Grounded Spatial Agent for Scene Understanding16 Mar 2026
- 2026ViewFusion: Structured Spatial Thinking Chains for Multi-View Reasoning6 Mar 2026
- 2026MapTab: A Diagnostic Benchmark for Long-Horizon Multi-Criteria Multimodal Reasoning on Heterogeneous Topological Graphs20 Feb 2026
- 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models9 Feb 2026
- 2025Transductive Visual Programming: Evolving Tool Libraries from Experience for Spatial Reasoning24 Dec 2025
- 2025Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Models23 Dec 2025
- 2025Geometrically-Constrained Agent for Spatial Reasoning27 Nov 2025
- 2025SpatialGeo:Boosting Spatial Reasoning in Multimodal LLMs via Geometry-Semantics Fusion21 Nov 2025
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks29 Oct 2025
- 2025Mixture-of-Visual-Thoughts: Exploring Context-Adaptive Reasoning Mode Selection for General Visual Reasoning26 Sep 2025
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarkscited by 33
- 2025Geometrically-Constrained Agent for Spatial Reasoningcited by 26
- 2025Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Modelscited by 12
- 2025Mixture-of-Visual-Thoughts: Exploring Context-Adaptive Reasoning Mode Selection for General Visual Reasoningcited by 7
- 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Taskscited by 7
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environmentscited by 6
- 2026RieMind: Geometry-Grounded Spatial Agent for Scene Understandingcited by 4
- 2026MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photoscited by 4
- 2026Self-Evolving Neuro-Symbolic Skills for Tool-Augmented Spatial Reasoningcited by 4
- 2025Transductive Visual Programming: Evolving Tool Libraries from Experience for Spatial Reasoningcited by 3
- 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Modelscited by 3
- 2026MapTab: A Diagnostic Benchmark for Long-Horizon Multi-Criteria Multimodal Reasoning on Heterogeneous Topological Graphscited by 3
12 most cited of 20 All 20 (JSON)
- 2026What Makes a Good Visual Representation for Spatial Understanding in MLLMs?13 Oct 2026
- 2026HumanPhys: A Human-Centric Physical-World Perception Benchmark for Real-World Visual Reasoning10 Oct 2026
- 2026From Sight to Foresight: Predictive Spatial Reasoning in Vision-Language Models2 Oct 2026
- 2026Self-Evolving Neuro-Symbolic Skills for Tool-Augmented Spatial Reasoning8 Aug 2026
- 2026LenGuard-GPC: Length Guarding with Guided-Prompt Consistency for Spatial Reasoning Reinforce Learning19 Jul 2026
- 2026MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photos1 Jul 2026
- 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Tasks8 Jun 2026
- 2026Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoning5 Jun 2026
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments24 Apr 2026
- 2026MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Model19 Mar 2026
- 2026RieMind: Geometry-Grounded Spatial Agent for Scene Understanding16 Mar 2026
- 2026ViewFusion: Structured Spatial Thinking Chains for Multi-View Reasoning6 Mar 2026
12 newest of 20 All 20 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition
- 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
- 2026Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models
- 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence
- 2025Spatial4D-Bench: A Versatile 4D Spatial Intelligence Benchmark
- 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
- 2025SpaCE-10: A Comprehensive Benchmark for Multimodal Large Language Models in Compositional Spatial Intelligence