mlsanityData to 14 Oct 2026

SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligence

arXiv 2505.17012 ↗First posted 22 May 2025cs.CV cs.AIcited by 24

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Existing evaluations of multimodal large language models (MLLMs) on spatial intelligence are typically fragmented and limited in scope. In this work, we aim to conduct a holistic assessment of the spatial understanding capabilities of modern MLLMs and propose complementary data-driven and agent-based solutions. Specifically, we make the following contributions: (i) we introduce SpatialScore, to our knowledge, the most comprehensive and diverse benchmark for multimodal spatial intelligence to date. It covers multiple visual data types, input modalities, and question-answering formats, and contains approximately 5K manually verified samples spanning 30 distinct tasks; (ii) using SpatialScore, we extensively evaluate 49 representative MLLMs, revealing persistent challenges and a substantial gap between current models and human-level spatial intelligence; (iii) to advance model capabilities, we construct SpatialCorpus, a large-scale training resource with 331K multimodal QA samples that supports fine-tuning on spatial reasoning tasks and significantly improves the performance of existing models (e.g., Qwen3-VL); (iv) to complement this data-driven route with a training-free paradigm, we develop SpatialAgent, a multi-agent system equipped with 12 specialized spatial perception tools that supports both Plan-Execute and ReAct reasoning, enabling substantial gains in spatial reasoning without additional model training. Extensive experiments and in-depth analyses demonstrate the effectiveness of our benchmark, corpus, and agent framework. We expect these resources to serve as a solid foundation for advancing MLLMs toward human-level spatial intelligence. All data, code, and models will be released to the research community.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 72 of its 112 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

72 of 112 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Models1 May
  2. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  3. 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?31 Mar
  4. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3D29 Mar
  5. 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMs17 Mar
  6. 2025Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models12 Feb
  7. 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding27 Jan
  8. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  9. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics25 Nov
  10. 2024SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language Models11 Oct
  11. 2024Reasoning Paths with Reference Objects Elicit Quantitative Spatial Reasoning in Large Vision-Language Models15 Sep
  12. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models21 Jun
4 more
  1. 2024SpatialBot: Precise Spatial Understanding with Vision Language Models19 Jun
  2. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
  3. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  4. 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoning30 Oct

Other references · 56

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  7. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  8. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  9. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  10. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  11. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  12. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
38 more
  1. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  2. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  3. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  4. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  5. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  6. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  7. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  8. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  9. 2024Depth Anything V2cited by 1,422
  10. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  11. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  12. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  13. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  14. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  15. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  16. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
  17. 2023VILA: On Pre-training for Visual Language Modelscited by 692
  18. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 598
  19. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  20. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  21. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  22. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
  23. 2025Kimi-VL Technical Reportcited by 388
  24. 2022Visual Spatial Reasoningcited by 293
  25. 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
  26. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 218
  27. 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 160
  28. 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Modelscited by 146
  29. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 139
  30. 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 115
  31. 2024LamRA: Large Multimodal Model as Your Advanced Retrieval Assistantcited by 106
  32. 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 84
  33. 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 82
  34. 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoningcited by 68
  35. 2024MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Modelscited by 67
  36. 2019SpatialSense: An Adversarially Crowdsourced Benchmark for Spatial Relation Recognitioncited by 55
  37. 2024Orient Anything: Learning Robust Object Orientation Estimation from Rendering 3D Modelscited by 45
  38. 2024Cubify Anything: Scaling Indoor 3D Object Detectioncited by 39

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 18.

24 papers.

Sort:

By area:

  1. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarkscited by 33
  2. 2025Geometrically-Constrained Agent for Spatial Reasoningcited by 26
  3. 2025Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Modelscited by 12
  4. 2025Mixture-of-Visual-Thoughts: Exploring Context-Adaptive Reasoning Mode Selection for General Visual Reasoningcited by 7
  5. 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Taskscited by 7
  6. 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environmentscited by 6
  7. 2026RieMind: Geometry-Grounded Spatial Agent for Scene Understandingcited by 4
  8. 2026MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photoscited by 4
  9. 2026Self-Evolving Neuro-Symbolic Skills for Tool-Augmented Spatial Reasoningcited by 4
  10. 2025Transductive Visual Programming: Evolving Tool Libraries from Experience for Spatial Reasoningcited by 3
  11. 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Modelscited by 3
  12. 2026MapTab: A Diagnostic Benchmark for Long-Horizon Multi-Criteria Multimodal Reasoning on Heterogeneous Topological Graphscited by 3
12 more
  1. 2026MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Modelcited by 3
  2. 2026Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Textcited by 2
  3. 2026ViewFusion: Structured Spatial Thinking Chains for Multi-View Reasoningcited by 1
  4. 2026Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoningcited by 1
  5. 2025SpatialGeo:Boosting Spatial Reasoning in Multimodal LLMs via Geometry-Semantics Fusioncited by 0
  6. 2026LenGuard-GPC: Length Guarding with Guided-Prompt Consistency for Spatial Reasoning Reinforce Learningcited by 0
  7. 2026CollabFlow: Recursive Self-Improvement of Agent Collaborationcited by 0
  8. 2026From Sight to Foresight: Predictive Spatial Reasoning in Vision-Language Modelscited by 0
  9. 2026Mind the Spatial Gap: A Benchmark for Geospatial Reasoning and Constrained Spatial Editingcited by 0
  10. 2026HumanPhys: A Human-Centric Physical-World Perception Benchmark for Real-World Visual Reasoningcited by 0
  11. 2026What Makes a Good Visual Representation for Spatial Understanding in MLLMs?cited by 0
  12. 2026The Gap Is in the Geometry: A Convergent Meta-Analysis of Multi-Facet Aerial and Remote Sensing Video Understandingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition
  2. 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
  3. 2026Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models
  4. 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
  5. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence
  6. 2025Spatial4D-Bench: A Versatile 4D Spatial Intelligence Benchmark
  7. 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
  8. 2025SpaCE-10: A Comprehensive Benchmark for Multimodal Large Language Models in Compositional Spatial Intelligence