mlsanityData to 14 Oct 2026

SpatialLLM: From Multi-modality Data to Urban Spatial Intelligence

arXiv 2505.12703 ↗First posted 19 May 2025cs.CV cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

We propose SpatialLLM, a novel approach advancing spatial intelligence tasks in complex urban scenes. Unlike previous methods requiring geographic analysis tools or domain expertise, SpatialLLM is a unified language model directly addressing various spatial intelligence tasks without any training, fine-tuning, or expert intervention. The core of SpatialLLM lies in constructing detailed and structured scene descriptions from raw spatial data to prompt pre-trained LLMs for scene-based analysis. Extensive experiments show that, with our designs, pretrained LLMs can accurately perceive spatial distribution information and enable zero-shot execution of advanced spatial intelligence tasks, including urban planning, ecological analysis, traffic management, etc. We argue that multi-field knowledge, context length, and reasoning ability are key factors influencing LLM performances in urban analysis. We hope that SpatialLLM will provide a novel viable perspective for urban intelligent analysis and management. The code and dataset are available at https://github.com/WHU-USI3DV/SpatialLLM.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 32 of its 59 references that are in the map. First posted on arXiv 19 May 2025.

Builds on

32 of 59 references.

References · 32

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Qwen Technical Reportcited by 3,344
  4. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  5. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  6. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
  7. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  8. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
  9. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 452
  10. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
  11. 2023An Embodied Generalist Agent in 3D Worldcited by 365
  12. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
20 more
  1. 2022SQA3D: Situated Question Answering in 3D Scenescited by 314
  2. 2023LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planningcited by 210
  3. 20233D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignmentcited by 204
  4. 2023Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifierscited by 175
  5. 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoningcited by 175
  6. 2022Stratified Transformer for 3D Point Cloud Segmentationcited by 167
  7. 2023Chat-3D: Data-efficiently Tuning Large Language Model for Universal Dialogue of 3D Scenescited by 129
  8. 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligencecited by 88
  9. 2023Autonomous GIS: the next-generation AI-powered GIScited by 53
  10. 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Modelscited by 43
  11. 2023GeoGPT: Understanding and Processing Geospatial Tasks through An Autonomous GPTcited by 41
  12. 2024MMScan: A Multi-Modal 3D Scene Dataset with Hierarchical Grounded Language Annotationscited by 40
  13. 2024CityGPT: Empowering Urban Spatial Cognition of Large Language Modelscited by 30
  14. 2023UrbanBIS: a Large-scale Benchmark for Fine-grained Urban Building Instance Segmentationcited by 24
  15. 2023CityRefer: Geography-aware 3D Visual Grounding Dataset on City-scale Point Cloud Datacited by 18
  16. 2023Recent Advances in Multi-modal 3D Intelligence: A Comprehensive Survey and Evaluationcited by 12
  17. 2024SceneGPT: A Language Model for 3D Scene Understandingcited by 12
  18. 2024Tag Map: A Text-Based Map for Spatial Reasoning and Navigation with Large Language Modelscited by 12
  19. 20243D Question Answering for City Scene Understandingcited by 10
  20. 2024GeoReasoner: Reasoning On Geospatially Grounded Context For Natural Language Understandingcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 6.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can Large Language Models Integrate Spatial Data? Empirical Insights into Reasoning Strengths and Computational Weaknesses
  2. 2025A Survey of Large Language Model-Powered Spatial Intelligence Across Scales: Advances in Embodied Agents, Smart Cities, and Earth Science
  3. 2025UrbanLLaVA: A Multi-modal Large Language Model for Urban Intelligence with Spatial Reasoning and Understanding
  4. 2025SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligence
  5. 2024StreetviewLLM: Extracting Geographic Information Using a Chain-of-Thought Multimodal Large Language Model
  6. 2026Can LLMs See Without Pixels? Benchmarking Spatial Intelligence from Textual Descriptions
  7. 2026Mind the Spatial Gap: A Benchmark for Geospatial Reasoning and Constrained Spatial Editing
  8. 2025USTBench: Benchmarking and Dissecting Spatiotemporal Reasoning of LLMs as Urban Agents