mlsanityData to 14 Oct 2026

Can LLMs Learn to Map the World from Local Descriptions?

arXiv 2505.20874 ↗First posted 27 May 2025cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent advances in Large Language Models (LLMs) have demonstrated strong capabilities in tasks such as code and mathematics. However, their potential to internalize structured spatial knowledge remains underexplored. This study investigates whether LLMs, grounded in locally relative human observations, can construct coherent global spatial cognition by integrating fragmented relational descriptions. We focus on two core aspects of spatial cognition: spatial perception, where models infer consistent global layouts from local positional relationships, and spatial navigation, where models learn road connectivity from trajectory data and plan optimal paths between unconnected locations. Experiments conducted in a simulated urban environment demonstrate that LLMs not only generalize to unseen spatial relationships between points of interest (POIs) but also exhibit latent representations aligned with real-world spatial distributions. Furthermore, LLMs can learn road connectivity from trajectory descriptions, enabling accurate path planning and dynamic spatial awareness during navigation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 27 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

21 of 27 references.

References · 21

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  5. 2023Qwen Technical Reportcited by 3,344
  6. 2025Gemma 3 Technical Reportcited by 1,824
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  8. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
  9. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  10. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
  11. 2023Emergent Linear Representations in World Models of Self-Supervised Sequence Modelscited by 319
  12. 2023Language Models Represent Space and Timecited by 316
9 more
  1. 2024Evaluating the World Model Implicit in a Generative Modelcited by 113
  2. 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 77
  3. 2023Evaluating Cognitive Maps and Planning in Large Language Models with CogEvalcited by 77
  4. 2024Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Modelscited by 66
  5. 2024Does Spatial Cognition Emerge in Frontier Models?cited by 66
  6. 2023Emergent Representations of Program Semantics in Language Models Trained on Programscited by 30
  7. 2021Do Language Models Know the Way to Rome?cited by 18
  8. 2023Linear Latent World Models in Simple Transformers: A Case Study on Othello-GPTcited by 16
  9. 2025From Text to Space: Mapping Abstract Spatial Models in LLMs during a Grid-World Navigation Taskcited by 10

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.