Enriching Location Representation with Detailed Semantic Information
Not on the map. Why?
Abstract (arXiv)
Spatial representations that capture both structural and semantic characteristics of urban environments are essential for urban modeling. Traditional spatial embeddings often prioritize spatial proximity while underutilizing fine-grained contextual information from places. To address this limitation, we introduce CaLLiPer+, an extension of the CaLLiPer model that systematically integrates Point-of-Interest (POI) names alongside categorical labels within a multimodal contrastive learning framework. We evaluate its effectiveness on two downstream tasks, land use classification and socioeconomic status distribution mapping, demonstrating consistent performance gains of 4% to 11% over baseline methods. Additionally, we show that incorporating POI names enhances location retrieval, enabling models to capture complex urban concepts with greater precision. Ablation studies further reveal the complementary role of POI names and the advantages of leveraging pretrained text encoders for spatial representations. Overall, our findings highlight the potential of integrating fine-grained semantic attributes and multimodal learning techniques to advance the development of urban foundation models.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 16 of its 34 references that are in the map. First posted on arXiv 3 Jun 2025.
Builds on
16 of 34 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 187
- 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 151
- 2018Tile2Vec: Unsupervised representation learning for spatially distributed datacited by 110
4 more
- 2020Multi-Scale Representation Learning for Spatial Feature Distributions using Grid Cellscited by 90
- 2023UrbanCLIP: Learning Text-enhanced Urban Region Profiling with Contrastive Language-Image Pretraining from the Webcited by 78
- 2023Sphere2Vec: A General-Purpose Location Representation Learning over a Spherical Surface for Large-Scale Geospatial Predictionscited by 39
- 2022Context-aware multi-head self-attentional neural network model for next location predictioncited by 21
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2026CITYREP: A Unified Benchmark for Urban Representations Across Cities, Tasks, and Modalitiescited by 5
- 2025Into the Unknown: Applying Inductive Spatial-Semantic Location Embeddings for Predicting Individuals' Mobility Beyond Visited Placescited by 4
- 2025Beyond AlphaEarth: Toward Human-Centered Geospatial Foundation Models via POI-Guided Contrastive Learningcited by 2
- 2026OSMGraphCLIP: Learning Global Location Representations from OpenStreetMap Graphscited by 0
- 2026LE4Mob: Towards Inductive, Distance-Aware and General-Purpose Location Embedding for Human Mobility Modellingcited by 0
- 2026Modelling daily activity patterns from mobile phone location data via deep representation learningcited by 0
- 2026Modelling daily activity patterns from mobile phone location data via deep representation learning20 Aug 2026
- 2026LE4Mob: Towards Inductive, Distance-Aware and General-Purpose Location Embedding for Human Mobility Modelling19 Aug 2026
- 2026OSMGraphCLIP: Learning Global Location Representations from OpenStreetMap Graphs6 Jun 2026
- 2026CITYREP: A Unified Benchmark for Urban Representations Across Cities, Tasks, and Modalities25 May 2026
- 2025Beyond AlphaEarth: Toward Human-Centered Geospatial Foundation Models via POI-Guided Contrastive Learning10 Oct 2025
- 2025Into the Unknown: Applying Inductive Spatial-Semantic Location Embeddings for Predicting Individuals' Mobility Beyond Visited Places17 Jun 2025