Spatial Representation Learning Beyond Pixels: Unifying Raster Data and Vector Semantics for Human-Centric Geospatial Foundation Models
Not on the map. Why?
Abstract (arXiv)
Earth Observation (EO) has fundamentally transformed the monitoring of environmental processes and human activities up to planetary scale. Recent advances in self-supervised learning have given rise to Earth Observation Foundation Models (EOFMs), which leverage petabyte-scale unlabeled EO data to learn transferable representations across a wide range of downstream geospatial tasks. Despite these advances, current EOFMs remain largely confined to raster modalities, overlooking the rich, structured information encoded in openly-accessible vector data sources such as OpenStreetMap and Overture. Vector data provides explicit and compact representations of geographic entities, including geometry, topology, and semantic relationships, offering critical contextual signals that are often ambiguous or inaccessible in imagery alone. Raster and vector data thus represent complementary views of geographic space: raster data captures continuous physical and spectral patterns, while vector data encodes discrete objects and their relational structure and often represents more of the human rather than the physical systems (e.g. social or demographic data). However, existing geospatial representation learning paradigms treat these modalities in isolation, relying on imperfect and often lossy transformations to bridge them. This perspective paper calls for a paradigm shift toward joint Spatial Representation Learning (SRL) in an unified embedding space that integrate raster perception with vector-based reasoning. Building on emerging efforts in multimodal geospatial learning, we highlight conceptual foundations, technical challenges, and promising directions for aligning heterogeneous spatial data sources. We contend that such integration is essential for developing next-generation geospatial AI systems capable of more accurate, interpretable, and semantically grounded understanding of the Earth.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 59 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
42 of 59 references.
References · 42
- 2023Reasoning with Language Model is Planning with World Modelcited by 861
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 187
- 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 151
- 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
- 2025AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label datacited by 137
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
- 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 104
- 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 69
30 more
- 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 68
- 2023Geographic Location Encoding with Spherical Harmonics and Sinusoidal Representation Networkscited by 61
- 2025Towards a Unified Copernicus Foundation Model for Earth Visioncited by 53
- 2025Galileo: Learning Global & Local Features of Many Remote Sensing Modalitiescited by 43
- 2020OpenStreetMap: Challenges and Opportunities in Machine Learning and Remote Sensingcited by 30
- 2025SkySense V2: A Unified Foundation Model for Multi-modal Remote Sensingcited by 26
- 2025TerraFM: A Scalable Foundation Model for Unified Multisensor Earth Observationcited by 25
- 2025Foundation Models for Geospatial Reasoning: Assessing Capabilities of Large Language Models in Understanding Geometries and Topological Spatial Relationscited by 23
- 2022Towards General-Purpose Representation Learning of Polygonal Geometriescited by 22
- 2023City Foundation Models for Learning General Purpose Representations from OpenStreetMapcited by 21
- 2025RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddingscited by 19
- 2025REOBench: Benchmarking Robustness of Earth Observation Foundation Modelscited by 15
- 2024Poly2Vec: Polymorphic Fourier-Based Encoding of Geospatial Objects for GeoAI Applicationscited by 13
- 2024Global and Dense Embeddings of Earth: Major TOM Floating in the Latent Spacecited by 12
- 2024PolygonGNN: Representation Learning for Polygonal Geometries with Heterogeneous Visibility Graphcited by 10
- 2025Lossy Neural Compression for Geospatial Analytics: A Reviewcited by 10
- 2025GAIR: Location-Aware Self-Supervised Contrastive Pre-Training with Geo-Aligned Implicit Representationscited by 10
- 2025Climplicit: Climatic Implicit Embeddings for Global Ecological Taskscited by 10
- 2024Pix2Poly: A Sequence Prediction Method for End-to-end Polygonal Building Footprint Extraction from Remote Sensing Imagerycited by 8
- 2025GeoLink: Empowering Remote Sensing Foundation Model with OpenStreetMap Datacited by 8
- 2025Geo2Vec: Shape- and Distance-Aware Neural Representation of Geospatial Entitiescited by 7
- 2026THOR: A Versatile Foundation Model for Earth Observation Climate and Society Applicationscited by 7
- 2025ExEBench: Benchmarking Foundation Models on Extreme Earth Eventscited by 5
- 2025S2Vec: Self-Supervised Geospatial Embeddings for the Built Environmentcited by 4
- 2025Semantic-Guided Cross-Sensor Super Resolution of Remote Sensing Images: A Gated Dual Conditioning Flow Matching Modelcited by 3
- 2025SHRUG-FM: Reliability-Aware Foundation Models for Earth Observationcited by 3
- 2025Beyond AlphaEarth: Toward Human-Centered Geospatial Foundation Models via POI-Guided Contrastive Learningcited by 2
- 2026A satellite foundation model for improved wealth monitoringcited by 2
- 2026OT on the Map: Quantifying Domain Shifts in Geographic Spacecited by 1
- 2026Asynchronous Remote Sensing Time-Series Fusion for Cloud Removal and Anytime Reconstructioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.