GeoLink: Empowering Remote Sensing Foundation Model with OpenStreetMap Data
Not on the map. Why?
Abstract (arXiv)
Integrating ground-level geospatial data with rich geographic context, like OpenStreetMap (OSM), into remote sensing (RS) foundation models (FMs) is essential for advancing geospatial intelligence and supporting a broad spectrum of tasks. However, modality gap between RS and OSM data, including differences in data structure, content, and spatial granularity, makes effective synergy highly challenging, and most existing RS FMs focus on imagery alone. To this end, this study presents GeoLink, a multimodal framework that leverages OSM data to enhance RS FM during both the pretraining and downstream task stages. Specifically, GeoLink enhances RS self-supervised pretraining using multi-granularity learning signals derived from OSM data, guided by cross-modal spatial correlations for information interaction and collaboration. It also introduces image mask-reconstruction to enable sparse input for efficient pretraining. For downstream tasks, GeoLink generates both unimodal and multimodal fine-grained encodings to support a wide range of applications, from common RS interpretation tasks like land cover classification to more comprehensive geographic tasks like urban function zone mapping. Extensive experiments show that incorporating OSM data during pretraining enhances the performance of the RS image encoder, while fusing RS and OSM data in downstream tasks improves the FM's adaptability to complex geographic scenarios. These results underscore the potential of multimodal synergy in advancing high-level geospatial artificial intelligence. Moreover, we find that spatial correlation plays a crucial role in enabling effective multimodal geospatial data integration. Code, checkpoints, and using examples are released at https://github.com/bailubin/GeoLink_NeurIPS2025
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 38 of its 71 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
38 of 71 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2017Graph Attention Networkscited by 8,923
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2022Scaling Language-Image Pre-training via Maskingcited by 317
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
- 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
26 more
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
- 2020Geography-Aware Self-Supervised Learningcited by 190
- 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
- 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
- 2019xBD: A Dataset for Assessing Building Damage from Satellite Imagerycited by 139
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
- 2023Towards Geospatial Foundation Models via Continual Pretrainingcited by 109
- 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
- 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 69
- 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 68
- 2024OmniSat: Self-Supervised Modality Fusion for Earth Observationcited by 63
- 2020MLRSNet: A Multi-label High Spatial Resolution Remote Sensing Dataset for Semantic Scene Understandingcited by 59
- 2024Cross-Scale MAE: A Tale of Multi-Scale Exploitation in Remote Sensingcited by 47
- 2023Decoupling Common and Unique Representations for Multimodal Self-supervised Learningcited by 36
- 2022Enabling Country-Scale Land Cover Mapping with Meter-Resolution Satellite Imagerycited by 31
- 2023FoMo: Multi-Modal, Multi-Scale and Multi-Task Remote Sensing Foundation Models for Forest Monitoringcited by 31
- 2020OpenStreetMap: Challenges and Opportunities in Machine Learning and Remote Sensingcited by 30
- 2024CrossEarth: Geospatial Vision Foundation Model for Domain Generalizable Remote Sensing Semantic Segmentationcited by 27
- 2025FlexiMo: A Flexible Remote Sensing Foundation Modelcited by 24
- 2025HyperFree: A Channel-adaptive and Tuning-free Foundation Model for Hyperspectral Remote Sensing Imagerycited by 17
- 2017Joint Learning from Earth Observation and OpenStreetMap Data to Get Faster Better Semantic Mapscited by 13
- 2023When Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence Systemcited by 13
- 2024Geospatial foundation models for image analysis: evaluating and enhancing NASA-IBM Prithvi's domain adaptabilitycited by 11
- 2020AiRound and CV-BrCT: Novel Multi-View Datasets for Scene Classificationcited by 10
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Spatial Representation Learning Beyond Pixels: Unifying Raster Data and Vector Semantics for Human-Centric Geospatial Foundation Modelscited by 1
- 2026A high-resolution nationwide urban village mapping product for 342 Chinese cities based on foundation modelscited by 0
- 2026GroundSet: A Cadastral-Grounded Dataset for Spatial Understanding with Vector Datacited by 0
- 2026TrajGANR: Trajectory-Centric Urban Multimodal Learning via Geospatially Aligned Neural Representationscited by 0
- 2026OSMGraphCLIP: Learning Global Location Representations from OpenStreetMap Graphscited by 0
- 2026GeoArbiter: Verifiability-Guided Grounding for Remote-Sensing Multimodal LLMscited by 0
- 2026Autoregressive Drillhole Modelling Under Distribution Shiftcited by 0
- 2026Geospatial Vector Geometry as a Native Spatial Modality for Vision-Language Modelscited by 0
- 2026Geospatial Vector Geometry as a Native Spatial Modality for Vision-Language Models12 Oct 2026
- 2026Autoregressive Drillhole Modelling Under Distribution Shift1 Oct 2026
- 2026GeoArbiter: Verifiability-Guided Grounding for Remote-Sensing Multimodal LLMs1 Aug 2026
- 2026OSMGraphCLIP: Learning Global Location Representations from OpenStreetMap Graphs6 Jun 2026
- 2026Spatial Representation Learning Beyond Pixels: Unifying Raster Data and Vector Semantics for Human-Centric Geospatial Foundation Models1 Jun 2026
- 2026TrajGANR: Trajectory-Centric Urban Multimodal Learning via Geospatially Aligned Neural Representations7 May 2026
- 2026GroundSet: A Cadastral-Grounded Dataset for Spatial Understanding with Vector Data15 Mar 2026
- 2026A high-resolution nationwide urban village mapping product for 342 Chinese cities based on foundation models21 Feb 2026