mlsanityData to 14 Oct 2026

GeoLink: Empowering Remote Sensing Foundation Model with OpenStreetMap Data

arXiv 2509.26016 ↗First posted 30 Sep 2025cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Integrating ground-level geospatial data with rich geographic context, like OpenStreetMap (OSM), into remote sensing (RS) foundation models (FMs) is essential for advancing geospatial intelligence and supporting a broad spectrum of tasks. However, modality gap between RS and OSM data, including differences in data structure, content, and spatial granularity, makes effective synergy highly challenging, and most existing RS FMs focus on imagery alone. To this end, this study presents GeoLink, a multimodal framework that leverages OSM data to enhance RS FM during both the pretraining and downstream task stages. Specifically, GeoLink enhances RS self-supervised pretraining using multi-granularity learning signals derived from OSM data, guided by cross-modal spatial correlations for information interaction and collaboration. It also introduces image mask-reconstruction to enable sparse input for efficient pretraining. For downstream tasks, GeoLink generates both unimodal and multimodal fine-grained encodings to support a wide range of applications, from common RS interpretation tasks like land cover classification to more comprehensive geographic tasks like urban function zone mapping. Extensive experiments show that incorporating OSM data during pretraining enhances the performance of the RS image encoder, while fusing RS and OSM data in downstream tasks improves the FM's adaptability to complex geographic scenarios. These results underscore the potential of multimodal synergy in advancing high-level geospatial artificial intelligence. Moreover, we find that spatial correlation plays a crucial role in enabling effective multimodal geospatial data integration. Code, checkpoints, and using examples are released at https://github.com/bailubin/GeoLink_NeurIPS2025

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 38 of its 71 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

38 of 71 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2017Graph Attention Networkscited by 8,923
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
  7. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
  8. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
  9. 2022Scaling Language-Image Pre-training via Maskingcited by 317
  10. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
  11. 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
  12. 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
26 more
  1. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
  2. 2020Geography-Aware Self-Supervised Learningcited by 190
  3. 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
  4. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
  5. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
  6. 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
  7. 2019xBD: A Dataset for Assessing Building Damage from Satellite Imagerycited by 139
  8. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
  9. 2023Towards Geospatial Foundation Models via Continual Pretrainingcited by 109
  10. 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
  11. 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 69
  12. 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 68
  13. 2024OmniSat: Self-Supervised Modality Fusion for Earth Observationcited by 63
  14. 2020MLRSNet: A Multi-label High Spatial Resolution Remote Sensing Dataset for Semantic Scene Understandingcited by 59
  15. 2024Cross-Scale MAE: A Tale of Multi-Scale Exploitation in Remote Sensingcited by 47
  16. 2023Decoupling Common and Unique Representations for Multimodal Self-supervised Learningcited by 36
  17. 2022Enabling Country-Scale Land Cover Mapping with Meter-Resolution Satellite Imagerycited by 31
  18. 2023FoMo: Multi-Modal, Multi-Scale and Multi-Task Remote Sensing Foundation Models for Forest Monitoringcited by 31
  19. 2020OpenStreetMap: Challenges and Opportunities in Machine Learning and Remote Sensingcited by 30
  20. 2024CrossEarth: Geospatial Vision Foundation Model for Domain Generalizable Remote Sensing Semantic Segmentationcited by 27
  21. 2025FlexiMo: A Flexible Remote Sensing Foundation Modelcited by 24
  22. 2025HyperFree: A Channel-adaptive and Tuning-free Foundation Model for Hyperspectral Remote Sensing Imagerycited by 17
  23. 2017Joint Learning from Earth Observation and OpenStreetMap Data to Get Faster Better Semantic Mapscited by 13
  24. 2023When Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence Systemcited by 13
  25. 2024Geospatial foundation models for image analysis: evaluating and enhancing NASA-IBM Prithvi's domain adaptabilitycited by 11
  26. 2020AiRound and CV-BrCT: Novel Multi-View Datasets for Scene Classificationcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.