mlsanityData to 14 Oct 2026

Survey of Multimodal Geospatial Foundation Models: Techniques, Applications, and Challenges

arXiv 2510.22964 ↗First posted 27 Oct 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Foundation models have transformed natural language processing and computer vision, and their impact is now reshaping remote sensing image analysis. With powerful generalization and transfer learning capabilities, they align naturally with the multimodal, multi-resolution, and multi-temporal characteristics of remote sensing data. To address unique challenges in the field, multimodal geospatial foundation models (GFMs) have emerged as a dedicated research frontier. This survey delivers a comprehensive review of multimodal GFMs from a modality-driven perspective, covering five core visual and vision-language modalities. We examine how differences in imaging physics and data representation shape interaction design, and we analyze key techniques for alignment, integration, and knowledge transfer to tackle modality heterogeneity, distribution shifts, and semantic gaps. Advances in training paradigms, architectures, and task-specific adaptation strategies are systematically assessed alongside a wealth of emerging benchmarks. Representative multimodal visual and vision-language GFMs are evaluated across ten downstream tasks, with insights into their architectures, performance, and application scenarios. Real-world case studies, spanning land cover mapping, agricultural monitoring, disaster response, climate studies, and geospatial intelligence, demonstrate the practical potential of GFMs. Finally, we outline pressing challenges in domain generalization, interpretability, efficiency, and privacy, and chart promising avenues for future research.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 109 of its 184 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

109 of 184 references.

References · 109

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  6. 2023Segment Anythingcited by 8,234
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  8. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
  9. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  10. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
  11. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
  12. 2022MaPLe: Multi-modal Prompt Learningcited by 687
38 more
  1. 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
  2. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
  3. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
  4. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
  5. 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 347
  6. 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 340
  7. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
  8. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
  9. 2021TransVG: End-to-End Visual Grounding with Transformerscited by 271
  10. 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
  11. 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
  12. 2019BigEarthNet: A Large-Scale Benchmark Archive For Remote Sensing Image Understandingcited by 234
  13. 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
  14. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
  15. 2017Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Modelscited by 206
  16. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
  17. 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 204
  18. 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 203
  19. 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 197
  20. 2019iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Imagescited by 197
  21. 2020Geography-Aware Self-Supervised Learningcited by 190
  22. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
  23. 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
  24. 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 181
  25. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
  26. 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 167
  27. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
  28. 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
  29. 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 151
  30. 2022Advancing Plain Vision Transformer Towards Remote Sensing Foundation Modelcited by 149
  31. 2018xView: Objects in Context in Overhead Imagerycited by 146
  32. 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
  33. 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Modelcited by 138
  34. 2025AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label datacited by 137
  35. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 131
  36. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
  37. 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 123
  38. 2018Land-Cover Classification with High-Resolution Remote Sensing Images Using Transferable Deep Modelscited by 119

50 most cited of 109 All 109 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.