Survey of Multimodal Geospatial Foundation Models: Techniques, Applications, and Challenges
Not on the map. Why?
Abstract (arXiv)
Foundation models have transformed natural language processing and computer vision, and their impact is now reshaping remote sensing image analysis. With powerful generalization and transfer learning capabilities, they align naturally with the multimodal, multi-resolution, and multi-temporal characteristics of remote sensing data. To address unique challenges in the field, multimodal geospatial foundation models (GFMs) have emerged as a dedicated research frontier. This survey delivers a comprehensive review of multimodal GFMs from a modality-driven perspective, covering five core visual and vision-language modalities. We examine how differences in imaging physics and data representation shape interaction design, and we analyze key techniques for alignment, integration, and knowledge transfer to tackle modality heterogeneity, distribution shifts, and semantic gaps. Advances in training paradigms, architectures, and task-specific adaptation strategies are systematically assessed alongside a wealth of emerging benchmarks. Representative multimodal visual and vision-language GFMs are evaluated across ten downstream tasks, with insights into their architectures, performance, and application scenarios. Real-world case studies, spanning land cover mapping, agricultural monitoring, disaster response, climate studies, and geospatial intelligence, demonstrate the practical potential of GFMs. Finally, we outline pressing challenges in domain generalization, interpretability, efficiency, and privacy, and chart promising avenues for future research.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 109 of its 184 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
109 of 184 references.
References · 109
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023GPT-4 Technical Reportcited by 18,396
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023Segment Anythingcited by 8,234
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
- 2022MaPLe: Multi-modal Prompt Learningcited by 687
38 more
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 347
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 340
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2021TransVG: End-to-End Visual Grounding with Transformerscited by 271
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
- 2019BigEarthNet: A Large-Scale Benchmark Archive For Remote Sensing Image Understandingcited by 234
- 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
- 2017Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Modelscited by 206
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 204
- 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 203
- 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 197
- 2019iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Imagescited by 197
- 2020Geography-Aware Self-Supervised Learningcited by 190
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
- 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 181
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 167
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 151
- 2022Advancing Plain Vision Transformer Towards Remote Sensing Foundation Modelcited by 149
- 2018xView: Objects in Context in Overhead Imagerycited by 146
- 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Modelcited by 138
- 2025AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label datacited by 137
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 131
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
- 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 123
- 2018Land-Cover Classification with High-Resolution Remote Sensing Images Using Transferable Deep Modelscited by 119
50 most cited of 109 All 109 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.