Scalable and Trustworthy Earth Observation Foundation Models
Not on the map. Why?
Abstract (arXiv)
Foundation models (FMs) have transformed machine learning from isolated task-specific model development toward general-purpose models pretrained on broad data and adapted to multiple downstream tasks. Earth observation (EO) is an important domain for this paradigm because satellite and airborne archives are large, high-revisit, and increasingly multimodal, while reliable field labels are often sparse. Remote sensing foundation models (RSFMs) cannot be transferred reliably/optimally without domain-specific adaptation. This is because EO data are governed by measurement physics and operational decision constraints. This chapter reviews the design principles arising from these domain-specific constraints. It first defines the FMs paradigm in remote sensing (RS), then synthesizes the current model landscape, pretraining objectives, architecture designs, downstream adaptation and trustworthiness requirements. The chapter also incorporates recent benchmark evidence showing that no single geospatial foundation model is universally best and that inconsistent evaluation remains a major issue to fair comparison and reliable deployment. In addition, two brief environmental monitoring case studies; physics-informed spectral targeted masking for harmful algal bloom prediction and reinforcement learning for adaptive environmental monitoring station selection to illustrate the FMs domain-guided principles in practice. This chapter posits that next-generation RSFMs should be evaluated not only by benchmark accuracy, but also by modality-aware transfer and physically plausible representations for trustworthy EO decisions.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
43 of 53 references.
References · 43
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,231
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
- 2017On Calibration of Modern Neural Networkscited by 4,902
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,213
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,999
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,902
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,306
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,710
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,240
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 406
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 359
- 2023ClimaX: A foundation model for weather and climatecited by 332
31 more
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 305
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 251
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 181
- 2014Learning to Optimize via Information-Directed Samplingcited by 168
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 168
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
- 2022Self-supervised Learning in Remote Sensing: A Reviewcited by 137
- 2025AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label datacited by 128
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 116
- 2024Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observationcited by 102
- 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 101
- 2022SSL4EO-S12: A Large-Scale Multi-Modal, Multi-Temporal Dataset for Self-Supervised Learning in Earth Observationcited by 83
- 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 77
- 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
- 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 68
- 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 66
- 2025Towards a Unified Copernicus Foundation Model for Earth Visioncited by 53
- 2024Major TOM: Expandable Datasets for Earth Observationcited by 31
- 2025SkySense V2: A Unified Foundation Model for Multi-modal Remote Sensingcited by 26
- 2025GEO-Bench-2: From Performance to Capability, Rethinking Evaluation in Geospatial AIcited by 21
- 2026No One Knows the State of the Art in Geospatial Foundation Modelscited by 12
- 2025Geospatial Foundation Models to Enable Progress on Sustainable Development Goalscited by 10
- 2025Fine-tune Smarter, Not Harder: Parameter-Efficient Fine-Tuning for Geospatial Foundation Modelscited by 9
- 2025DOFA-CLIP: Multimodal Vision-Language Foundation Models for Earth Observationcited by 6
- 2026MMEarth-Bench: Global Model Adaptation via Multimodal Test-Time Trainingcited by 6
- 2025Physics-Informed Spectral Modeling for Hyperspectral Imagingcited by 2
- 2026TerraFlow: Multimodal, Multitemporal Representation Learning for Earth Observationcited by 2
- 2026SpecTM: Spectral Targeted Masking for Trustworthy Foundation Modelscited by 2
- 2026HighFM: Towards a Foundation Model for Learning Representations from High-Frequency Earth Observation Datacited by 2
- 2026GeoMeld: Toward Semantically Grounded Foundation Models for Remote Sensingcited by 2
- 2026PiCSRL: Physics-Informed Contextual Spectral Reinforcement Learningcited by 1
Built on by
Not cited yet.