Emerging Flexible Designs for Geospatial Multimodal Foundation Models
Not on the map. Why?
Abstract (arXiv)
Foundation models are rapidly transforming Earth observation by enabling scalable pretraining across diverse unlabeled geospatial modalities. However, their architectural diversity ranging from encoder-only to encoder-decoder and masked autoencoding paradigms makes it challenging to assess performance trade offs in a consistent manner. In this work, we present an apples-to-apples comparison of leading FM architectures designed for geospatial multimodal reasoning, with a particular focus on flexibility across varied spectral band configurations. We standardize pretraining using identical self supervised learning objectives and training datasets, and evaluate all models under consistent parameterization on the GEOBench benchmark across classification and segmentation tasks. Our results offer new insights into the design trade-offs between model flexibility, modality alignment, and downstream task performance. By highlighting architectural strengths and limitations under controlled conditions, this study provides practical guidance for building next generation geospatial foundation models capable of robust multimodal reasoning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
17 of 25 references.
References · 17
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2020Geography-Aware Self-Supervised Learningcited by 190
- 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 124
- 2024Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observationcited by 104
- 2021BigEarthNet-MM: A Large Scale Multi-Modal Multi-Label Benchmark Archive for Remote Sensing Image Classification and Retrievalcited by 92
- 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 74
- 2024OmniSat: Self-Supervised Modality Fusion for Earth Observationcited by 63
- 2024One for All: Toward Unified Foundation Models for Earth Visioncited by 34
- 2023FoMo: Multi-Modal, Multi-Scale and Multi-Task Remote Sensing Foundation Models for Forest Monitoringcited by 31
5 more
- 2023USat: A Unified Self-Supervised Encoder for Multi-Sensor Satellite Imagerycited by 28
- 2025TerraTorch: The Geospatial Foundation Models Toolkitcited by 25
- 2024SenPa-MAE: Sensor Parameter Aware Masked Autoencoder for Multi-Satellite Self-Supervised Pretrainingcited by 18
- 2024OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagerycited by 11
- 2023Mapping smallholder cashew plantations to inform sustainable tree crop expansion in Benincited by 10
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discovery
- 2026GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensing
- 2026GeoMeld: Toward Semantically Grounded Foundation Models for Remote Sensing
- 2026SIMPLER: Efficient Foundation Model Adaptation via Similarity-Guided Layer Pruning for Earth Observation
- 2026The Emerging Paradigm of Geospatial Foundation Models: From Pre-Training to Agentic Reasoning
- 2025Scaling Laws for Geospatial Foundation Models: A case study on PhilEO Bench
- 2026MEOX: Compact Multimodal Mixture-of-Experts for Earth Observation
- 2024Towards Vision-Language Geo-Foundation Model: A Survey