Leveraging AI multimodal geospatial foundation models for improved near-real-time flood mapping at a global scale
Not on the map. Why?
Abstract (arXiv)
Floods are among the most damaging weather-related hazards, and in 2024, the warmest year on record, extreme flood events affected communities across five continents. Earth observation (EO) satellites provide critical, frequent coverage for mapping inundation, yet operational accuracy depends heavily on labeled datasets and model generalization. Recent Geospatial Foundation Models (GFMs), such as ESA-IBM's TerraMind, offer improved generalizability through large-scale self-supervised pretraining, but their performance on diverse global flood events remains poorly understood. We fine-tune TerraMind for flood extent mapping using FloodsNet, a harmonized multimodal dataset containing co-located Sentinel-1 (Synthetic Aperture Radar, SAR data) and Sentinel-2 (optical) imagery for 85 flood events worldwide. We tested four configurations (base vs. large models; frozen vs. unfrozen backbones) and compared against the TerraMind Sen1Floods11 example and a U-Net trained on both FloodsNet and Sen1Floods11. The base-unfrozen configuration provided the best balance of accuracy, precision, and recall at substantially lower computational cost than the large model. The large unfrozen model achieved the highest recall. Models trained on FloodsNet outperformed the Sen1Floods11-trained example in recall with similar overall accuracy. U-Net achieved higher recall than all GFM configurations, though with slightly lower accuracy and precision. Our results demonstrate that integrating multimodal optical and SAR data and fine-tuning a GFM can enhance near-real-time flood mapping. This study provides one of the first global-scale evaluations of a GFM for flood segmentation, highlighting both its potential and current limitations for climate adaptation and disaster resilience.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 71 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
17 of 71 references.
References · 17
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 583
- 2022Self-supervised Learning in Remote Sensing: A Reviewcited by 137
- 2022Contrastive Masked Autoencoders are Stronger Vision Learnerscited by 133
- 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 101
- 2017Machine Learning for the Geosciences: Challenges and Opportunitiescited by 53
- 2024Vision Foundation Models in Remote Sensing: A Surveycited by 52
- 2023SSL4EO-L: Datasets and Foundation Models for Landsat Imagerycited by 49
- 2024SpectralEarth: Training Hyperspectral Foundation Models at Scalecited by 42
5 more
- 2025Roll the dice & look before you leap: Going beyond the creative limits of next-token predictioncited by 28
- 2021Toward Foundation Models for Earth Monitoring: Proposal for a Climate Change Benchmarkcited by 22
- 2025Geospatial Foundation Models to Enable Progress on Sustainable Development Goalscited by 9
- 2024Generalization Enhancement Strategies to Enable Cross-year Cropland Mapping with Convolutional Neural Networks Trained Using Historical Samplescited by 6
- 2024When are Foundation Models Effective? Understanding the Suitability for Pixel-Level Classification Using Multispectral Imagerycited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.