GAIA: A Foundation Model for Operational Atmospheric Dynamics
Not on the map. Why?
Abstract (arXiv)
We introduce GAIA (Geospatial Artificial Intelligence for Atmospheres), a hybrid self-supervised geospatial foundation model that fuses Masked Autoencoders (MAE) with self-distillation with no labels (DINO) to generate semantically rich representations from global geostationary satellite imagery. Pre-trained on 15 years of globally-merged infrared observations (2001-2015), GAIA learns disentangled representations that capture atmospheric dynamics rather than trivial diurnal patterns, as evidenced by distributed principal component structure and temporal coherence analysis. We demonstrate robust reconstruction capabilities across varying data availability (30-95% masking), achieving superior gap-filling performance on real missing data patterns. When transferred to downstream tasks, GAIA consistently outperforms an MAE-only baseline: improving atmospheric river segmentation (F1: 0.58 vs 0.52), enhancing tropical cyclone detection (storm-level recall: 81% vs 75%, early detection: 29% vs 17%), and maintaining competitive precipitation estimation performance. Analysis reveals that GAIA's hybrid objectives encourage learning of spatially coherent, object-centric features distributed across multiple principal components rather than concentrated representations focused on reconstruction. This work demonstrates that combining complementary self-supervised objectives yields more transferable representations for diverse atmospheric modeling tasks. Model weights and code are available at: https://huggingface.co/bcg-usra-nasa-gaia/GAIA-v1.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 65 references that are in the map. First posted on arXiv 15 May 2025.
Builds on
21 of 65 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017Mask R-CNNcited by 7,277
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2023ClimaX: A foundation model for weather and climatecited by 337
- 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 275
- 2020Geography-Aware Self-Supervised Learningcited by 190
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
- 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
9 more
- 2018Tile2Vec: Unsupervised representation learning for spatially distributed datacited by 110
- 2023Siamese Masked Autoencoderscited by 76
- 2019Physics-guided Convolutional Neural Network (PhyCNN) for Data-driven Seismic Response Modelingcited by 40
- 2023Mixed Autoencoder for Self-supervised Visual Representation Learningcited by 38
- 2024Prithvi WxC: Foundation Model for Weather and Climatecited by 31
- 2018Exascale Deep Learning for Climate Analyticscited by 28
- 2018Missing Data Reconstruction in Remote Sensing image with a Unified Spatial-Temporal-Spectral Deep Convolutional Neural Networkcited by 26
- 2022RePre: Improving Self-Supervised Vision Transformer with Reconstructive Pre-trainingcited by 25
- 2015Unsupervised Deep Feature Extraction for Remote Sensing Image Classificationcited by 16
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Mechanistic Interpretability of Atmospheric Rivers in GraphCast
- 2026Earth-o1: A Grid-free Observation-native Atmospheric World Model
- 2026Beyond Linear Superposition: Discovering Climate Features in AI Weather Models with KAN-SAE
- 2026SAE-Xplainers: Rule-Based Feature Interpretation for Extreme Earth Events
- 2026Tracing the Unlabeled Storm: Cross-Variable Transfer in a Lagrangian Atmospheric JEPA Framework
- 2025GAIA: A Global, Multi-modal, Multi-scale Vision-Language Dataset for Remote Sensing Image Analysis
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilation
- 2026Benchmarking Generative Models for Weather Data Assimilation on Real Station Observations