NIVA: A Multimodal Foundation Model for Actionable Earth System Intelligence
Not on the map. Why?
Abstract (arXiv)
Recent advances in AI-driven weather and climate modeling have improved forecast skill while reducing computational cost. However, existing data-driven approaches are limited in their ability to model coupled Earth system dynamics, which is required for extending predictability beyond the ~2-week horizon. To address this, we introduce NIVA, a multimodal foundation model designed to learn unified representations across Earth system components. While the full framework targets atmosphere, ocean, ice, and land interactions, we focus here on a two-modality setting (ocean and atmosphere) as a controlled proof of concept to evaluate whether foundation models can learn coupled dynamics. Trained on large-scale Earth system simulations, NIVA learns physically meaningful cross-modal structure, providing a foundation for subseasonal-to-seasonal prediction. As initial validation, we show that NIVA captures key modes of climate variability through accurate prediction of major climate indices.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 45 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
12 of 45 references.
References · 12
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
- 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 646
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
- 2023AtmoRep: A stochastic model of atmosphere dynamics using large scale representation learningcited by 35
- 2026Auto-Augmentation Contrastive Learning for Wearable-based Human Activity Recognitioncited by 1
Built on by
Not cited yet.