mlsanityData to 7 Oct 2026

NIVA: A Multimodal Foundation Model for Actionable Earth System Intelligence

arXiv 2606.28546 ↗First posted 26 Jun 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in AI-driven weather and climate modeling have improved forecast skill while reducing computational cost. However, existing data-driven approaches are limited in their ability to model coupled Earth system dynamics, which is required for extending predictability beyond the ~2-week horizon. To address this, we introduce NIVA, a multimodal foundation model designed to learn unified representations across Earth system components. While the full framework targets atmosphere, ocean, ice, and land interactions, we focus here on a two-modality setting (ocean and atmosphere) as a controlled proof of concept to evaluate whether foundation models can learn coupled dynamics. Trained on large-scale Earth system simulations, NIVA learns physically meaningful cross-modal structure, providing a foundation for subseasonal-to-seasonal prediction. As initial validation, we show that NIVA captures key modes of climate variability through accurate prediction of major climate indices.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 45 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

12 of 45 references.

References · 12

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  6. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  7. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  8. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  9. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 646
  10. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
  11. 2023AtmoRep: A stochastic model of atmosphere dynamics using large scale representation learningcited by 35
  12. 2026Auto-Augmentation Contrastive Learning for Wearable-based Human Activity Recognitioncited by 1

Built on by

Not cited yet.