WIND: Weather Inverse Diffusion for Zero-Shot Atmospheric Modeling
Not on the map. Why?
Abstract (arXiv)
Deep learning has revolutionized weather forecasting, but many challenges remain, including climate modeling. Moreover, the current landscape remains fragmented: highly specialized models are typically trained individually for distinct tasks. To unify this landscape, we introduce WIND, a single pre-trained foundation model capable of replacing specialized baselines across a vast array of tasks. Crucially, in contrast to previous atmospheric foundation models, we achieve this without any task-specific fine-tuning. To learn a robust, task-agnostic prior of the atmosphere, we pre-train WIND with a self-supervised video reconstruction objective, utilizing an unconditional video diffusion model to iteratively reconstruct atmospheric dynamics from a noisy state. At inference, we frame diverse domain-specific problems strictly as inverse problems and solve them via posterior sampling. This unified approach allows us to tackle highly relevant weather and climate problems, including probabilistic forecasting, spatial and temporal downscaling, reconstruction of spatial fields from sparse observations and enforcing global dry air mass conservation. We further demonstrate how WIND can be applied to explore extreme weather events under prescribed out-of-distribution thermodynamic perturbations. By combining generative video modeling with inverse problem solving, WIND offers a computationally efficient alternative for AI-based atmospheric modeling.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 49 of its 82 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
49 of 82 references.
References · 49
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2022Video Diffusion Modelscited by 2,305
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
37 more
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023Simple diffusion: End-to-end diffusion for high resolution imagescited by 422
- 2023ClimaX: A foundation model for weather and climatecited by 337
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 304
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
- 2023Neural General Circulation Models for Weather and Climatecited by 239
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 236
- 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 177
- 2025History-Guided Video Diffusioncited by 171
- 2024Rolling Diffusion Modelscited by 104
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 87
- 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 82
- 2024Simpler Diffusion (SiD2): 1.5 FID on ImageNet512 with pixel-space diffusioncited by 75
- 2024Learning Diffusion Priors from Observations by Expectation Maximizationcited by 61
- 2024ACE2: Accurately learning subseasonal to decadal atmospheric variability and forced responsescited by 54
- 2025Is Noise Conditioning Necessary for Denoising Generative Models?cited by 44
- 2023AtmoRep: A stochastic model of atmosphere dynamics using large scale representation learningcited by 40
- 2026Meta Flow Maps enable scalable reward alignmentcited by 37
- 2025Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learningcited by 36
- 2023Debias Coarsely, Sample Conditionally: Statistical Downscaling through Optimal Transport and Probabilistic Diffusion Modelscited by 33
- 2022Hard-Constrained Deep Learning for Climate Downscalingcited by 32
- 2023Challenges of learning multi-scale dynamics with AI weather models: Implications for stability and one solutioncited by 31
- 2023SEEDS: Emulation of Weather Forecast Ensembles with Diffusion Modelscited by 28
- 2025Fixing the Double Penalty in Data-Driven Weather Forecasting Through a Modified Spherical Harmonic Loss Functioncited by 28
- 2024Fast, Scale-Adaptive, and Uncertainty-Aware Downscaling of Earth System Model Fields with Generative Machine Learningcited by 27
- 2024Can AI weather models predict out-of-distribution gray swan tropical cyclones?cited by 26
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilationcited by 20
- 2024Conditional diffusion models for downscaling and bias correction of Earth system model precipitationcited by 17
- 2024DiffESM: Conditional Emulation of Temperature and Precipitation in Earth System Models with 3D Diffusion Modelscited by 15
- 2024A Generative Framework for Probabilistic, Spatiotemporally Coherent Downscaling of Climate Simulationcited by 12
- 2024Robustness of AI-based weather forecasts in a changing climatecited by 11
- 2024[MASK] is All You Needcited by 11
- 2025Guiding diffusion models to reconstruct flow fields from sparse datacited by 11
- 2025Generative assimilation and prediction for weather and climatecited by 8
- 2025LaM-SLidE: Latent Space Modeling of Spatial Dynamical Systems via Linked Entitiescited by 6
- 2025Generating realistic global precipitation fields from modelled atmospheric circulationcited by 2
- 2025Conditional Diffusion Models for Global Precipitation Map Inpaintingcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Composite Classifier-Free Guidance for Multi-Modal Conditioning in Wind Dynamics Super-Resolution
- 2024Enhancing Weather Predictions: Super-Resolution via Deep Diffusion Models
- 2024Ensemble-based, large-eddy reconstruction of wind turbine inflow in a near-stationary atmospheric boundary layer through generative artificial intelligence
- 2025Diffusion-Based, Data-Assimilation-Enabled Super-Resolution of Hub-height Winds
- 2026Downscaling weather forecasts from Low- to High-Resolution with Diffusion Models
- 2023Ensemble flow reconstruction in the atmospheric boundary layer from spatially limited measurements through latent diffusion models
- 2026Apeliotes: A Diffusion-Based Modeling Framework for km-scale Multi-Level Atmospheric Fields
- 2026Physics-Informed Diffusion Model for Generating Synthetic Extreme Rare Weather Events Data