DiffDA: a Diffusion Model for Weather-scale Data Assimilation
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted states and sparse observations. Acknowledging the similarity between a weather forecast model and a denoising diffusion model dedicated to weather applications, we adapt the pretrained GraphCast neural network as the backbone of the diffusion model. Through experiments based on simulated observations from the ERA5 reanalysis dataset, our method can produce assimilated global atmospheric data consistent with observations at 0.25 deg (~30km) resolution globally. This marks the highest resolution achieved by ML data assimilation models. The experiments also show that the initial conditions assimilated from sparse observations (less than 0.96% of gridded data) and 48-hour forecast can be used for forecast models with a loss of lead time of at most 24 hours compared to initial conditions from state-of-the-art data assimilation in ERA5. This enables the application of the method to real-world applications, such as creating reanalysis datasets with autoregressive data assimilation.
Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 16 of its 28 references that are in the map. First posted on arXiv 11 Jan 2024.
Builds on
16 of 28 references.
Closest ancestors · 2
Same direction, newest first
- 2023Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling24 Sep
- 2023SEEDS: Emulation of Weather Forecast Ensembles with Diffusion Models24 Jun
Other references · 14
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
- 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 169
- 2023Score-based Data Assimilationcited by 91
- 2023Deep Learning for Day Forecasts from Sparse Observationscited by 70
2 more
Built on by
Citing papers per year: 2024: 20; 2025: 26; 2026: 13.
59 papers.
Sort:
By area:
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Datacited by 66
- 2024On conditional diffusion models for PDE simulationscited by 56
- 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modelingcited by 32
- 2024Deep Generative Data Assimilation in Multimodal Settingcited by 28
- 2024Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scalescited by 27
- 2024Generative Diffusion-based Downscaling for Climatecited by 25
- 2024Latent-EnSF: A Latent Ensemble Score Filter for High-Dimensional Data Assimilation with Sparse Observation Datacited by 20
- 2024Data driven weather forecasts trained and initialised directly from observationscited by 19
- 2024Fuxi-DA: A Generalized Deep Learning Data Assimilation Framework for Assimilating Satellite Observationscited by 18
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilationcited by 17
- 2024Spatially-Aware Diffusion Models with Cross-Attention for Global Field Reconstruction with Sparse Observationscited by 13
- 2025FlowDAS: A Stochastic Interpolant-based Framework for Data Assimilationcited by 13
38 more
- 2024WeatherGFM: Learning A Weather Generalist Foundation Model via In-context Learningcited by 12
- 2025Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex Dynamicscited by 12
- 2025Flow Matching for Efficient and Scalable Data Assimilationcited by 11
- 2024Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNetcited by 10
- 2024LD-EnSF: Synergizing Latent Dynamics with Ensemble Score Filters for Fast Data Assimilation with Sparse Observationscited by 10
- 2025PhyDA: Physics-Guided Diffusion Models for Data Assimilation in Atmospheric Systemscited by 9
- 2024FNP: Fourier Neural Processes for Arbitrary-Resolution Data Assimilationcited by 8
- 2024WeatherReal: A Benchmark Based on In-Situ Observations for Evaluating Weather Modelscited by 8
- 2024Exploring the design space of deep-learning-based weather forecasting systemscited by 8
- 2025Multimodal Atmospheric Super-Resolution With Deep Generative Modelscited by 8
- 2025Strictly Constrained Generative Modeling via Split Augmented Langevin Samplingcited by 6
- 2025LaDCast: A Latent Diffusion Model for Medium-Range Ensemble Weather Forecastingcited by 6
- 2024A Comprehensive Evaluation of Generative Models in Calorimeter Shower Simulationcited by 5
- 2025Kolmogorov Arnold Neural Interpolator for Downscaling and Correcting Meteorological Fields from In-Situ Observationscited by 5
- 2025Ensemble Kalman filter in latent space using a variational autoencoder paircited by 5
- 2025Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferencescited by 5
- 2025Training-Free Data Assimilation with GenCastcited by 5
- 2025Adversarial Observations in Weather Forecastingcited by 4
- 2024Benchmarking AI-based data assimilation to advance data-driven global weather forecastingcited by 3
- 2025Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Modelscited by 3
- 2025DAISI: Data Assimilation with Inverse Sampling using Stochastic Interpolantscited by 3
- 2024Aardvark weather: end-to-end data-driven weather forecastingcited by 2
- 2024VAE-Var: Variational-Autoencoder-Enhanced Variational Assimilationcited by 2
- 2026Amortized Filtering and Smoothing with Conditional Normalizing Flowscited by 2
- 2026Training-Free Bayesian Filtering with Generative Emulatorscited by 2
- 2025DAWP: A framework for global observation forecasting via Data Assimilation and Weather Prediction in satellite observation spacecited by 1
- 2025Sparse Local Implicit Image Function for sub-km Weather Downscalingcited by 1
- 2025DAMBench: A Multi-Modal Benchmark for Deep Learning-based Atmospheric Data Assimilationcited by 1
- 2025Advancing Ocean State Estimation with efficient and scalable AIcited by 1
- 2026Accurate and Efficient Hybrid-Ensemble Atmospheric Data Assimilation in Latent Space with Uncertainty Quantificationcited by 1
- 2026ADDA: a Modular Framework for Representing, Simulating and Assimilating Dynamics with End-to-end Differentiabilitycited by 1
- 2025Generative diffusion model surrogates for mechanistic agent-based biological modelscited by 0
- 2025Probabilistic Spatial Interpolation of Sparse Data using Diffusion Modelscited by 0
- 2025ReconMOST: Multi-Layer Sea Temperature Reconstruction with Observations-Guided Diffusioncited by 0
- 2025PnP-DA: Towards Principled Plug-and-Play Integration of Variational Data Assimilation and Generative Modelscited by 0
- 2025On the Effect of Neural Field Reparameterization for 4DVARcited by 0
- 2025Diffusion-Based, Data-Assimilation-Enabled Super-Resolution of Hub-height Windscited by 0
- 2025Control-Augmented Autoregressive Diffusion for Data Assimilationcited by 0
50 most cited of 59 All 59 (JSON)
- 2026EnJoi: Ensemble Joint Score Filter for Generative Data Assimilation28 Sep 2026
- 2026Generative Atmospheric Super-Resolution from Heterogeneous In Situ Observations through Composable Interfaces24 Sep 2026
- 2026ADDA: a Modular Framework for Representing, Simulating and Assimilating Dynamics with End-to-end Differentiability24 Aug 2026
- 2026Multimodal Spatiotemporal Atmospheric Data Assimilation with Latent Video Flow-matching5 Aug 2026
- 2026Generative Model Proposal based Particle Filtering for Data Assimilation1 Jul 2026
- 2026Training-Free Bayesian Filtering with Generative Emulators19 May 2026
- 2026WindINR: Latent-State INR for Fast Local Wind Query and Correction in Complex Terrain10 May 2026
- 2026Global Attention with Linear Complexity for Exascale Generative Data Assimilation in Earth System Prediction17 Apr 2026
- 2026Amortized Filtering and Smoothing with Conditional Normalizing Flows8 Apr 2026
- 2026FuXiWeather2: Learning accurate atmospheric state estimation for operational global weather forecasting16 Mar 2026
- 2026From AI Weather Prediction to Infrastructure Resilience: A Real-Time Correction-Downscaling Framework for Tropical Cyclone Impact Forecasting13 Mar 2026
- 2026Accurate and Efficient Hybrid-Ensemble Atmospheric Data Assimilation in Latent Space with Uncertainty Quantification4 Mar 2026
38 more
- 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matching6 Feb 2026
- 2025DAISI: Data Assimilation with Inverse Sampling using Stochastic Interpolants29 Nov 2025
- 2025Advancing Ocean State Estimation with efficient and scalable AI8 Nov 2025
- 2025DAMBench: A Multi-Modal Benchmark for Deep Learning-based Atmospheric Data Assimilation3 Nov 2025
- 2025Sparse Local Implicit Image Function for sub-km Weather Downscaling23 Oct 2025
- 2025DAWP: A framework for global observation forecasting via Data Assimilation and Weather Prediction in satellite observation space13 Oct 2025
- 2025Control-Augmented Autoregressive Diffusion for Data Assimilation8 Oct 2025
- 2025Diffusion-Based, Data-Assimilation-Enabled Super-Resolution of Hub-height Winds3 Oct 2025
- 2025Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models26 Sep 2025
- 2025On the Effect of Neural Field Reparameterization for 4DVAR26 Sep 2025
- 2025Training-Free Data Assimilation with GenCast23 Sep 2025
- 2025Flow Matching for Efficient and Scalable Data Assimilation18 Aug 2025
- 2025PnP-DA: Towards Principled Plug-and-Play Integration of Variational Data Assimilation and Generative Models1 Aug 2025
- 2025Multimodal Atmospheric Super-Resolution With Deep Generative Models28 Jun 2025
- 2025Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex Dynamics24 Jun 2025
- 2025ReconMOST: Multi-Layer Sea Temperature Reconstruction with Observations-Guided Diffusion12 Jun 2025
- 2025LaDCast: A Latent Diffusion Model for Medium-Range Ensemble Weather Forecasting10 Jun 2025
- 2025Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferences28 May 2025
- 2025Probabilistic Spatial Interpolation of Sparse Data using Diffusion Models26 May 2025
- 2025Strictly Constrained Generative Modeling via Split Augmented Langevin Sampling23 May 2025
- 2025PhyDA: Physics-Guided Diffusion Models for Data Assimilation in Atmospheric Systems19 May 2025
- 2025Generative diffusion model surrogates for mechanistic agent-based biological models1 May 2025
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilation25 Apr 2025
- 2025Adversarial Observations in Weather Forecasting22 Apr 2025
- 2025Ensemble Kalman filter in latent space using a variational autoencoder pair18 Feb 2025
- 2025Kolmogorov Arnold Neural Interpolator for Downscaling and Correcting Meteorological Fields from In-Situ Observations24 Jan 2025
- 2025FlowDAS: A Stochastic Interpolant-based Framework for Data Assimilation13 Jan 2025
- 2024LD-EnSF: Synergizing Latent Dynamics with Ensemble Score Filters for Fast Data Assimilation with Sparse Observations28 Nov 2024
- 2024WeatherGFM: Learning A Weather Generalist Foundation Model via In-context Learning8 Nov 2024
- 2024On conditional diffusion models for PDE simulations21 Oct 2024
- 2024Exploring the design space of deep-learning-based weather forecasting systems9 Oct 2024
- 2024WeatherReal: A Benchmark Based on In-Situ Observations for Evaluating Weather Models14 Sep 2024
- 2024Spatially-Aware Diffusion Models with Cross-Attention for Global Field Reconstruction with Sparse Observations30 Aug 2024
- 2024Latent-EnSF: A Latent Ensemble Score Filter for High-Dimensional Data Assimilation with Sparse Observation Data29 Aug 2024
- 2024Benchmarking AI-based data assimilation to advance data-driven global weather forecasting21 Aug 2024
- 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modeling20 Aug 2024
- 2024Data driven weather forecasts trained and initialised directly from observations22 Jul 2024
- 2024Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scales19 Jun 2024
50 newest of 59 All 59 (JSON)
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Datacited by 66
- 2024On conditional diffusion models for PDE simulationscited by 56
- 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modelingcited by 32
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilationcited by 17
- 2024Spatially-Aware Diffusion Models with Cross-Attention for Global Field Reconstruction with Sparse Observationscited by 13
- 2025FlowDAS: A Stochastic Interpolant-based Framework for Data Assimilationcited by 13
- 2025Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex Dynamicscited by 12
- 2025Flow Matching for Efficient and Scalable Data Assimilationcited by 11
- 2025PhyDA: Physics-Guided Diffusion Models for Data Assimilation in Atmospheric Systemscited by 9
- 2025Multimodal Atmospheric Super-Resolution With Deep Generative Modelscited by 8
- 2025LaDCast: A Latent Diffusion Model for Medium-Range Ensemble Weather Forecastingcited by 6
- 2025Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferencescited by 5
12 most cited of 21 All 21 (JSON)
- 2026EnJoi: Ensemble Joint Score Filter for Generative Data Assimilation28 Sep 2026
- 2026Generative Atmospheric Super-Resolution from Heterogeneous In Situ Observations through Composable Interfaces24 Sep 2026
- 2026Multimodal Spatiotemporal Atmospheric Data Assimilation with Latent Video Flow-matching5 Aug 2026
- 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matching6 Feb 2026
- 2025Control-Augmented Autoregressive Diffusion for Data Assimilation8 Oct 2025
- 2025Diffusion-Based, Data-Assimilation-Enabled Super-Resolution of Hub-height Winds3 Oct 2025
- 2025Flow Matching for Efficient and Scalable Data Assimilation18 Aug 2025
- 2025Multimodal Atmospheric Super-Resolution With Deep Generative Models28 Jun 2025
- 2025Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex Dynamics24 Jun 2025
- 2025ReconMOST: Multi-Layer Sea Temperature Reconstruction with Observations-Guided Diffusion12 Jun 2025
- 2025LaDCast: A Latent Diffusion Model for Medium-Range Ensemble Weather Forecasting10 Jun 2025
- 2025Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferences28 May 2025
12 newest of 21 All 21 (JSON)
- 2024Deep Generative Data Assimilation in Multimodal Settingcited by 28
- 2024Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scalescited by 27
- 2024Generative Diffusion-based Downscaling for Climatecited by 25
- 2024Latent-EnSF: A Latent Ensemble Score Filter for High-Dimensional Data Assimilation with Sparse Observation Datacited by 20
- 2024Data driven weather forecasts trained and initialised directly from observationscited by 19
- 2024Fuxi-DA: A Generalized Deep Learning Data Assimilation Framework for Assimilating Satellite Observationscited by 18
- 2024WeatherGFM: Learning A Weather Generalist Foundation Model via In-context Learningcited by 12
- 2024Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNetcited by 10
- 2024LD-EnSF: Synergizing Latent Dynamics with Ensemble Score Filters for Fast Data Assimilation with Sparse Observationscited by 10
- 2024FNP: Fourier Neural Processes for Arbitrary-Resolution Data Assimilationcited by 8
- 2024WeatherReal: A Benchmark Based on In-Situ Observations for Evaluating Weather Modelscited by 8
- 2024Exploring the design space of deep-learning-based weather forecasting systemscited by 8
12 most cited of 38 All 38 (JSON)
- 2026ADDA: a Modular Framework for Representing, Simulating and Assimilating Dynamics with End-to-end Differentiability24 Aug 2026
- 2026Generative Model Proposal based Particle Filtering for Data Assimilation1 Jul 2026
- 2026Training-Free Bayesian Filtering with Generative Emulators19 May 2026
- 2026WindINR: Latent-State INR for Fast Local Wind Query and Correction in Complex Terrain10 May 2026
- 2026Global Attention with Linear Complexity for Exascale Generative Data Assimilation in Earth System Prediction17 Apr 2026
- 2026Amortized Filtering and Smoothing with Conditional Normalizing Flows8 Apr 2026
- 2026FuXiWeather2: Learning accurate atmospheric state estimation for operational global weather forecasting16 Mar 2026
- 2026From AI Weather Prediction to Infrastructure Resilience: A Real-Time Correction-Downscaling Framework for Tropical Cyclone Impact Forecasting13 Mar 2026
- 2026Accurate and Efficient Hybrid-Ensemble Atmospheric Data Assimilation in Latent Space with Uncertainty Quantification4 Mar 2026
- 2025DAISI: Data Assimilation with Inverse Sampling using Stochastic Interpolants29 Nov 2025
- 2025Advancing Ocean State Estimation with efficient and scalable AI8 Nov 2025
- 2025DAMBench: A Multi-Modal Benchmark for Deep Learning-based Atmospheric Data Assimilation3 Nov 2025
12 newest of 38 All 38 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024DiffObs: Generative Diffusion for Global Forecasting of Satellite Observations
- 2024Enhancing Weather Predictions: Super-Resolution via Deep Diffusion Models
- 2026Closed-form conditional diffusion models for data assimilation
- 2025Data-Efficient Ensemble Weather Forecasting with Diffusion Models
- 2025DEF: Diffusion-augmented Ensemble Forecasting
- 2026PuYun-LDM: A Latent Diffusion Model for High-Resolution Ensemble Weather Forecasts
- 2026DAWIS: Data Assimilation with Windowed Inverse Sampling via Multitask Interpolants
- 2026LD-EnFF: Latent-Dynamics Ensemble Flow Filtering for Data Assimilation with Sparse Observations