PnP-DA: Towards Principled Plug-and-Play Integration of Variational Data Assimilation and Generative Models
Not on the map. Why?
Abstract (arXiv)
Earth system modeling presents a fundamental challenge in scientific computing: capturing complex, multiscale nonlinear dynamics in computationally efficient models while minimizing forecast errors caused by necessary simplifications. Even the most powerful AI- or physics-based forecast system suffer from gradual error accumulation. Data assimilation (DA) aims to mitigate these errors by optimally blending (noisy) observations with prior model forecasts, but conventional variational methods often assume Gaussian error statistics that fail to capture the true, non-Gaussian behavior of chaotic dynamical systems. We propose PnP-DA, a Plug-and-Play algorithm that alternates (1) a lightweight, gradient-based analysis update (using a Mahalanobis-distance misfit on new observations) with (2) a single forward pass through a pretrained generative prior conditioned on the background forecast via a conditional Wasserstein coupling. This strategy relaxes restrictive statistical assumptions and leverages rich historical data without requiring an explicit regularization functional, and it also avoids the need to backpropagate gradients through the complex neural network that encodes the prior during assimilation cycles. Experiments on standard chaotic testbeds demonstrate that this strategy consistently reduces forecast errors across a range of observation sparsities and noise levels, outperforming classical variational methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 47 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
20 of 47 references.
References · 20
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023A Variational Perspective on Solving Inverse Problems with Diffusion Modelscited by 222
- 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 198
- 2024Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priorscited by 97
- 2024PnP-Flow: Plug-and-Play Image Restoration with Flow Matchingcited by 97
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 75
- 2024DiffDA: a Diffusion Model for Weather-scale Data Assimilationcited by 61
- 2023An Ensemble Score Filter for Tracking High-Dimensional Nonlinear Dynamical Systemscited by 38
- 2024Gradient-Free Generation for Hard-Constrained Systemscited by 38
- 2024Conditional Wasserstein Distances with Applications in Bayesian OT Flow Matchingcited by 36
- 2024Deep Generative Data Assimilation in Multimodal Settingcited by 29
- 2024Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scalescited by 27
8 more
- 2024Fuxi-DA: A Generalized Deep Learning Data Assimilation Framework for Assimilating Satellite Observationscited by 18
- 2022Online model error correction with neural networks in the incremental 4D-Var frameworkcited by 14
- 20244D-Var using Hessian approximation and backpropagation applied to automatically-differentiable numerical and machine learning modelscited by 6
- 2025Strictly Constrained Generative Modeling via Split Augmented Langevin Samplingcited by 6
- 2024Joint Parameter and Parameterization Inference with Uncertainty Quantification through Differentiable Programmingcited by 5
- 2025Ensemble Kalman filter in latent space using a variational autoencoder paircited by 5
- 2024Neural Incremental Data Assimilationcited by 3
- 2024VAE-Var: Variational-Autoencoder-Enhanced Variational Assimilationcited by 2
Built on by
Not cited yet.