Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review
Not on the map. Why?
Abstract (arXiv)
Data Assimilation (DA) and Uncertainty quantification (UQ) are extensively used in analysing and reducing error propagation in high-dimensional spatial-temporal dynamics. Typical applications span from computational fluid dynamics (CFD) to geoscience and climate systems. Recently, much effort has been given in combining DA, UQ and machine learning (ML) techniques. These research efforts seek to address some critical challenges in high-dimensional dynamical systems, including but not limited to dynamical system identification, reduced order surrogate modelling, error covariance specification and model error correction. A large number of developed techniques and methodologies exhibit a broad applicability across numerous domains, resulting in the necessity for a comprehensive guide. This paper provides the first overview of the state-of-the-art researches in this interdisciplinary field, covering a wide range of applications. This review aims at ML scientists who attempt to apply DA and UQ techniques to improve the accuracy and the interpretability of their models, but also at DA and UQ experts who intend to integrate cutting-edge ML approaches to their systems. Therefore, this article has a special focus on how ML methods can overcome the existing limits of DA and UQ, and vice versa. Some exciting perspectives of this rapidly developing research field are also discussed.
Key facts. Cited by 74 papers in the map (data through 7 Oct 2026). Builds on 105 of its 331 references that are in the map. First posted on arXiv 18 Mar 2023.
Builds on
105 of 331 references.
References · 105
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017Neural Discrete Representation Learningcited by 4,650
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2018Neural Ordinary Differential Equationscited by 3,733
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2019A Comprehensive Survey on Transfer Learningcited by 1,154
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
38 more
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2016Learning to learn by gradient descent by gradient descentcited by 616
- 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
- 2021A Survey of Transformerscited by 399
- 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 336
- 2015LSTM: A Search Space Odysseycited by 315
- 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
- 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
- 2017Recent Trends in Deep Learning Based Natural Language Processingcited by 262
- 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
- 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
- 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 208
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
- 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
- 2022Uncertainty Quantification in Scientific Machine Learning: Methods, Metrics, and Comparisonscited by 169
- 2021Next Generation Reservoir Computingcited by 160
- 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 156
- 2018Deep learning to represent sub-grid processes in climate modelscited by 156
- 2018Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networkscited by 155
- 2019A review of domain adaptation without target labelscited by 154
- 2018Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flowscited by 147
- 2017Linearly-Recurrent Autoencoder Networks for Learning Dynamicscited by 142
- 2017Sparse identification of nonlinear dynamics for model predictive control in the low-data limitcited by 139
- 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 137
- 2021Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and controlcited by 134
- 2021KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamicscited by 128
- 2020Incorporating Symmetry into Deep Dynamics Models for Improved Generalizationcited by 123
- 2018Deep Fluids: A Generative Network for Parameterized Fluid Simulationscited by 121
- 2020Latent Video Transformercited by 106
- 2018Latent-space Physics: Towards Learning the Temporal Evolution of Fluid Flowcited by 97
- 2021PySINDy: A comprehensive Python package for robust sparse system identificationcited by 88
- 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 72
- 2019Quality of Uncertainty Quantification for Bayesian Neural Network Inferencecited by 58
50 most cited of 105 All 105 (JSON)
Built on by
Citing papers per year: 2023: 11; 2024: 32; 2025: 20; 2026: 11.
74 papers.
Sort:
By area:
- 2023Med-UniC: Unifying Cross-Lingual Medical Vision-Language Pre-Training by Diminishing Biascited by 57
- 2023Generative Text-Guided 3D Vision-Language Pretraining for Unified Medical Image Segmentationcited by 47
- 2024Continuum Attention for Neural Operatorscited by 39
- 2024FuXi Weather: A data-to-forecast machine learning system for global weathercited by 21
- 2023Towards an end-to-end artificial intelligence driven global weather forecasting systemcited by 20
- 2024Fuxi-DA: A Generalized Deep Learning Data Assimilation Framework for Assimilating Satellite Observationscited by 18
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilationcited by 17
- 2023Efficient deep data assimilation with sparse observations and time-varying sensorscited by 14
- 2024Spatially-Aware Diffusion Models with Cross-Attention for Global Field Reconstruction with Sparse Observationscited by 13
- 2024Uncertainty Quantification in Large Language Models Through Convex Hull Analysiscited by 12
- 2025Machine learning for modelling unstructured grid data in computational physics: a reviewcited by 12
- 2025Learning Enhanced Ensemble Filterscited by 11
38 more
- 2024Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNetcited by 10
- 2023Neural Koopman prior for data assimilationcited by 9
- 2024FNP: Fourier Neural Processes for Arbitrary-Resolution Data Assimilationcited by 8
- 2024Conformal Approach To Gaussian Process Surrogate Evaluation With Coverage Guaranteescited by 7
- 2024Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Methodcited by 7
- 2024State-observation augmented diffusion model for nonlinear assimilation with unknown dynamicscited by 7
- 2024Accurate deep learning-based filtering for chaotic dynamics by identifying instabilities without an ensemblecited by 7
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilationcited by 7
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilationcited by 6
- 2025Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Networkcited by 6
- 2024Joint Parameter and Parameterization Inference with Uncertainty Quantification through Differentiable Programmingcited by 5
- 2024TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functionscited by 5
- 2024Dynamical system prediction from sparse observations using deep neural networks with Voronoi tessellation and physics constraintcited by 5
- 2025Ensemble Kalman filter in latent space using a variational autoencoder paircited by 5
- 2025Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferencescited by 5
- 2023Physics-informed neural networks modeling for systems with moving immersed boundaries: application to an unsteady flow past a plunging foilcited by 4
- 2023OceanBench: The Sea Surface Height Editioncited by 4
- 2024Learning Semilinear Neural Operators : A Unified Recursive Framework For Prediction And Data Assimilationcited by 4
- 20244D-Var using Hessian approximation and backpropagation applied to automatically-differentiable numerical and machine learning modelscited by 4
- 2024AI for Extreme Event Modeling and Understanding: Methodologies and Challengescited by 3
- 2024Self-consistent Deep Geometric Learning for Heterogeneous Multi-source Spatial Point Data Predictioncited by 3
- 2024Generating Unseen Nonlinear Evolution in Sea Surface Temperature Using a Deep Learning-Based Latent Space Data Assimilation Frameworkcited by 3
- 2025Tensor-Var: Efficient Four-Dimensional Variational Data Assimilationcited by 3
- 2025Augmented Invertible Koopman Autoencoder for long-term time series forecastingcited by 3
- 2025Constrained Sensing and Reliable State Estimation with Shallow Recurrent Decoders on a TRIGA Mark II Reactorcited by 3
- 2025Bridging Idealized and Operational Models: An Explainable AI Framework for Earth System Emulatorscited by 3
- 2023Online machine-learning forecast uncertainty estimation for sequential data assimilationcited by 2
- 2023Physics-Informed Boundary Integral Networks (PIBI-Nets): A Data-Driven Approach for Solving Partial Differential Equationscited by 2
- 2024A local squared Wasserstein-2 method for efficient reconstruction of models with uncertaintycited by 2
- 2025Sequential learning based PINNs to overcome temporal domain complexities in unsteady flow past flapping wingscited by 2
- 2025RL-DAUNCE: Reinforcement Learning-Driven Data Assimilation with Uncertainty-Aware Constrained Ensemblescited by 2
- 2026Amortized Filtering and Smoothing with Conditional Normalizing Flowscited by 2
- 2024Enhancing Dynamical System Modeling through Interpretable Machine Learning Augmentations: A Case Study in Cathodic Electrophoretic Depositioncited by 1
- 2024Explainable Global Wildfire Prediction Models using Graph Neural Networkscited by 1
- 2024Uncertainty Quantification for Deep Learningcited by 1
- 2024The Deep Latent Space Particle Filter for Real-Time Data Assimilation with Uncertainty Quantificationcited by 1
- 2024Deep learning surrogate models of JULES-INFERNO for wildfire prediction on a global scalecited by 1
- 2024Comparison of Generative Learning Methods for Turbulence Surrogatescited by 1
50 most cited of 74 All 74 (JSON)
- 2026Variational Augmented Invertible Koopman Autoencoder for probabilistic time series forecasting29 Sep 2026
- 2026ADDA: a Modular Framework for Representing, Simulating and Assimilating Dynamics with End-to-end Differentiability24 Aug 2026
- 2026Gaussian process learning with flow map refinement for parameter estimation in dynamical systems23 Aug 2026
- 2026Variational Parameter Calibration with Physics-Aware Latent-Space Surrogates11 Aug 2026
- 2026A Graph Neural Network approach to zero-shot Digital Twins10 Jul 2026
- 2026Learning dynamical systems from noisy data with Weak-form Kernel Ridge Regression30 Jun 2026
- 2026OceanCBM: A Concept Bottleneck Model for Mechanistic Interpretability in Ocean Forecasting12 May 2026
- 2026Amortized Filtering and Smoothing with Conditional Normalizing Flows8 Apr 2026
- 2026Toward Artificial Intelligence Enabled Earth System Coupling26 Mar 2026
- 2026Spatiotemporal System Forecasting with Irregular Time Steps via Masked Autoencoder26 Mar 2026
- 2026Accurate and Efficient Hybrid-Ensemble Atmospheric Data Assimilation in Latent Space with Uncertainty Quantification4 Mar 2026
- 2025Balancing Accuracy and Speed: A Multi-Fidelity Ensemble Kalman Filter with a Machine Learning Surrogate Model13 Dec 2025
38 more
- 2025Forests of Uncertaint(r)ees: Using tree-based ensembles to estimate probability distributions of future conflict5 Dec 2025
- 2025A Weak Penalty Neural ODE for Learning Chaotic Dynamics from Noisy Time Series10 Nov 2025
- 2025Bridging Idealized and Operational Models: An Explainable AI Framework for Earth System Emulators14 Oct 2025
- 2025Constrained Sensing and Reliable State Estimation with Shallow Recurrent Decoders on a TRIGA Mark II Reactor14 Oct 2025
- 2025Uncertainty Quantification in Probabilistic Machine Learning Models: Theory, Methods, and Insights7 Sep 2025
- 2025PnP-DA: Towards Principled Plug-and-Play Integration of Variational Data Assimilation and Generative Models1 Aug 2025
- 2025Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Network11 Jul 2025
- 2025Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferences28 May 2025
- 2025RL-DAUNCE: Reinforcement Learning-Driven Data Assimilation with Uncertainty-Aware Constrained Ensembles8 May 2025
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilation25 Apr 2025
- 2025Learning Enhanced Ensemble Filters24 Apr 2025
- 2025Hybrid machine learning data assimilation for marine biogeochemistry7 Apr 2025
- 2025Simulation-informed deep learning for enhanced SWOT observations of fine-scale ocean dynamics27 Mar 2025
- 2025Sequential learning based PINNs to overcome temporal domain complexities in unsteady flow past flapping wings19 Mar 2025
- 2025Augmented Invertible Koopman Autoencoder for long-term time series forecasting17 Mar 2025
- 2025Probabilistic Forecasting for Dynamical Systems with Missing or Imperfect Data15 Mar 2025
- 2025Ensemble Kalman filter in latent space using a variational autoencoder pair18 Feb 2025
- 2025Machine learning for modelling unstructured grid data in computational physics: a review13 Feb 2025
- 2025Tensor-Var: Efficient Four-Dimensional Variational Data Assimilation23 Jan 2025
- 2024Long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systems18 Dec 2024
- 2024Generating Unseen Nonlinear Evolution in Sea Surface Temperature Using a Deep Learning-Based Latent Space Data Assimilation Framework18 Dec 2024
- 2024Performance Evaluation of Deep Learning-Based State Estimation: A Comparative Study of KalmanNet25 Nov 2024
- 2024Comparison of Generative Learning Methods for Turbulence Surrogates25 Nov 2024
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation26 Oct 2024
- 2024A competitive baseline for deep learning enhanced data assimilation using conditional Gaussian ensemble Kalman filtering22 Sep 2024
- 2024Dynamical system prediction from sparse observations using deep neural networks with Voronoi tessellation and physics constraint31 Aug 2024
- 2024TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functions30 Aug 2024
- 2024Deep learning surrogate models of JULES-INFERNO for wildfire prediction on a global scale30 Aug 2024
- 2024Spatially-Aware Diffusion Models with Cross-Attention for Global Field Reconstruction with Sparse Observations30 Aug 2024
- 2024FuXi Weather: A data-to-forecast machine learning system for global weather10 Aug 2024
- 2024Accurate deep learning-based filtering for chaotic dynamics by identifying instabilities without an ensemble8 Aug 2024
- 20244D-Var using Hessian approximation and backpropagation applied to automatically-differentiable numerical and machine learning models5 Aug 2024
- 2024State-observation augmented diffusion model for nonlinear assimilation with unknown dynamics31 Jul 2024
- 2024Self-consistent Deep Geometric Learning for Heterogeneous Multi-source Spatial Point Data Prediction30 Jun 2024
- 2024AI for Extreme Event Modeling and Understanding: Methodologies and Challenges28 Jun 2024
- 2024Uncertainty Quantification in Large Language Models Through Convex Hull Analysis28 Jun 2024
- 2024A local squared Wasserstein-2 method for efficient reconstruction of models with uncertainty10 Jun 2024
- 2024Continuum Attention for Neural Operators10 Jun 2024
50 newest of 74 All 74 (JSON)
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilationcited by 17
- 2024Spatially-Aware Diffusion Models with Cross-Attention for Global Field Reconstruction with Sparse Observationscited by 13
- 2024State-observation augmented diffusion model for nonlinear assimilation with unknown dynamicscited by 7
- 2025Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferencescited by 5
- 2024Comparison of Generative Learning Methods for Turbulence Surrogatescited by 1
- 2025Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferences28 May 2025
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilation25 Apr 2025
- 2024Comparison of Generative Learning Methods for Turbulence Surrogates25 Nov 2024
- 2024Spatially-Aware Diffusion Models with Cross-Attention for Global Field Reconstruction with Sparse Observations30 Aug 2024
- 2024State-observation augmented diffusion model for nonlinear assimilation with unknown dynamics31 Jul 2024
- 2024Continuum Attention for Neural Operatorscited by 39
- 2024FuXi Weather: A data-to-forecast machine learning system for global weathercited by 21
- 2023Towards an end-to-end artificial intelligence driven global weather forecasting systemcited by 20
- 2024Fuxi-DA: A Generalized Deep Learning Data Assimilation Framework for Assimilating Satellite Observationscited by 18
- 2023Efficient deep data assimilation with sparse observations and time-varying sensorscited by 14
- 2024Uncertainty Quantification in Large Language Models Through Convex Hull Analysiscited by 12
- 2025Machine learning for modelling unstructured grid data in computational physics: a reviewcited by 12
- 2025Learning Enhanced Ensemble Filterscited by 11
- 2024Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNetcited by 10
- 2023Neural Koopman prior for data assimilationcited by 9
- 2024FNP: Fourier Neural Processes for Arbitrary-Resolution Data Assimilationcited by 8
- 2024Conformal Approach To Gaussian Process Surrogate Evaluation With Coverage Guaranteescited by 7
12 most cited of 67 All 67 (JSON)
- 2026Variational Augmented Invertible Koopman Autoencoder for probabilistic time series forecasting29 Sep 2026
- 2026ADDA: a Modular Framework for Representing, Simulating and Assimilating Dynamics with End-to-end Differentiability24 Aug 2026
- 2026Gaussian process learning with flow map refinement for parameter estimation in dynamical systems23 Aug 2026
- 2026Variational Parameter Calibration with Physics-Aware Latent-Space Surrogates11 Aug 2026
- 2026A Graph Neural Network approach to zero-shot Digital Twins10 Jul 2026
- 2026Learning dynamical systems from noisy data with Weak-form Kernel Ridge Regression30 Jun 2026
- 2026OceanCBM: A Concept Bottleneck Model for Mechanistic Interpretability in Ocean Forecasting12 May 2026
- 2026Amortized Filtering and Smoothing with Conditional Normalizing Flows8 Apr 2026
- 2026Toward Artificial Intelligence Enabled Earth System Coupling26 Mar 2026
- 2026Spatiotemporal System Forecasting with Irregular Time Steps via Masked Autoencoder26 Mar 2026
- 2026Accurate and Efficient Hybrid-Ensemble Atmospheric Data Assimilation in Latent Space with Uncertainty Quantification4 Mar 2026
- 2025Balancing Accuracy and Speed: A Multi-Fidelity Ensemble Kalman Filter with a Machine Learning Surrogate Model13 Dec 2025
12 newest of 67 All 67 (JSON)