mlsanityData to 7 Oct 2026

Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review

arXiv 2303.10462 ↗First posted 18 Mar 2023cs.LGcited by 74

Not on the map. Why?

Abstract (arXiv)

Data Assimilation (DA) and Uncertainty quantification (UQ) are extensively used in analysing and reducing error propagation in high-dimensional spatial-temporal dynamics. Typical applications span from computational fluid dynamics (CFD) to geoscience and climate systems. Recently, much effort has been given in combining DA, UQ and machine learning (ML) techniques. These research efforts seek to address some critical challenges in high-dimensional dynamical systems, including but not limited to dynamical system identification, reduced order surrogate modelling, error covariance specification and model error correction. A large number of developed techniques and methodologies exhibit a broad applicability across numerous domains, resulting in the necessity for a comprehensive guide. This paper provides the first overview of the state-of-the-art researches in this interdisciplinary field, covering a wide range of applications. This review aims at ML scientists who attempt to apply DA and UQ techniques to improve the accuracy and the interpretability of their models, but also at DA and UQ experts who intend to integrate cutting-edge ML approaches to their systems. Therefore, this article has a special focus on how ML methods can overcome the existing limits of DA and UQ, and vice versa. Some exciting perspectives of this rapidly developing research field are also discussed.

Key facts. Cited by 74 papers in the map (data through 7 Oct 2026). Builds on 105 of its 331 references that are in the map. First posted on arXiv 18 Mar 2023.

Builds on

105 of 331 references.

References · 105

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  6. 2013Auto-Encoding Variational Bayescited by 3,980
  7. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  8. 2018Neural Ordinary Differential Equationscited by 3,733
  9. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
  10. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  11. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
  12. 2020Meta-Learning in Neural Networks: A Surveycited by 944
38 more
  1. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
  2. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  3. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  4. 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
  5. 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
  6. 2016Learning to learn by gradient descent by gradient descentcited by 616
  7. 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
  8. 2021A Survey of Transformerscited by 399
  9. 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 336
  10. 2015LSTM: A Search Space Odysseycited by 315
  11. 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
  12. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
  13. 2017Recent Trends in Deep Learning Based Natural Language Processingcited by 262
  14. 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
  15. 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
  16. 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 208
  17. 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
  18. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  19. 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
  20. 2022Uncertainty Quantification in Scientific Machine Learning: Methods, Metrics, and Comparisonscited by 169
  21. 2021Next Generation Reservoir Computingcited by 160
  22. 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 156
  23. 2018Deep learning to represent sub-grid processes in climate modelscited by 156
  24. 2018Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networkscited by 155
  25. 2019A review of domain adaptation without target labelscited by 154
  26. 2018Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flowscited by 147
  27. 2017Linearly-Recurrent Autoencoder Networks for Learning Dynamicscited by 142
  28. 2017Sparse identification of nonlinear dynamics for model predictive control in the low-data limitcited by 139
  29. 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 137
  30. 2021Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and controlcited by 134
  31. 2021KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamicscited by 128
  32. 2020Incorporating Symmetry into Deep Dynamics Models for Improved Generalizationcited by 123
  33. 2018Deep Fluids: A Generative Network for Parameterized Fluid Simulationscited by 121
  34. 2020Latent Video Transformercited by 106
  35. 2018Latent-space Physics: Towards Learning the Temporal Evolution of Fluid Flowcited by 97
  36. 2021PySINDy: A comprehensive Python package for robust sparse system identificationcited by 88
  37. 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 72
  38. 2019Quality of Uncertainty Quantification for Bayesian Neural Network Inferencecited by 58

50 most cited of 105 All 105 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 11; 2024: 32; 2025: 20; 2026: 11.

74 papers.

Sort:

By area:

  1. 2023Med-UniC: Unifying Cross-Lingual Medical Vision-Language Pre-Training by Diminishing Biascited by 57
  2. 2023Generative Text-Guided 3D Vision-Language Pretraining for Unified Medical Image Segmentationcited by 47
  3. 2024Continuum Attention for Neural Operatorscited by 39
  4. 2024FuXi Weather: A data-to-forecast machine learning system for global weathercited by 21
  5. 2023Towards an end-to-end artificial intelligence driven global weather forecasting systemcited by 20
  6. 2024Fuxi-DA: A Generalized Deep Learning Data Assimilation Framework for Assimilating Satellite Observationscited by 18
  7. 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilationcited by 17
  8. 2023Efficient deep data assimilation with sparse observations and time-varying sensorscited by 14
  9. 2024Spatially-Aware Diffusion Models with Cross-Attention for Global Field Reconstruction with Sparse Observationscited by 13
  10. 2024Uncertainty Quantification in Large Language Models Through Convex Hull Analysiscited by 12
  11. 2025Machine learning for modelling unstructured grid data in computational physics: a reviewcited by 12
  12. 2025Learning Enhanced Ensemble Filterscited by 11
38 more
  1. 2024Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNetcited by 10
  2. 2023Neural Koopman prior for data assimilationcited by 9
  3. 2024FNP: Fourier Neural Processes for Arbitrary-Resolution Data Assimilationcited by 8
  4. 2024Conformal Approach To Gaussian Process Surrogate Evaluation With Coverage Guaranteescited by 7
  5. 2024Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Methodcited by 7
  6. 2024State-observation augmented diffusion model for nonlinear assimilation with unknown dynamicscited by 7
  7. 2024Accurate deep learning-based filtering for chaotic dynamics by identifying instabilities without an ensemblecited by 7
  8. 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilationcited by 7
  9. 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilationcited by 6
  10. 2025Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Networkcited by 6
  11. 2024Joint Parameter and Parameterization Inference with Uncertainty Quantification through Differentiable Programmingcited by 5
  12. 2024TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functionscited by 5
  13. 2024Dynamical system prediction from sparse observations using deep neural networks with Voronoi tessellation and physics constraintcited by 5
  14. 2025Ensemble Kalman filter in latent space using a variational autoencoder paircited by 5
  15. 2025Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferencescited by 5
  16. 2023Physics-informed neural networks modeling for systems with moving immersed boundaries: application to an unsteady flow past a plunging foilcited by 4
  17. 2023OceanBench: The Sea Surface Height Editioncited by 4
  18. 2024Learning Semilinear Neural Operators : A Unified Recursive Framework For Prediction And Data Assimilationcited by 4
  19. 20244D-Var using Hessian approximation and backpropagation applied to automatically-differentiable numerical and machine learning modelscited by 4
  20. 2024AI for Extreme Event Modeling and Understanding: Methodologies and Challengescited by 3
  21. 2024Self-consistent Deep Geometric Learning for Heterogeneous Multi-source Spatial Point Data Predictioncited by 3
  22. 2024Generating Unseen Nonlinear Evolution in Sea Surface Temperature Using a Deep Learning-Based Latent Space Data Assimilation Frameworkcited by 3
  23. 2025Tensor-Var: Efficient Four-Dimensional Variational Data Assimilationcited by 3
  24. 2025Augmented Invertible Koopman Autoencoder for long-term time series forecastingcited by 3
  25. 2025Constrained Sensing and Reliable State Estimation with Shallow Recurrent Decoders on a TRIGA Mark II Reactorcited by 3
  26. 2025Bridging Idealized and Operational Models: An Explainable AI Framework for Earth System Emulatorscited by 3
  27. 2023Online machine-learning forecast uncertainty estimation for sequential data assimilationcited by 2
  28. 2023Physics-Informed Boundary Integral Networks (PIBI-Nets): A Data-Driven Approach for Solving Partial Differential Equationscited by 2
  29. 2024A local squared Wasserstein-2 method for efficient reconstruction of models with uncertaintycited by 2
  30. 2025Sequential learning based PINNs to overcome temporal domain complexities in unsteady flow past flapping wingscited by 2
  31. 2025RL-DAUNCE: Reinforcement Learning-Driven Data Assimilation with Uncertainty-Aware Constrained Ensemblescited by 2
  32. 2026Amortized Filtering and Smoothing with Conditional Normalizing Flowscited by 2
  33. 2024Enhancing Dynamical System Modeling through Interpretable Machine Learning Augmentations: A Case Study in Cathodic Electrophoretic Depositioncited by 1
  34. 2024Explainable Global Wildfire Prediction Models using Graph Neural Networkscited by 1
  35. 2024Uncertainty Quantification for Deep Learningcited by 1
  36. 2024The Deep Latent Space Particle Filter for Real-Time Data Assimilation with Uncertainty Quantificationcited by 1
  37. 2024Deep learning surrogate models of JULES-INFERNO for wildfire prediction on a global scalecited by 1
  38. 2024Comparison of Generative Learning Methods for Turbulence Surrogatescited by 1

50 most cited of 74 All 74 (JSON)