Using machine learning to correct model error in data assimilation and forecast applications
Not on the map. Why?
Abstract (arXiv)
The idea of using machine learning (ML) methods to reconstruct the dynamics of a system is the topic of recent studies in the geosciences, in which the key output is a surrogate model meant to emulate the dynamical model. In order to treat sparse and noisy observations in a rigorous way, ML can be combined to data assimilation (DA). This yields a class of iterative methods in which, at each iteration a DA step assimilates the observations, and alternates with a ML step to learn the underlying dynamics of the DA analysis. In this article, we propose to use this method to correct the error of an existent, knowledge-based model. In practice, the resulting surrogate model is an hybrid model between the original (knowledge-based) model and the ML model. We demonstrate numerically the feasibility of the method using a two-layer, two-dimensional quasi-geostrophic channel model. Model error is introduced by the means of perturbed parameters. The DA step is performed using the strong-constraint 4D-Var algorithm, while the ML step is performed using deep learning tools. The ML models are able to learn a substantial part of the model error and the resulting hybrid surrogate models produce better short- to mid-range forecasts. Furthermore, using the hybrid surrogate models for DA yields a significantly better analysis than using the original model.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 6; 2023: 9; 2024: 8; 2025: 8; 2026: 3.
40 papers.
Sort:
By area:
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 37
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2021Variational Data Assimilation with a Learned Inverse Observation Operatorcited by 28
- 2022Generalised Latent Assimilation in Heterogeneous Reduced Spaces with Machine Learning Surrogate Modelscited by 24
- 2023FengWu-4DVar: Coupling the Data-driven Weather Forecasting Model with 4D Variational Assimilationcited by 22
- 2022Discrepancy Modeling Framework: Learning missing physics, modeling systematic residuals, and disambiguating between deterministic and random effectscited by 15
- 2021A comparison of combined data assimilation and machine learning methods for offline and online model error correctioncited by 13
- 2022Online model error correction with neural networks in the incremental 4D-Var frameworkcited by 13
- 2023Reduced-Order Autodifferentiable Ensemble Kalman Filterscited by 12
- 2023Neural Koopman prior for data assimilationcited by 9
- 2023Latent assimilation with implicit neural representations for unknown dynamicscited by 8
28 more
- 2021State, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamicscited by 6
- 2021Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test casecited by 6
- 2023Gradient-free online learning of subgrid-scale dynamics with neural emulatorscited by 5
- 2024Data Assimilation in Chaotic Systems Using Deep Reinforcement Learningcited by 5
- 2025Ensemble Kalman filter in latent space using a variational autoencoder paircited by 5
- 2025Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferencescited by 5
- 2021Combining data assimilation and machine learning to estimate parameters of a convective-scale modelcited by 4
- 2023Machine-learning parameter tracking with partial state observationcited by 4
- 2024Learning Semilinear Neural Operators : A Unified Recursive Framework For Prediction And Data Assimilationcited by 4
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontierscited by 4
- 2022Learning 4DVAR inversion directly from observationscited by 3
- 2023Online machine-learning forecast uncertainty estimation for sequential data assimilationcited by 2
- 2024Decomposing weather forecasting into advection and convection with neural networkscited by 2
- 2024Ensemble Transport Filter via Optimized Maximum Mean Discrepancycited by 2
- 2024Combined Optimization of Dynamics and Assimilation with End-to-End Learning on Sparse Observationscited by 2
- 2025RL-DAUNCE: Reinforcement Learning-Driven Data Assimilation with Uncertainty-Aware Constrained Ensemblescited by 2
- 2024Development of an offline and online hybrid model for the Integrated Forecasting Systemcited by 1
- 2024Long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systemscited by 1
- 2025Uncertainty-aware data assimilation through variational inferencecited by 1
- 2025Integrating Score-Based Diffusion Models with Machine Learning-Enhanced Localization for Advanced Data Assimilation in Geological Carbon Storagecited by 1
- 2025Advancing Ocean State Estimation with efficient and scalable AIcited by 1
- 2026Operator Learning for Smoothing and Forecastingcited by 1
- 2026Auto-differentiable data assimilation: Co-learning of states, dynamics, and filtering algorithmscited by 1
- 2022Composing a surrogate observation operator for sequential data assimilationcited by 0
- 2023Improving Surrogate Model Robustness to Perturbations for Dynamical Systems Through Machine Learning and Data Assimilationcited by 0
- 2024U-Net Kalman Filter (UNetKF): An Example of Machine Learning-assisted Ensemble Data Assimilationcited by 0
- 2025Hybrid twinning using PBDW and DeepONet for the effective state estimation and prediction on partially known systemscited by 0
- 2026Structured Neural Modeling of Daily Arctic Sea-Ice Concentration Evolution: Physical-Trajectory-Driven Learning and Forecast-Domain Adaptationcited by 0
- 2026Structured Neural Modeling of Daily Arctic Sea-Ice Concentration Evolution: Physical-Trajectory-Driven Learning and Forecast-Domain Adaptation22 Aug 2026
- 2026Auto-differentiable data assimilation: Co-learning of states, dynamics, and filtering algorithms21 Mar 2026
- 2026Operator Learning for Smoothing and Forecasting20 Mar 2026
- 2025Hybrid twinning using PBDW and DeepONet for the effective state estimation and prediction on partially known systems3 Dec 2025
- 2025Advancing Ocean State Estimation with efficient and scalable AI8 Nov 2025
- 2025Integrating Score-Based Diffusion Models with Machine Learning-Enhanced Localization for Advanced Data Assimilation in Geological Carbon Storage7 Nov 2025
- 2025Uncertainty-aware data assimilation through variational inference20 Oct 2025
- 2025Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferences28 May 2025
- 2025RL-DAUNCE: Reinforcement Learning-Driven Data Assimilation with Uncertainty-Aware Constrained Ensembles8 May 2025
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontiers5 Apr 2025
- 2025Ensemble Kalman filter in latent space using a variational autoencoder pair18 Feb 2025
- 2024Long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systems18 Dec 2024
28 more
- 2024Combined Optimization of Dynamics and Assimilation with End-to-End Learning on Sparse Observations11 Sep 2024
- 2024Ensemble Transport Filter via Optimized Maximum Mean Discrepancy16 Jul 2024
- 2024Decomposing weather forecasting into advection and convection with neural networks10 May 2024
- 2024U-Net Kalman Filter (UNetKF): An Example of Machine Learning-assisted Ensemble Data Assimilation19 Mar 2024
- 2024Development of an offline and online hybrid model for the Integrated Forecasting System6 Mar 2024
- 2024Learning Semilinear Neural Operators : A Unified Recursive Framework For Prediction And Data Assimilation24 Feb 2024
- 2024Data Assimilation in Chaotic Systems Using Deep Reinforcement Learning1 Jan 2024
- 2023FengWu-4DVar: Coupling the Data-driven Weather Forecasting Model with 4D Variational Assimilation16 Dec 2023
- 2023Machine-learning parameter tracking with partial state observation15 Nov 2023
- 2023Gradient-free online learning of subgrid-scale dynamics with neural emulators30 Oct 2023
- 2023Latent assimilation with implicit neural representations for unknown dynamics18 Sep 2023
- 2023Neural Koopman prior for data assimilation11 Sep 2023
- 2023Improving Surrogate Model Robustness to Perturbations for Dynamical Systems Through Machine Learning and Data Assimilation19 Jul 2023
- 2023Online machine-learning forecast uncertainty estimation for sequential data assimilation12 May 2023
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review18 Mar 2023
- 2023Reduced-Order Autodifferentiable Ensemble Kalman Filters27 Jan 2023
- 2022Learning 4DVAR inversion directly from observations17 Nov 2022
- 2022Online model error correction with neural networks in the incremental 4D-Var framework25 Oct 2022
- 2022A posteriori learning for quasi-geostrophic turbulence parametrization8 Apr 2022
- 2022Generalised Latent Assimilation in Heterogeneous Reduced Spaces with Machine Learning Surrogate Models7 Apr 2022
- 2022Discrepancy Modeling Framework: Learning missing physics, modeling systematic residuals, and disambiguating between deterministic and random effects10 Mar 2022
- 2022Composing a surrogate observation operator for sequential data assimilation29 Jan 2022
- 2021Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test case1 Oct 2021
- 2021Combining data assimilation and machine learning to estimate parameters of a convective-scale model7 Sep 2021
- 2021State, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamics23 Jul 2021
- 2021A comparison of combined data assimilation and machine learning methods for offline and online model error correction23 Jul 2021
- 2021A Framework for Machine Learning of Model Error in Dynamical Systems14 Jul 2021
- 2021Variational Data Assimilation with a Learned Inverse Observation Operator22 Feb 2021
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 37
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2021Variational Data Assimilation with a Learned Inverse Observation Operatorcited by 28
- 2022Generalised Latent Assimilation in Heterogeneous Reduced Spaces with Machine Learning Surrogate Modelscited by 24
- 2023FengWu-4DVar: Coupling the Data-driven Weather Forecasting Model with 4D Variational Assimilationcited by 22
- 2022Discrepancy Modeling Framework: Learning missing physics, modeling systematic residuals, and disambiguating between deterministic and random effectscited by 15
- 2021A comparison of combined data assimilation and machine learning methods for offline and online model error correctioncited by 13
- 2022Online model error correction with neural networks in the incremental 4D-Var frameworkcited by 13
- 2023Reduced-Order Autodifferentiable Ensemble Kalman Filterscited by 12
- 2023Neural Koopman prior for data assimilationcited by 9
- 2023Latent assimilation with implicit neural representations for unknown dynamicscited by 8
12 most cited of 38 All 38 (JSON)
- 2026Structured Neural Modeling of Daily Arctic Sea-Ice Concentration Evolution: Physical-Trajectory-Driven Learning and Forecast-Domain Adaptation22 Aug 2026
- 2026Auto-differentiable data assimilation: Co-learning of states, dynamics, and filtering algorithms21 Mar 2026
- 2026Operator Learning for Smoothing and Forecasting20 Mar 2026
- 2025Hybrid twinning using PBDW and DeepONet for the effective state estimation and prediction on partially known systems3 Dec 2025
- 2025Advancing Ocean State Estimation with efficient and scalable AI8 Nov 2025
- 2025Uncertainty-aware data assimilation through variational inference20 Oct 2025
- 2025RL-DAUNCE: Reinforcement Learning-Driven Data Assimilation with Uncertainty-Aware Constrained Ensembles8 May 2025
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontiers5 Apr 2025
- 2025Ensemble Kalman filter in latent space using a variational autoencoder pair18 Feb 2025
- 2024Long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systems18 Dec 2024
- 2024Combined Optimization of Dynamics and Assimilation with End-to-End Learning on Sparse Observations11 Sep 2024
- 2024Ensemble Transport Filter via Optimized Maximum Mean Discrepancy16 Jul 2024
12 newest of 38 All 38 (JSON)