A comparison of combined data assimilation and machine learning methods for offline and online model error correction
Not on the map. Why?
Abstract (arXiv)
Recent studies have shown that it is possible to combine machine learning methods with data assimilation to reconstruct a dynamical system using only sparse and noisy observations of that system. The same approach can be used to correct the error of a knowledge-based model. The resulting surrogate model is hybrid, with a statistical part supplementing a physical part. In practice, the correction can be added as an integrated term (i.e. in the model resolvent) or directly inside the tendencies of the physical model. The resolvent correction is easy to implement. The tendency correction is more technical, in particular it requires the adjoint of the physical model, but also more flexible. We use the two-scale Lorenz model to compare the two methods. The accuracy in long-range forecast experiments is somewhat similar between the surrogate models using the resolvent correction and the tendency correction. By contrast, the surrogate models using the tendency correction significantly outperform the surrogate models using the resolvent correction in data assimilation experiments. Finally, we show that the tendency correction opens the possibility to make online model error correction, i.e. improving the model progressively as new observations become available. The resulting algorithm can be seen as a new formulation of weak-constraint 4D-Var. We compare online and offline learning using the same framework with the two-scale Lorenz system, and show that with online learning, it is possible to extract all the information from sparse and noisy observations.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 14 of its 45 references that are in the map. First posted on arXiv 23 Jul 2021.
Builds on
14 of 45 references.
References · 14
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 264
- 2018Deep learning to represent sub-grid processes in climate modelscited by 156
- 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 74
- 2018Physics Guided RNNs for Modeling Dynamical Systems: A Case Study in Simulating Lake Temperature Profilescited by 55
- 2019Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Modelcited by 45
- 2020Using machine learning to correct model error in data assimilation and forecast applicationscited by 41
- 2020Combining data assimilation and machine learning to infer unresolved scale parametrisationcited by 40
- 2020Bayesian inference of chaotic dynamics by merging data assimilation, machine learning and expectation-maximizationcited by 38
- 2020Supervised learning from noisy observations: Combining machine-learning techniques with data assimilationcited by 27
- 2020Combining Machine Learning with Knowledge-Based Modeling for Scalable Forecasting and Subgrid-Scale Closure of Large, Complex, Spatiotemporal Systemscited by 23
- 2019Applying machine learning to improve simulations of a chaotic dynamical system using empirical error correctioncited by 15
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 3; 2024: 3; 2025: 1; 2026: 1.
13 papers.
Sort:
By area:
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 75
- 2021Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data-Driven State Estimationcited by 21
- 2022Online model error correction with neural networks in the incremental 4D-Var frameworkcited by 14
- 2023Efficient deep data assimilation with sparse observations and time-varying sensorscited by 14
- 2021Evaluation of Machine Learning Techniques for Forecast Uncertainty Quantificationcited by 7
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilationcited by 7
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilationcited by 6
- 2021Adjoint-Matching Neural Network Surrogates for Fast 4D-Var Data Assimilationcited by 2
- 2023Online machine-learning forecast uncertainty estimation for sequential data assimilationcited by 2
- 2024Development of an offline and online hybrid model for the Integrated Forecasting Systemcited by 2
- 2025Integrating Score-Based Diffusion Models with Machine Learning-Enhanced Localization for Advanced Data Assimilation in Geological Carbon Storagecited by 1
- 2026The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modelingcited by 1
1 more
- 2026The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modeling29 May 2026
- 2025Integrating Score-Based Diffusion Models with Machine Learning-Enhanced Localization for Advanced Data Assimilation in Geological Carbon Storage7 Nov 2025
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation26 Oct 2024
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilation10 Apr 2024
- 2024Development of an offline and online hybrid model for the Integrated Forecasting System6 Mar 2024
- 2023Efficient deep data assimilation with sparse observations and time-varying sensors24 Oct 2023
- 2023Online machine-learning forecast uncertainty estimation for sequential data assimilation12 May 2023
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review18 Mar 2023
- 2022Online model error correction with neural networks in the incremental 4D-Var framework25 Oct 2022
- 2022Composing a surrogate observation operator for sequential data assimilation29 Jan 2022
- 2021Evaluation of Machine Learning Techniques for Forecast Uncertainty Quantification29 Nov 2021
- 2021Adjoint-Matching Neural Network Surrogates for Fast 4D-Var Data Assimilation16 Nov 2021
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 75
- 2021Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data-Driven State Estimationcited by 21
- 2022Online model error correction with neural networks in the incremental 4D-Var frameworkcited by 14
- 2023Efficient deep data assimilation with sparse observations and time-varying sensorscited by 14
- 2021Evaluation of Machine Learning Techniques for Forecast Uncertainty Quantificationcited by 7
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilationcited by 7
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilationcited by 6
- 2021Adjoint-Matching Neural Network Surrogates for Fast 4D-Var Data Assimilationcited by 2
- 2023Online machine-learning forecast uncertainty estimation for sequential data assimilationcited by 2
- 2024Development of an offline and online hybrid model for the Integrated Forecasting Systemcited by 2
- 2026The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modelingcited by 1
- 2022Composing a surrogate observation operator for sequential data assimilationcited by 0
- 2026The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modeling29 May 2026
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation26 Oct 2024
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilation10 Apr 2024
- 2024Development of an offline and online hybrid model for the Integrated Forecasting System6 Mar 2024
- 2023Efficient deep data assimilation with sparse observations and time-varying sensors24 Oct 2023
- 2023Online machine-learning forecast uncertainty estimation for sequential data assimilation12 May 2023
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review18 Mar 2023
- 2022Online model error correction with neural networks in the incremental 4D-Var framework25 Oct 2022
- 2022Composing a surrogate observation operator for sequential data assimilation29 Jan 2022
- 2021Evaluation of Machine Learning Techniques for Forecast Uncertainty Quantification29 Nov 2021
- 2021Adjoint-Matching Neural Network Surrogates for Fast 4D-Var Data Assimilation16 Nov 2021
- 2021Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data-Driven State Estimation25 Sep 2021