mlsanityData to 14 Oct 2026

A comparison of combined data assimilation and machine learning methods for offline and online model error correction

arXiv 2107.11114 ↗First posted 23 Jul 2021stat.ML cs.LGcited by 13

Not on the map. Why?

Abstract (arXiv)

Recent studies have shown that it is possible to combine machine learning methods with data assimilation to reconstruct a dynamical system using only sparse and noisy observations of that system. The same approach can be used to correct the error of a knowledge-based model. The resulting surrogate model is hybrid, with a statistical part supplementing a physical part. In practice, the correction can be added as an integrated term (i.e. in the model resolvent) or directly inside the tendencies of the physical model. The resolvent correction is easy to implement. The tendency correction is more technical, in particular it requires the adjoint of the physical model, but also more flexible. We use the two-scale Lorenz model to compare the two methods. The accuracy in long-range forecast experiments is somewhat similar between the surrogate models using the resolvent correction and the tendency correction. By contrast, the surrogate models using the tendency correction significantly outperform the surrogate models using the resolvent correction in data assimilation experiments. Finally, we show that the tendency correction opens the possibility to make online model error correction, i.e. improving the model progressively as new observations become available. The resulting algorithm can be seen as a new formulation of weak-constraint 4D-Var. We compare online and offline learning using the same framework with the two-scale Lorenz system, and show that with online learning, it is possible to extract all the information from sparse and noisy observations.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 14 of its 45 references that are in the map. First posted on arXiv 23 Jul 2021.

Builds on

14 of 45 references.

References · 14

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 264
  3. 2018Deep learning to represent sub-grid processes in climate modelscited by 156
  4. 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 74
  5. 2018Physics Guided RNNs for Modeling Dynamical Systems: A Case Study in Simulating Lake Temperature Profilescited by 55
  6. 2019Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Modelcited by 45
  7. 2020Using machine learning to correct model error in data assimilation and forecast applicationscited by 41
  8. 2020Combining data assimilation and machine learning to infer unresolved scale parametrisationcited by 40
  9. 2020Bayesian inference of chaotic dynamics by merging data assimilation, machine learning and expectation-maximizationcited by 38
  10. 2020Supervised learning from noisy observations: Combining machine-learning techniques with data assimilationcited by 27
  11. 2020Combining Machine Learning with Knowledge-Based Modeling for Scalable Forecasting and Subgrid-Scale Closure of Large, Complex, Spatiotemporal Systemscited by 23
  12. 2019Applying machine learning to improve simulations of a chaotic dynamical system using empirical error correctioncited by 15
2 more
  1. 2020Online learning of both state and dynamics using ensemble Kalman filterscited by 15
  2. 2017Machine Learning, Deepest Learning: Statistical Data Assimilation Problemscited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 3; 2022: 2; 2023: 3; 2024: 3; 2025: 1; 2026: 1.

13 papers.

Sort:

By area: