Online learning of both state and dynamics using ensemble Kalman filters
Not on the map. Why?
Abstract (arXiv)
The reconstruction of the dynamics of an observed physical system as a surrogate model has been brought to the fore by recent advances in machine learning. To deal with partial and noisy observations in that endeavor, machine learning representations of the surrogate model can be used within a Bayesian data assimilation framework. However, these approaches require to consider long time series of observational data, meant to be assimilated all together. This paper investigates the possibility to learn both the dynamics and the state online, i.e. to update their estimates at any time, in particular when new observations are acquired. The estimation is based on the ensemble Kalman filter (EnKF) family of algorithms using a rather simple representation for the surrogate model and state augmentation. We consider the implication of learning dynamics online through (i) a global EnKF, (i) a local EnKF and (iii) an iterative EnKF and we discuss in each case issues and algorithmic solutions. We then demonstrate numerically the efficiency and assess the accuracy of these methods using one-dimensional, one-scale and two-scale chaotic Lorenz models.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 1; 2023: 1; 2024: 3; 2025: 2; 2026: 4.
15 papers.
Sort:
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2021Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observationscited by 20
- 2021Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data-Driven State Estimationcited by 20
- 2021A comparison of combined data assimilation and machine learning methods for offline and online model error correctioncited by 13
- 2022Online model error correction with neural networks in the incremental 4D-Var frameworkcited by 13
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilationcited by 7
- 2021State, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamicscited by 6
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilationcited by 6
- 2025Ensemble Kalman filter in latent space using a variational autoencoder paircited by 5
- 2026Latent Autoencoder Ensemble Kalman Filter for Nonlinear Data assimilationcited by 3
- 2024Development of an offline and online hybrid model for the Integrated Forecasting Systemcited by 1
- 2026Auto-differentiable data assimilation: Co-learning of states, dynamics, and filtering algorithmscited by 1
- 2026ADDA: a Modular Framework for Representing, Simulating and Assimilating Dynamics with End-to-end Differentiability24 Aug 2026
- 2026The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modeling29 May 2026
- 2026Auto-differentiable data assimilation: Co-learning of states, dynamics, and filtering algorithms21 Mar 2026
- 2026Latent Autoencoder Ensemble Kalman Filter for Nonlinear Data assimilation6 Mar 2026
- 2025Ensemble Kalman filter in latent space using a variational autoencoder pair18 Feb 2025
- 2025The Ensemble Kalman Update is an Empirical Matheron Update5 Feb 2025
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation26 Oct 2024
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilation10 Apr 2024
- 2024Development of an offline and online hybrid model for the Integrated Forecasting System6 Mar 2024
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review18 Mar 2023
- 2022Online model error correction with neural networks in the incremental 4D-Var framework25 Oct 2022
- 2021Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data-Driven State Estimation25 Sep 2021
3 more
- 2021Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observations8 Aug 2021
- 2021State, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamics23 Jul 2021
- 2021A comparison of combined data assimilation and machine learning methods for offline and online model error correction23 Jul 2021
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2021Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observationscited by 20
- 2021Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data-Driven State Estimationcited by 20
- 2021A comparison of combined data assimilation and machine learning methods for offline and online model error correctioncited by 13
- 2022Online model error correction with neural networks in the incremental 4D-Var frameworkcited by 13
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilationcited by 7
- 2021State, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamicscited by 6
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilationcited by 6
- 2025Ensemble Kalman filter in latent space using a variational autoencoder paircited by 5
- 2026Latent Autoencoder Ensemble Kalman Filter for Nonlinear Data assimilationcited by 3
- 2024Development of an offline and online hybrid model for the Integrated Forecasting Systemcited by 1
- 2026Auto-differentiable data assimilation: Co-learning of states, dynamics, and filtering algorithmscited by 1
12 most cited of 15 All 15 (JSON)
- 2026ADDA: a Modular Framework for Representing, Simulating and Assimilating Dynamics with End-to-end Differentiability24 Aug 2026
- 2026The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modeling29 May 2026
- 2026Auto-differentiable data assimilation: Co-learning of states, dynamics, and filtering algorithms21 Mar 2026
- 2026Latent Autoencoder Ensemble Kalman Filter for Nonlinear Data assimilation6 Mar 2026
- 2025Ensemble Kalman filter in latent space using a variational autoencoder pair18 Feb 2025
- 2025The Ensemble Kalman Update is an Empirical Matheron Update5 Feb 2025
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation26 Oct 2024
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilation10 Apr 2024
- 2024Development of an offline and online hybrid model for the Integrated Forecasting System6 Mar 2024
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review18 Mar 2023
- 2022Online model error correction with neural networks in the incremental 4D-Var framework25 Oct 2022
- 2021Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data-Driven State Estimation25 Sep 2021
12 newest of 15 All 15 (JSON)