State, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamics
Not on the map. Why?
Abstract (arXiv)
In a recent methodological paper, we showed how to learn chaotic dynamics along with the state trajectory from sequentially acquired observations, using local ensemble Kalman filters. Here, we more systematically investigate the possibility to use a local ensemble Kalman filter with either covariance localisation or local domains, in order to retrieve the state and a mix of key global and local parameters. Global parameters are meant to represent the surrogate dynamical core, for instance through a neural network, which is reminiscent of data-driven machine learning of dynamics, while the local parameters typically stand for the forcings of the model. Aiming at joint state and parameter estimation, a family of algorithms for covariance and local domain localisation is proposed. In particular, we show how to rigorously update global parameters using a local domain ensemble Kalman filter (EnKF) such as the local ensemble transform Kalman filter (LETKF), an inherently local method. The approach is tested with success on the 40-variable Lorenz model using several of the local EnKF flavors. A two-dimensional illustration based on a multi-layer Lorenz model is finally provided. It uses radiance-like non-local observations. It features both local domains and covariance localisation in order to learn the chaotic dynamics and the local forcings. This paper more generally addresses the key question of online estimation of both global and local model parameters.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 9 of its 44 references that are in the map. First posted on arXiv 23 Jul 2021.
Builds on
9 of 44 references.
References · 9
- 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 72
- 2020Combining data assimilation and machine learning to infer unresolved scale parametrisationcited by 40
- 2020Using machine learning to correct model error in data assimilation and forecast applicationscited by 40
- 2020Bayesian inference of chaotic dynamics by merging data assimilation, machine learning and expectation-maximizationcited by 37
- 2020Supervised learning from noisy observations: Combining machine-learning techniques with data assimilationcited by 27
- 2020Combining Machine Learning with Knowledge-Based Modeling for Scalable Forecasting and Subgrid-Scale Closure of Large, Complex, Spatiotemporal Systemscited by 23
- 2020Online learning of both state and dynamics using ensemble Kalman filterscited by 15
- 2021Reservoir Computing as a Tool for Climate Predictability Studiescited by 13
- 2017Bilinear residual Neural Network for the identification and forecasting of dynamical systemscited by 5
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 3; 2025: 1.
6 papers.
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2022Online model error correction with neural networks in the incremental 4D-Var frameworkcited by 13
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilationcited by 7
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilationcited by 6
- 2025Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Networkcited by 6
- 2024Development of an offline and online hybrid model for the Integrated Forecasting Systemcited by 1
- 2025Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Network11 Jul 2025
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation26 Oct 2024
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilation10 Apr 2024
- 2024Development of an offline and online hybrid model for the Integrated Forecasting System6 Mar 2024
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review18 Mar 2023
- 2022Online model error correction with neural networks in the incremental 4D-Var framework25 Oct 2022