mlsanityData to 14 Oct 2026

Combining data assimilation and machine learning to estimate parameters of a convective-scale model

arXiv 2109.02953 ↗First posted 7 Sep 2021physics.ao-ph stat.MLcited by 4

Not on the map. Why?

Abstract (arXiv)

Errors in the representation of clouds in convection-permitting numerical weather prediction models can be introduced by different sources. These can be the forcing and boundary conditions, the representation of orography, the accuracy of the numerical schemes determining the evolution of humidity and temperature, but large contributions are due to the parametrization of microphysics and the parametrization of processes in the surface and boundary layers. These schemes typically contain several tunable parameters that are either not physical or only crudely known, leading to model errors. Traditionally, the numerical values of these model parameters are chosen by manual model tuning. More objectively, they can be estimated from observations by the augmented state approach during the data assimilation. Alternatively, in this work, we look at the problem of parameter estimation through an artificial intelligence lens by training two types of artificial neural networks (ANNs) to estimate several parameters of the one-dimensional modified shallow-water model as a function of the observations or analysis of the atmospheric state. Through perfect model experiments, we show that Bayesian neural networks (BNNs) and Bayesian approximations of point estimate neural networks (NNs) are able to estimate model parameters and their relevant statistics. The estimation of parameters combined with data assimilation for the state decreases the initial state errors even when assimilating sparse and noisy observations. The sensitivity to the number of ensemble members, observation coverage, and neural network size is shown. Additionally, we use the method of layer-wise relevance propagation to gain insight into how the ANNs are learning and discover that they naturally select only a few gridpoints that are subject to strong winds and rain to make their predictions of chosen parameters.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 20 of its 56 references that are in the map. First posted on arXiv 7 Sep 2021.

Builds on

20 of 56 references.

References · 20

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  4. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  5. 2018Pyro: Deep Universal Probabilistic Programmingcited by 380
  6. 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 338
  7. 2018Deep learning to represent sub-grid processes in climate modelscited by 156
  8. 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 74
  9. 2020Stochastic Super-Resolution for Downscaling Time-Evolving Atmospheric Fields with a Generative Adversarial Networkcited by 70
  10. 2019Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Modelcited by 45
  11. 2019Survey of Dropout Methods for Deep Neural Networkscited by 44
  12. 2019Physically Interpretable Neural Networks for the Geosciences: Applications to Earth System Variabilitycited by 44
8 more
  1. 2020Using machine learning to correct model error in data assimilation and forecast applicationscited by 41
  2. 2018Collapse of Deep and Narrow Neural Netscited by 37
  3. 2015Modeling Order in Neural Word Embeddings at Scalecited by 6
  4. 2020Informative Neural Ensemble Kalman Learningcited by 6
  5. 2017Sensitivity Analysis for Predictive Uncertainty in Bayesian Neural Networkscited by 3
  6. 2014Data Assimilation by Artificial Neural Networks for an Atmospheric General Circulation Model: Conventional Observationcited by 2
  7. 2020Machine Learning for Robust Identification of Complex Nonlinear Dynamical Systems: Applications to Earth Systems Modelingcited by 2
  8. 2020Embedded methods for feature selection in neural networkscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 0; 2026: 1.

4 papers.