Multi-fidelity climate model parameterization for better generalization and extrapolation
Not on the map. Why?
Abstract (arXiv)
Machine-learning-based parameterizations (i.e. representation of sub-grid processes) of global climate models or turbulent simulations have recently been proposed as a powerful alternative to physical, but empirical, representations, offering a lower computational cost and higher accuracy. Yet, those approaches still suffer from a lack of generalization and extrapolation beyond the training data, which is however critical to projecting climate change or unobserved regimes of turbulence. Here we show that a multi-fidelity approach, which integrates datasets of different accuracy and abundance, can provide the best of both worlds: the capacity to extrapolate leveraging the physically-based parameterization and a higher accuracy using the machine-learning-based parameterizations. In an application to climate modeling, the multi-fidelity framework yields more accurate climate projections without requiring major increase in computational resources. Our multi-fidelity randomized prior networks (MF-RPNs) combine physical parameterization data as low-fidelity and storm-resolving historical run's data as high-fidelity. To extrapolate beyond the training data, the MF-RPNs are tested on high-fidelity warming scenarios, +4K, data. We show the MF-RPN's capacity to return much more skillful predictions compared to either low- or high-fidelity (historical data) simulations trained only on one regime while providing trustworthy uncertainty quantification across a wide range of scenarios. Our approach paves the way for the use of machine-learning based methods that can optimally leverage historical observations or high-fidelity simulations and extrapolate to unseen regimes such as climate change.
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Builds on 19 of its 85 references that are in the map. First posted on arXiv 19 Sep 2023.
Builds on
19 of 85 references.
References · 19
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,430
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,902
- 2015Weight Uncertainty in Neural Networkscited by 554
- 2019Deep Ensembles: A Loss Landscape Perspectivecited by 441
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 305
- 2018Randomized Prior Functions for Deep Reinforcement Learningcited by 219
- 2018Deep Bayesian Bandits Showdown: An Empirical Comparison of Bayesian Deep Networks for Thompson Samplingcited by 168
- 2018Deep learning to represent sub-grid processes in climate modelscited by 156
- 2018Survey of multifidelity methods in uncertainty propagation, inference, and optimizationcited by 141
- 2020Multi-fidelity Bayesian Neural Networks: Algorithms and Applicationscited by 59
- 2017Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High-Resolution Simulationscited by 51
- 2022Scalable Uncertainty Quantification for Deep Operator Networks using Randomized Priorscited by 39
7 more
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2020Bayesian differential programming for robust systems identification under uncertaintycited by 16
- 2020A Fortran-Keras Deep Learning Bridge for Scientific Computingcited by 16
- 2021Bridging observation, theory and numerical simulation of the ocean using Machine Learningcited by 15
- 2022Multi-fidelity Hierarchical Neural Processescited by 15
- 2022Machine-learned climate model corrections from a global storm-resolving modelcited by 5
- 2023Scalable Bayesian optimization with high-dimensional outputs using randomized prior networkscited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 1.
4 papers.
- 2024Joint Parameter and Parameterization Inference with Uncertainty Quantification through Differentiable Programmingcited by 5
- 2023Navigating the Noise: Bringing Clarity to ML Parameterization Design with O(100) Ensemblescited by 3
- 2025Crowdsourcing the Frontier: Advancing Hybrid Physics-ML Climate Simulation via a 50,000 Kaggle Competitioncited by 1
- 2026No Epoch Like the Present: Robust Climate Emulation Requires Out-of-Distribution Generalisationcited by 0
- 2026No Epoch Like the Present: Robust Climate Emulation Requires Out-of-Distribution Generalisation21 May 2026
- 2025Crowdsourcing the Frontier: Advancing Hybrid Physics-ML Climate Simulation via a 50,000 Kaggle Competition26 Nov 2025
- 2024Joint Parameter and Parameterization Inference with Uncertainty Quantification through Differentiable Programming4 Mar 2024
- 2023Navigating the Noise: Bringing Clarity to ML Parameterization Design with O(100) Ensembles28 Sep 2023