Climate-Invariant Machine Learning
Not on the map. Why?
Abstract (arXiv)
Projecting climate change is a generalization problem: we extrapolate the recent past using physical models across past, present, and future climates. Current climate models require representations of processes that occur at scales smaller than model grid size, which have been the main source of model projection uncertainty. Recent machine learning (ML) algorithms hold promise to improve such process representations, but tend to extrapolate poorly to climate regimes they were not trained on. To get the best of the physical and statistical worlds, we propose a new framework - termed "climate-invariant" ML - incorporating knowledge of climate processes into ML algorithms, and show that it can maintain high offline accuracy across a wide range of climate conditions and configurations in three distinct atmospheric models. Our results suggest that explicitly incorporating physical knowledge into data-driven models of Earth system processes can improve their consistency, data efficiency, and generalizability across climate regimes.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 17 of its 128 references that are in the map. First posted on arXiv 14 Dec 2021.
Builds on
17 of 128 references.
References · 17
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systemscited by 660
- 2015Cyclical Learning Rates for Training Neural Networkscited by 627
- 2018A Survey of Unsupervised Deep Domain Adaptationcited by 361
- 2017The (Un)reliability of saliency methodscited by 331
- 2018Deep learning to represent sub-grid processes in climate modelscited by 156
- 2019A review of domain adaptation without target labelscited by 154
- 2021Recent Advances in Domain Adaptation for the Classification of Remote Sensing Datacited by 70
- 2017Machine Learning for the Geosciences: Challenges and Opportunitiescited by 53
5 more
- 2021Will Artificial Intelligence supersede Earth System and Climate Models?cited by 37
- 2020A Fortran-Keras Deep Learning Bridge for Scientific Computingcited by 16
- 2020Towards Physically-consistent, Data-driven Models of Convectioncited by 13
- 2019Cumulo: A Dataset for Learning Cloud Classescited by 9
- 2019Combining crowd-sourcing and deep learning to explore the meso-scale organization of shallow convectioncited by 7
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 3; 2024: 9; 2025: 5; 2026: 4.
24 papers.
Sort:
- 2023ACE: A fast, skillful learned global atmospheric model for climate predictioncited by 53
- 2024ACE2: Accurately learning subseasonal to decadal atmospheric variability and forced responsescited by 53
- 2024Can AI weather models predict out-of-distribution gray swan tropical cyclones?cited by 26
- 2024Drift-Resilient TabPFN: In-Context Learning Temporal Distribution Shifts on Tabular Datacited by 25
- 2022Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flowcited by 20
- 2022Multiscale Neural Operator: Learning Fast and Grid-independent PDE Solverscited by 12
- 2024Robustness of AI-based weather forecasts in a changing climatecited by 11
- 2021Deep Learning Based Cloud Cover Parameterization for ICONcited by 5
- 2025CERA: A Framework for Improved Generalization of Machine Learning Models to Changed Climatescited by 4
- 2023Navigating the Noise: Bringing Clarity to ML Parameterization Design with O(100) Ensemblescited by 3
- 2023Extreme Event Prediction with Multi-agent Reinforcement Learning-based Parametrization of Atmospheric and Oceanic Turbulencecited by 2
- 2024Lightning-Fast Convective Outlooks: Predicting Severe Convective Environments with Global AI-based Weather Modelscited by 2
12 more
- 2024Multi-scale decomposition of sea surface height snapshots using machine learningcited by 2
- 2025Forecasting the Future with Yesterday's Climate: Temperature Bias in AI Weather and Climate Modelscited by 2
- 2024Towards Physically Consistent Deep Learning For Climate Model Parameterizationscited by 1
- 2024Enforcing Equity in Neural Climate Emulatorscited by 1
- 2025The Equilibrium Response of Atmospheric Machine-Learning Models to Uniform Sea Surface Temperature Warmingcited by 1
- 2024Machine Learning for Stochastic Parametrisationcited by 0
- 2025Simple and Robust Forecasting of Spatiotemporally Correlated Small Earth Data with A Tabular Foundation Modelcited by 0
- 2025Conditional updates of neural network weights for increased out of training performancecited by 0
- 2026Accelerating Optimization and Machine Learning through Decentralizationcited by 0
- 2026No Epoch Like the Present: Robust Climate Emulation Requires Out-of-Distribution Generalisationcited by 0
- 2026Position: AI Must Become Planet-Centered, Not Just Human-Centeredcited by 0
- 2026Learning Prognostic Variables for AI Convective Parameterizations via Symbolic Distillationcited by 0
- 2026Learning Prognostic Variables for AI Convective Parameterizations via Symbolic Distillation21 Sep 2026
- 2026Position: AI Must Become Planet-Centered, Not Just Human-Centered9 Jun 2026
- 2026No Epoch Like the Present: Robust Climate Emulation Requires Out-of-Distribution Generalisation21 May 2026
- 2026Accelerating Optimization and Machine Learning through Decentralization21 Apr 2026
- 2025Conditional updates of neural network weights for increased out of training performance3 Dec 2025
- 2025Simple and Robust Forecasting of Spatiotemporally Correlated Small Earth Data with A Tabular Foundation Model10 Oct 2025
- 2025The Equilibrium Response of Atmospheric Machine-Learning Models to Uniform Sea Surface Temperature Warming2 Oct 2025
- 2025Forecasting the Future with Yesterday's Climate: Temperature Bias in AI Weather and Climate Models26 Sep 2025
- 2025CERA: A Framework for Improved Generalization of Machine Learning Models to Changed Climates15 Aug 2025
- 2024ACE2: Accurately learning subseasonal to decadal atmospheric variability and forced responses18 Nov 2024
- 2024Drift-Resilient TabPFN: In-Context Learning Temporal Distribution Shifts on Tabular Data15 Nov 2024
- 2024Can AI weather models predict out-of-distribution gray swan tropical cyclones?19 Oct 2024
12 more
- 2024Robustness of AI-based weather forecasts in a changing climate27 Sep 2024
- 2024Multi-scale decomposition of sea surface height snapshots using machine learning11 Sep 2024
- 2024Enforcing Equity in Neural Climate Emulators28 Jun 2024
- 2024Lightning-Fast Convective Outlooks: Predicting Severe Convective Environments with Global AI-based Weather Models13 Jun 2024
- 2024Towards Physically Consistent Deep Learning For Climate Model Parameterizations6 Jun 2024
- 2024Machine Learning for Stochastic Parametrisation12 Feb 2024
- 2023Extreme Event Prediction with Multi-agent Reinforcement Learning-based Parametrization of Atmospheric and Oceanic Turbulence1 Dec 2023
- 2023ACE: A fast, skillful learned global atmospheric model for climate prediction3 Oct 2023
- 2023Navigating the Noise: Bringing Clarity to ML Parameterization Design with O(100) Ensembles28 Sep 2023
- 2022Multiscale Neural Operator: Learning Fast and Grid-independent PDE Solvers23 Jul 2022
- 2022Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow7 Jun 2022
- 2021Deep Learning Based Cloud Cover Parameterization for ICON21 Dec 2021
- 2023ACE: A fast, skillful learned global atmospheric model for climate predictioncited by 53
- 2024ACE2: Accurately learning subseasonal to decadal atmospheric variability and forced responsescited by 53
- 2024Can AI weather models predict out-of-distribution gray swan tropical cyclones?cited by 26
- 2024Drift-Resilient TabPFN: In-Context Learning Temporal Distribution Shifts on Tabular Datacited by 25
- 2022Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flowcited by 20
- 2022Multiscale Neural Operator: Learning Fast and Grid-independent PDE Solverscited by 12
- 2024Robustness of AI-based weather forecasts in a changing climatecited by 11
- 2021Deep Learning Based Cloud Cover Parameterization for ICONcited by 5
- 2025CERA: A Framework for Improved Generalization of Machine Learning Models to Changed Climatescited by 4
- 2023Navigating the Noise: Bringing Clarity to ML Parameterization Design with O(100) Ensemblescited by 3
- 2023Extreme Event Prediction with Multi-agent Reinforcement Learning-based Parametrization of Atmospheric and Oceanic Turbulencecited by 2
- 2024Lightning-Fast Convective Outlooks: Predicting Severe Convective Environments with Global AI-based Weather Modelscited by 2
12 most cited of 24 All 24 (JSON)
- 2026Learning Prognostic Variables for AI Convective Parameterizations via Symbolic Distillation21 Sep 2026
- 2026Position: AI Must Become Planet-Centered, Not Just Human-Centered9 Jun 2026
- 2026No Epoch Like the Present: Robust Climate Emulation Requires Out-of-Distribution Generalisation21 May 2026
- 2026Accelerating Optimization and Machine Learning through Decentralization21 Apr 2026
- 2025Conditional updates of neural network weights for increased out of training performance3 Dec 2025
- 2025Simple and Robust Forecasting of Spatiotemporally Correlated Small Earth Data with A Tabular Foundation Model10 Oct 2025
- 2025The Equilibrium Response of Atmospheric Machine-Learning Models to Uniform Sea Surface Temperature Warming2 Oct 2025
- 2025Forecasting the Future with Yesterday's Climate: Temperature Bias in AI Weather and Climate Models26 Sep 2025
- 2025CERA: A Framework for Improved Generalization of Machine Learning Models to Changed Climates15 Aug 2025
- 2024ACE2: Accurately learning subseasonal to decadal atmospheric variability and forced responses18 Nov 2024
- 2024Drift-Resilient TabPFN: In-Context Learning Temporal Distribution Shifts on Tabular Data15 Nov 2024
- 2024Can AI weather models predict out-of-distribution gray swan tropical cyclones?19 Oct 2024
12 newest of 24 All 24 (JSON)