No Epoch Like the Present: Robust Climate Emulation Requires Out-of-Distribution Generalisation
Not on the map. Why?
Abstract (arXiv)
Climate emulation is an out-of-distribution (OOD) projection task. This is precisely the challenge where modern Machine Learning (ML) methods are most prone to failure. Consequently, while current ML emulators trained on present climate achieve high in-distribution performance, their future reliability under the inevitable distribution shifts of a changing climate remains a critical, poorly understood blind spot. Addressing this challenge requires a fundamental shift in how we understand, evaluate, and design climate emulators. In this work, we first confirm that climate change drives a statistically significant and progressively growing shift in atmospheric state distributions, rendering standard evaluation protocols insufficient. We empirically establish that seasonal variation serves as an effective proxy for these long-term climate shifts, providing access to textitreal-world distribution shifts without recourse to heuristics like synthetic perturbations. Motivated by this link, we introduce a novel evaluation framework that leverages seasonal shifts as a rigorous, zero-overhead testbed for emulator robustness. Our systematic characterisation confirms that current state-of-the-art hybrid-ML emulators degrade significantly under these realistic shifts. Finally, we chart a path forward by identifying compositional generalisation, the ability to form novel combinations from observed elementary components, as a principled route towards robust climate emulation. We demonstrate that physically motivated decompositions substantially improve OOD performance with only modest trade-offs against in-distribution performance, providing an avenue towards ML-driven climate emulators robust to an unknown future.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 80 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
29 of 80 references.
References · 29
- 2022A ConvNet for the 2020scited by 3,579
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2020In Search of Lost Domain Generalizationcited by 1,054
- 2023ClimaX: A foundation model for weather and climatecited by 337
- 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 275
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 249
- 2023Neural General Circulation Models for Weather and Climatecited by 239
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 236
- 2020On the Binding Problem in Artificial Neural Networkscited by 233
- 2021Abstraction and Analogy-Making in Artificial Intelligencecited by 103
- 2024ACE2: Accurately learning subseasonal to decadal atmospheric variability and forced responsescited by 54
- 2017Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High-Resolution Simulationscited by 51
17 more
- 2023ClimateLearn: Benchmarking Machine Learning for Weather and Climate Modelingcited by 47
- 2023ClimateSet: A Large-Scale Climate Model Dataset for Machine Learningcited by 25
- 2021Climate-Invariant Machine Learningcited by 24
- 2024Marrying Causal Representation Learning with Dynamical Systems for Sciencecited by 23
- 2021ClimART: A Benchmark Dataset for Emulating Atmospheric Radiative Transfer in Weather and Climate Modelscited by 21
- 2020Towards Physically-consistent, Data-driven Models of Convectioncited by 13
- 2025Towards mechanistic understanding in a data-driven weather model: internal activations reveal interpretable physical featurescited by 12
- 2024Robustness of AI-based weather forecasts in a changing climatecited by 11
- 2024Accuracy on the wrong line: On the pitfalls of noisy data for out-of-distribution generalisationcited by 9
- 2023Multi-fidelity climate model parameterization for better generalization and extrapolationcited by 4
- 2025CERA: A Framework for Improved Generalization of Machine Learning Models to Changed Climatescited by 4
- 2026FloeNet: A mass-conserving global sea ice emulator that generalizes across climatescited by 4
- 2023Navigating the Noise: Bringing Clarity to ML Parameterization Design with O(100) Ensemblescited by 3
- 2026Disentangling Dynamical Systems: Causal Representation Learning Meets Local Sparse Attentioncited by 3
- 2024Towards Physically Consistent Deep Learning For Climate Model Parameterizationscited by 1
- 2025Crowdsourcing the Frontier: Advancing Hybrid Physics-ML Climate Simulation via a 50,000 Kaggle Competitioncited by 1
- 2026Assessing the Robustness of Climate Foundation Models under No-Analog Distribution Shiftscited by 1
Built on by
Not cited yet.