Do AI Forecast Ensembles Sample the Correct Conditional Distribution?
Not on the map. Why?
Abstract (arXiv)
Ensemble forecasting aims to sample the conditional distribution of outcomes; whether AI forecast ensembles do this correctly in a joint sense remains largely untested. We train a diffusion model for probabilistic subseasonal coastal sea level forecasts at eight US East Coast tide gauge stations, with sea level derived from reanalysis, and find that marginal and joint forecast quality decouple: positive skill at every station and lead time marginally, while joint spatial structure is worse than climatological draws. A shuffle-based permutation decomposition reveals this failure is invisible to the energy score but detected by the variogram score. Lorenz-96 experiments across 0.7-170 equivalent years show the gap persists regardless of training volume and is reproduced by a linear baseline, indicating structural inadequacy of the learned distribution. A dynamical ensemble does not replicate the failure while a deterministic emulator does, suggesting it is specific to learned emulators rather than ensemble forecasting generally.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 17 references that are in the map. First posted on arXiv 9 Aug 2026.
Builds on
6 of 17 references.
References · 6
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
- 2021Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction modelscited by 79
- 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 74
- 2019Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Modelcited by 45
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Continuous Ensemble Weather Forecasting with Diffusion models
- 2026Proper Scoring Rule-based Diffusion for Probabilistic Weather Forecasting
- 2023SEEDS: Emulation of Weather Forecast Ensembles with Diffusion Models
- 2025Data-Efficient Ensemble Weather Forecasting with Diffusion Models
- 2025DEF: Diffusion-augmented Ensemble Forecasting
- 2025LaDCast: A Latent Diffusion Model for Medium-Range Ensemble Weather Forecasting
- 2026BridgeCast: Bridging Ocean Wave Forecasts to Reanalysis via Flow Matching with Exogenous Variables
- 2026Universal Diffusion-Based Probabilistic Downscaling