Do AI weather models miss extremes?
Not on the map. Why?
Abstract (arXiv)
AI weather models are often reported to underestimate extremes, but most evidence concerns deterministic regression models verified against reanalysis. We evaluate twelve physical and AI forecast models against ECMWF IFS using ten months of European station observations. The evaluation covers 10 m wind, 2 m temperature, solar radiation, and precipitation within regimes defined from a fixed ERA5 1991-2020 climatology. We find no uniform AI-specific deficit in the tails. Several AI models remain more accurate than IFS under extreme conditions, while others deteriorate markedly; comparable variation occurs among physical models. Every model nevertheless exhibits a common conditional-error pattern, overpredicting low observations and underpredicting high observations. Attenuation of extreme values therefore does not imply a uniform loss of relative skill: tail performance depends on the model, variable, and evaluation setting rather than on whether the forecast is produced by AI or physical numerical modelling.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 30 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
9 of 30 references.
References · 9
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modelingcited by 32
- 2024Generative AI for fast and accurate statistical computation of fluidscited by 28
- 2025Fixing the Double Penalty in Data-Driven Weather Forecasting Through a Modified Spherical Harmonic Loss Functioncited by 27
- 2023Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciar'ancited by 12
- 2024WeatherReal: A Benchmark Based on In-Situ Observations for Evaluating Weather Modelscited by 8
- 2026Universal Diffusion-Based Probabilistic Downscalingcited by 5
- 2025EPT-2 Technical Reportcited by 4
- 2025MAUSAM: An Observations-focused assessment of Global AI Weather Prediction Models During the South Asian Monsooncited by 4
Built on by
Not cited yet.