mlsanityData to 14 Oct 2026

Stochastically Perturbed Weights: Ensembles from Deterministic Machine-Learning Weather Models

arXiv 2609.08412 ↗First posted 8 Sep 2026cs.LG physics.ao-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine-learning weather models (MLWMs) now match or outperform operational numerical weather prediction (NWP) at global medium-range forecasting, at far lower inference cost. Many deployed MLWMs are deterministic, producing a single forecast with no estimate of its own uncertainty, whereas a growing family of trained-probabilistic models generate calibrated ensembles directly, at the price of a dedicated training run. We ask instead how much uncertainty can be extracted from a deterministic checkpoint that already exists, without retraining it. Where physical ensembles represent model uncertainty by stochastically perturbing parametrisation tendencies, we perturb the network's raw weight tensors at inference time, a scheme we call stochastically perturbed weights (SPW). We also ask whether it works, where and on which scales to inject the noise, and where it fails. A three-phase ablation across four deterministic backbones, Aurora, GraphCast, SFNO, and AIFS, selects one production baseline per model, benchmarked against the trained-probabilistic AIFS-ENS, FourCastNet 3 and Atlas as well as the operational ECMWF ensemble (IFS-ENS) over 112 initialisation times. At a 240 h (10-day) lead time the SPW ensembles reach continuous ranked probability skill scores (CRPSS) between 0.04 and 0.13 below the best trained-probabilistic baseline, at zero marginal training cost. No injection site works across models: the productive tensor group is architecture-specific, so SPW is at present a tuning procedure rather than a plug-and-play recipe. Its main failure mode is a coherent whole-field offset that overdisperses the domain mean, and restricting the noise to coarse scales or perturbing the initial conditions each repair part of it.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 79 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

29 of 79 references.

References · 29

  1. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  2. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  3. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  4. 2015Variational Dropout and the Local Reparameterization Trickcited by 490
  5. 2023ClimaX: A foundation model for weather and climatecited by 337
  6. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 236
  7. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
  8. 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 177
  9. 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
  10. 2023Scaling transformer neural networks for skillful and reliable medium-range weather forecastingcited by 110
  11. 2025Skillful joint probabilistic weather forecasting from marginalscited by 63
  12. 2025FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scalecited by 62
17 more
  1. 2023AtmoRep: A stochastic model of atmosphere dynamics using large scale representation learningcited by 40
  2. 2022SwinVRNN: A Data-Driven Ensemble Forecasting Model via Learned Distribution Perturbationcited by 32
  3. 2024Probabilistic Weather Forecasting with Hierarchical Graph Neural Networkscited by 30
  4. 2024Uncertainty quantification for data-driven weather modelscited by 26
  5. 2024Huge Ensembles Part I: Design of Ensemble Weather Forecasts using Spherical Fourier Neural Operatorscited by 18
  6. 2022WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline modelscited by 17
  7. 2026Demystifying Data-Driven Probabilistic Medium-Range Weather Forecastingcited by 15
  8. 2026U-Cast: A Surprisingly Simple and Efficient Frontier Probabilistic AI Weather Forecastercited by 12
  9. 2026Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecastingcited by 8
  10. 2026PhysMetrics.Weather: An Evaluation Framework for Physical Consistency in ML Weather Modelscited by 5
  11. 2026Can AI Weather Models Predict Beyond Two Weeks? A Quantitative Benchmark and Analysis of Long Rolloutscited by 4
  12. 2025AI-boosted rare event sampling to characterize extreme weathercited by 3
  13. 2025Signature Kernel Scoring Rule: A Spatio-Temporal Diagnostic for Probabilistic Weather Forecastingcited by 2
  14. 2026The physics of AI weather modelscited by 2
  15. 2023Neural Subnetwork Ensemblescited by 1
  16. 2025Noisy Deep Ensemble: Accelerating Deep Ensemble Learning via Noise Injectioncited by 1
  17. 2026Conditional Tropical Cyclogenesis Rates via Rare-Event Sampling in a Neural Weather Emulatorcited by 1

Built on by

Not cited yet.