mlsanityData to 14 Oct 2026

Improving probabilistic forecasts of extreme wind speeds by training statistical post-processing models with weighted scoring rules

arXiv 2407.15900 ↗First posted 22 Jul 2024cs.LG stat.APcited by 2

Not on the map. Why?

Abstract (arXiv)

Accurate forecasts of extreme wind speeds are of high importance for many applications. Such forecasts are usually generated by ensembles of numerical weather prediction (NWP) models, which however can be biased and have errors in dispersion, thus necessitating the application of statistical post-processing techniques. In this work we aim to improve statistical post-processing models for probabilistic predictions of extreme wind speeds. We do this by adjusting the training procedure used to fit ensemble model output statistics (EMOS) models - a commonly applied post-processing technique - and propose estimating parameters using the so-called threshold-weighted continuous ranked probability score (twCRPS), a proper scoring rule that places special emphasis on predictions over a threshold. We show that training using the twCRPS leads to improved extreme event performance of post-processing models for a variety of thresholds. We find a distribution body-tail trade-off where improved performance for probabilistic predictions of extreme events comes with worse performance for predictions of the distribution body. However, we introduce strategies to mitigate this trade-off based on weighted training and linear pooling. Finally, we consider some synthetic experiments to explain the training impact of the twCRPS and derive closed-form expressions of the twCRPS for a number of distributions, giving the first such collection in the literature. The results will enable researchers and practitioners alike to improve the performance of probabilistic forecasting models for extremes and other events of interest.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 72 references that are in the map. First posted on arXiv 22 Jul 2024.

Builds on

19 of 72 references.

References · 19

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2018Neural networks for post-processing ensemble weather forecastscited by 95
  3. 2021Regression Diagnostics meets Forecast Evaluation: Conditional Calibration, Reliability Diagrams, and Coefficient of Determinationcited by 31
  4. 2022The harm of class imbalance corrections for risk prediction models: illustration and simulation using logistic regressioncited by 28
  5. 2022Generative machine learning methods for multivariate ensemble post-processingcited by 26
  6. 2021CRPS Learningcited by 21
  7. 2015Forecaster's Dilemma: Extreme Events and Forecast Evaluationcited by 20
  8. 2021Gradient boosting for extreme quantile regressioncited by 17
  9. 2022Evaluating forecasts for high-impact events using transformed kernel scorescited by 11
  10. 2014Log-normal distribution based EMOS models for probabilistic wind speed forecastingcited by 10
  11. 2016Combining predictive distributions for statistical post-processing of ensemble forecastscited by 9
  12. 2019Evaluating probabilistic forecasts of extremes using continuous ranked probability score distributionscited by 7
7 more
  1. 2024Tail calibration of probabilistic forecastscited by 7
  2. 2013Assessing the calibration of high-dimensional ensemble forecasts using rank histogramscited by 6
  3. 2015Censored and shifted gamma distribution based EMOS model for probabilistic quantitative precipitation forecastingcited by 5
  4. 2017Forest-based methods and ensemble model output statistics for rainfall ensemble forecastingcited by 5
  5. 2018Improving precipitation forecasts using extreme quantile regressioncited by 4
  6. 2013Statistical Post-Processing of Forecasts for Extremes Using Bivariate Brown-Resnick Processes with an Application to Wind Gustscited by 3
  7. 2013CRPS M-estimation for max-stable modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.