M5 Competition Uncertainty: Overdispersion, distributional forecasting, GAMLSS and beyond
Not on the map. Why?
Abstract (arXiv)
The M5 competition uncertainty track aims for probabilistic forecasting of sales of thousands of Walmart retail goods. We show that the M5 competition data faces strong overdispersion and sporadic demand, especially zero demand. We discuss resulting modeling issues concerning adequate probabilistic forecasting of such count data processes. Unfortunately, the majority of popular prediction methods used in the M5 competition (e.g. lightgbm and xgboost GBMs) fails to address the data characteristics due to the considered objective functions. The distributional forecasting provides a suitable modeling approach for to the overcome those problems. The GAMLSS framework allows flexible probabilistic forecasting using low dimensional distributions. We illustrate, how the GAMLSS approach can be applied for the M5 competition data by modeling the location and scale parameter of various distributions, e.g. the negative binomial distribution. Finally, we discuss software packages for distributional modeling and their drawback, like the R package gamlss with its package extensions, and (deep) distributional forecasting libraries such as TensorFlow Probability.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 8 of its 22 references that are in the map. First posted on arXiv 14 Jul 2021.
Builds on
8 of 22 references.
References · 8
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
- 2017TensorFlow Distributionscited by 105
- 2019Probabilistic Forecasting with Temporal Convolutional Neural Networkcited by 63
- 2020Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectoriescited by 15
- 2021deepregression: a Flexible Neural Network Framework for Semi-Structured Deep Distributional Regressioncited by 13
- 2019XGBoostLSS -- An extension of XGBoost to probabilistic forecastingcited by 11
- 2020Deep Distributional Time Series Models and the Probabilistic Forecasting of Intraday Electricity Pricescited by 11
Built on by
Citing papers per year: 2022: 6; 2023: 1; 2024: 1; 2025: 2; 2026: 1.
11 papers.
- 2022A review of predictive uncertainty estimation with machine learningcited by 29
- 2022Probabilistic forecasting of German electricity imbalance pricescited by 10
- 2022Distributional Gradient Boosting Machinescited by 5
- 2025Foundation Models for Demand Forecasting via Dual-Strategy Ensemblingcited by 5
- 2023Scalable Probabilistic Forecasting in Retail with Gradient Boosted Trees: A Practitioner's Approachcited by 4
- 2022Simulation-based Forecasting for Intraday Power Markets: Modelling Fundamental Drivers for Location, Shape and Scale of the Price Distributioncited by 3
- 2024Online Distributional Regressioncited by 3
- 2022High-Resolution Peak Demand Estimation Using Generalized Additive Models and Deep Neural Networkscited by 2
- 2025Online Multivariate Regularized Distributional Regression for High-dimensional Probabilistic Electricity Price Forecastingcited by 2
- 2026Intermittent time series forecasting: local vs global modelscited by 1
- 2022Distributional Adaptive Soft Regression Treescited by 0
- 2026Intermittent time series forecasting: local vs global models20 Jan 2026
- 2025Foundation Models for Demand Forecasting via Dual-Strategy Ensembling29 Jul 2025
- 2025Online Multivariate Regularized Distributional Regression for High-dimensional Probabilistic Electricity Price Forecasting3 Apr 2025
- 2024Online Distributional Regression26 Jun 2024
- 2023Scalable Probabilistic Forecasting in Retail with Gradient Boosted Trees: A Practitioner's Approach2 Nov 2023
- 2022Simulation-based Forecasting for Intraday Power Markets: Modelling Fundamental Drivers for Location, Shape and Scale of the Price Distribution23 Nov 2022
- 2022Distributional Adaptive Soft Regression Trees19 Oct 2022
- 2022A review of predictive uncertainty estimation with machine learning17 Sep 2022
- 2022Probabilistic forecasting of German electricity imbalance prices23 May 2022
- 2022Distributional Gradient Boosting Machines2 Apr 2022
- 2022High-Resolution Peak Demand Estimation Using Generalized Additive Models and Deep Neural Networks7 Mar 2022