# Kaggle forecasting competitions: An overlooked learning opportunity

arXiv: https://arxiv.org/abs/2009.07701 · HTML: https://mlsanity.com/paper/2009.07701/

## Key facts

- Cited by 56 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Sep 2020.

## Built on by (most cited first, 30 of 56)

- [Deep Neural Networks and Tabular Data: A Survey](https://mlsanity.com/paper/2110.01889/) (2021)
- [Monash Time Series Forecasting Archive](https://mlsanity.com/paper/2105.06643/) (2021)
- [fev-bench: A Realistic Benchmark for Time Series Forecasting](https://mlsanity.com/paper/2509.26468/) (2025)
- [Forecast Evaluation for Data Scientists: Common Pitfalls and Best Practices](https://mlsanity.com/paper/2203.10716/) (2022)
- [A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluation](https://mlsanity.com/paper/2304.02858/) (2023)
- [Adapting and Evaluating Influence-Estimation Methods for Gradient-Boosted Decision Trees](https://mlsanity.com/paper/2205.00359/) (2022)
- [Rethinking Evaluation in the Era of Time Series Foundation Models: (Un)known Information Leakage Challenges](https://mlsanity.com/paper/2510.13654/) (2025)
- [A review of machine learning concepts and methods for addressing challenges in probabilistic hydrological post-processing and forecasting](https://mlsanity.com/paper/2206.08998/) (2022)
- [Online multiple testing with e-values](https://mlsanity.com/paper/2311.06412/) (2023)
- [A Multi-scale Time-series Dataset with Benchmark for Machine Learning in Decarbonized Energy Grids](https://mlsanity.com/paper/2110.06324/) (2021)
- [Coresets for Decision Trees of Signals](https://mlsanity.com/paper/2110.03195/) (2021)
- [HuggingGraph: Understanding the Supply Chain of LLM Ecosystem](https://mlsanity.com/paper/2507.14240/) (2025)
- [LIMREF: Local Interpretable Model Agnostic Rule-based Explanations for Forecasting, with an Application to Electricity Smart Meter Data](https://mlsanity.com/paper/2202.07766/) (2022)
- [DivBO: Diversity-aware CASH for Ensemble Learning](https://mlsanity.com/paper/2302.03255/) (2023)
- [How to effectively use machine learning models to predict the solutions for optimization problems: lessons from loss function](https://mlsanity.com/paper/2105.06618/) (2021)
- [Aggregating distribution forecasts from deep ensembles](https://mlsanity.com/paper/2204.02291/) (2022)
- [Contextually Enhanced ES-dRNN with Dynamic Attention for Short-Term Load Forecasting](https://mlsanity.com/paper/2212.09030/) (2022)
- [Deep Non-Parametric Time Series Forecaster](https://mlsanity.com/paper/2312.14657/) (2023)
- [Efficient adjustment for complex covariates: Gaining efficiency with DOPE](https://mlsanity.com/paper/2402.12980/) (2024)
- [Fit4CAD: A point cloud benchmark for fitting simple geometric primitives in CAD objects](https://mlsanity.com/paper/2105.06858/) (2021)
- [STD: A Seasonal-Trend-Dispersion Decomposition of Time Series](https://mlsanity.com/paper/2204.10398/) (2022)
- [Lassoed Tree Boosting](https://mlsanity.com/paper/2205.10697/) (2022)
- [Scalable Probabilistic Forecasting in Retail with Gradient Boosted Trees: A Practitioner's Approach](https://mlsanity.com/paper/2311.00993/) (2023)
- [Large language models for newspaper sentiment analysis during COVID-19: The Guardian](https://mlsanity.com/paper/2405.13056/) (2024)
- [Synergetic Learning of Heterogeneous Temporal Sequences for Multi-Horizon Probabilistic Forecasting](https://mlsanity.com/paper/2102.00431/) (2021)
- [LoMEF: A Framework to Produce Local Explanations for Global Model Time Series Forecasts](https://mlsanity.com/paper/2111.07001/) (2021)
- [Forecasting Electric Vehicle Charging Station Occupancy: Smarter Mobility Data Challenge](https://mlsanity.com/paper/2306.06142/) (2023)
- [AnnotatedTables: A Large Tabular Dataset with Language Model Annotations](https://mlsanity.com/paper/2406.16349/) (2024)
- [TS-Arena -- A Live Forecast Pre-Registration Platform](https://mlsanity.com/paper/2512.20761/) (2025)
- [Exploring the representativeness of the M5 competition data](https://mlsanity.com/paper/2103.02941/) (2021)

## Abstract (arXiv)

Competitions play an invaluable role in the field of forecasting, as exemplified through the recent M4 competition. The competition received attention from both academics and practitioners and sparked discussions around the representativeness of the data for business forecasting. Several competitions featuring real-life business forecasting tasks on the Kaggle platform has, however, been largely ignored by the academic community. We believe the learnings from these competitions have much to offer to the forecasting community and provide a review of the results from six Kaggle competitions. We find that most of the Kaggle datasets are characterized by higher intermittence and entropy than the M-competitions and that global ensemble models tend to outperform local single models. Furthermore, we find the strong performance of gradient boosted decision trees, increasing success of neural networks for forecasting, and a variety of techniques for adapting machine learning models to the forecasting task.