mlsanityData to 7 Oct 2026

Kaggle forecasting competitions: An overlooked learning opportunity

arXiv 2009.07701 ↗First posted 16 Sep 2020stat.ML cs.LG stat.APcited by 55

Not on the map. Why?

Abstract (arXiv)

Competitions play an invaluable role in the field of forecasting, as exemplified through the recent M4 competition. The competition received attention from both academics and practitioners and sparked discussions around the representativeness of the data for business forecasting. Several competitions featuring real-life business forecasting tasks on the Kaggle platform has, however, been largely ignored by the academic community. We believe the learnings from these competitions have much to offer to the forecasting community and provide a review of the results from six Kaggle competitions. We find that most of the Kaggle datasets are characterized by higher intermittence and entropy than the M-competitions and that global ensemble models tend to outperform local single models. Furthermore, we find the strong performance of gradient boosted decision trees, increasing success of neural networks for forecasting, and a variety of techniques for adapting machine learning models to the forecasting task.

Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Sep 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 10; 2022: 11; 2023: 13; 2024: 9; 2025: 10; 2026: 2.

55 papers.

Sort:

By area:

  1. 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
  2. 2021Monash Time Series Forecasting Archivecited by 256
  3. 2022Forecast Evaluation for Data Scientists: Common Pitfalls and Best Practicescited by 54
  4. 2025fev-bench: A Realistic Benchmark for Time Series Forecastingcited by 52
  5. 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluationcited by 24
  6. 2022Adapting and Evaluating Influence-Estimation Methods for Gradient-Boosted Decision Treescited by 16
  7. 2022A review of machine learning concepts and methods for addressing challenges in probabilistic hydrological post-processing and forecastingcited by 12
  8. 2023Online multiple testing with e-valuescited by 12
  9. 2021A Multi-scale Time-series Dataset with Benchmark for Machine Learning in Decarbonized Energy Gridscited by 11
  10. 2021Coresets for Decision Trees of Signalscited by 10
  11. 2025Rethinking Evaluation in the Era of Time Series Foundation Models: (Un)known Information Leakage Challengescited by 10
  12. 2025HuggingGraph: Understanding the Supply Chain of LLM Ecosystemcited by 8
38 more
  1. 2022LIMREF: Local Interpretable Model Agnostic Rule-based Explanations for Forecasting, with an Application to Electricity Smart Meter Datacited by 6
  2. 2023DivBO: Diversity-aware CASH for Ensemble Learningcited by 6
  3. 2021How to effectively use machine learning models to predict the solutions for optimization problems: lessons from loss functioncited by 5
  4. 2022Aggregating distribution forecasts from deep ensemblescited by 5
  5. 2023Deep Non-Parametric Time Series Forecastercited by 5
  6. 2024Efficient adjustment for complex covariates: Gaining efficiency with DOPEcited by 5
  7. 2021Fit4CAD: A point cloud benchmark for fitting simple geometric primitives in CAD objectscited by 4
  8. 2022STD: A Seasonal-Trend-Dispersion Decomposition of Time Seriescited by 4
  9. 2022Contextually Enhanced ES-dRNN with Dynamic Attention for Short-Term Load Forecastingcited by 4
  10. 2023Scalable Probabilistic Forecasting in Retail with Gradient Boosted Trees: A Practitioner's Approachcited by 4
  11. 2024Large language models for newspaper sentiment analysis during COVID-19: The Guardiancited by 4
  12. 2021Synergetic Learning of Heterogeneous Temporal Sequences for Multi-Horizon Probabilistic Forecastingcited by 3
  13. 2021LoMEF: A Framework to Produce Local Explanations for Global Model Time Series Forecastscited by 3
  14. 2022Lassoed Tree Boostingcited by 3
  15. 2023Forecasting Electric Vehicle Charging Station Occupancy: Smarter Mobility Data Challengecited by 3
  16. 2024AnnotatedTables: A Large Tabular Dataset with Language Model Annotationscited by 3
  17. 2025TS-Arena -- A Live Forecast Pre-Registration Platformcited by 3
  18. 2021Exploring the representativeness of the M5 competition datacited by 2
  19. 2022SETAR-Tree: A Novel and Accurate Tree Algorithm for Global Time Series Forecastingcited by 2
  20. 2024Optimizing AI-Assisted Code Generationcited by 2
  21. 2025A Short-Term Predict-Then-Cluster Framework for Meal Delivery Servicescited by 2
  22. 2022Interpretable Time Series Clustering Using Local Explanationscited by 1
  23. 2022Experimental study of time series forecasting methods for groundwater level predictioncited by 1
  24. 2023DANLIP: Deep Autoregressive Networks for Locally Interpretable Probabilistic Forecastingcited by 1
  25. 2023Enhancing Clinical Predictive Modeling through Model Complexity-Driven Class Proportion Tuning for Class Imbalanced Data: An Empirical Study on Opioid Overdose Predictioncited by 1
  26. 2023Efficient Social Choice via NLP and Samplingcited by 1
  27. 2024A step towards the integration of machine learning and classic model-based survey methodscited by 1
  28. 2025Boosting Revisited: Benchmarking and Advancing LP-Based Ensemble Methodscited by 1
  29. 2021A hybrid ensemble method with negative correlation learning for regressioncited by 0
  30. 2023Variational Boosted Soft Treescited by 0
  31. 2023Streamlined Framework for Agile Forecasting Model Development towards Efficient Inventory Managementcited by 0
  32. 2023CyPhERS: A Cyber-Physical Event Reasoning System providing real-time situational awareness for attack and fault responsecited by 0
  33. 2023Learning for Interval Prediction of Electricity Demand: A Cluster-based Bootstrapping Approachcited by 0
  34. 2024Improving the accuracy of freight mode choice models: A case study using the 2017 CFS PUF data set and ensemble learning techniquescited by 0
  35. 2024Optimizing Sales Forecasts through Automated Integration of Market Indicatorscited by 0
  36. 2024Beyond Trend Following: Deep Learning for Market Trend Predictioncited by 0
  37. 2024A Benchmark Time Series Dataset for Semiconductor Fabrication Manufacturing Constructed using Component-based Discrete-Event Simulation Modelscited by 0
  38. 2025Training Set Reconstruction from Differentially Private Forests: How Effective is DP?cited by 0

50 most cited of 55 All 55 (JSON)