Kaggle forecasting competitions: An overlooked learning opportunity
Not on the map. Why?
Abstract (arXiv)
Competitions play an invaluable role in the field of forecasting, as exemplified through the recent M4 competition. The competition received attention from both academics and practitioners and sparked discussions around the representativeness of the data for business forecasting. Several competitions featuring real-life business forecasting tasks on the Kaggle platform has, however, been largely ignored by the academic community. We believe the learnings from these competitions have much to offer to the forecasting community and provide a review of the results from six Kaggle competitions. We find that most of the Kaggle datasets are characterized by higher intermittence and entropy than the M-competitions and that global ensemble models tend to outperform local single models. Furthermore, we find the strong performance of gradient boosted decision trees, increasing success of neural networks for forecasting, and a variety of techniques for adapting machine learning models to the forecasting task.
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 11; 2023: 13; 2024: 9; 2025: 10; 2026: 2.
55 papers.
Sort:
By area:
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
- 2021Monash Time Series Forecasting Archivecited by 256
- 2022Forecast Evaluation for Data Scientists: Common Pitfalls and Best Practicescited by 54
- 2025fev-bench: A Realistic Benchmark for Time Series Forecastingcited by 52
- 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluationcited by 24
- 2022Adapting and Evaluating Influence-Estimation Methods for Gradient-Boosted Decision Treescited by 16
- 2022A review of machine learning concepts and methods for addressing challenges in probabilistic hydrological post-processing and forecastingcited by 12
- 2023Online multiple testing with e-valuescited by 12
- 2021A Multi-scale Time-series Dataset with Benchmark for Machine Learning in Decarbonized Energy Gridscited by 11
- 2021Coresets for Decision Trees of Signalscited by 10
- 2025Rethinking Evaluation in the Era of Time Series Foundation Models: (Un)known Information Leakage Challengescited by 10
- 2025HuggingGraph: Understanding the Supply Chain of LLM Ecosystemcited by 8
38 more
- 2022LIMREF: Local Interpretable Model Agnostic Rule-based Explanations for Forecasting, with an Application to Electricity Smart Meter Datacited by 6
- 2023DivBO: Diversity-aware CASH for Ensemble Learningcited by 6
- 2021How to effectively use machine learning models to predict the solutions for optimization problems: lessons from loss functioncited by 5
- 2022Aggregating distribution forecasts from deep ensemblescited by 5
- 2023Deep Non-Parametric Time Series Forecastercited by 5
- 2024Efficient adjustment for complex covariates: Gaining efficiency with DOPEcited by 5
- 2021Fit4CAD: A point cloud benchmark for fitting simple geometric primitives in CAD objectscited by 4
- 2022STD: A Seasonal-Trend-Dispersion Decomposition of Time Seriescited by 4
- 2022Contextually Enhanced ES-dRNN with Dynamic Attention for Short-Term Load Forecastingcited by 4
- 2023Scalable Probabilistic Forecasting in Retail with Gradient Boosted Trees: A Practitioner's Approachcited by 4
- 2024Large language models for newspaper sentiment analysis during COVID-19: The Guardiancited by 4
- 2021Synergetic Learning of Heterogeneous Temporal Sequences for Multi-Horizon Probabilistic Forecastingcited by 3
- 2021LoMEF: A Framework to Produce Local Explanations for Global Model Time Series Forecastscited by 3
- 2022Lassoed Tree Boostingcited by 3
- 2023Forecasting Electric Vehicle Charging Station Occupancy: Smarter Mobility Data Challengecited by 3
- 2024AnnotatedTables: A Large Tabular Dataset with Language Model Annotationscited by 3
- 2025TS-Arena -- A Live Forecast Pre-Registration Platformcited by 3
- 2021Exploring the representativeness of the M5 competition datacited by 2
- 2022SETAR-Tree: A Novel and Accurate Tree Algorithm for Global Time Series Forecastingcited by 2
- 2024Optimizing AI-Assisted Code Generationcited by 2
- 2025A Short-Term Predict-Then-Cluster Framework for Meal Delivery Servicescited by 2
- 2022Interpretable Time Series Clustering Using Local Explanationscited by 1
- 2022Experimental study of time series forecasting methods for groundwater level predictioncited by 1
- 2023DANLIP: Deep Autoregressive Networks for Locally Interpretable Probabilistic Forecastingcited by 1
- 2023Enhancing Clinical Predictive Modeling through Model Complexity-Driven Class Proportion Tuning for Class Imbalanced Data: An Empirical Study on Opioid Overdose Predictioncited by 1
- 2023Efficient Social Choice via NLP and Samplingcited by 1
- 2024A step towards the integration of machine learning and classic model-based survey methodscited by 1
- 2025Boosting Revisited: Benchmarking and Advancing LP-Based Ensemble Methodscited by 1
- 2021A hybrid ensemble method with negative correlation learning for regressioncited by 0
- 2023Variational Boosted Soft Treescited by 0
- 2023Streamlined Framework for Agile Forecasting Model Development towards Efficient Inventory Managementcited by 0
- 2023CyPhERS: A Cyber-Physical Event Reasoning System providing real-time situational awareness for attack and fault responsecited by 0
- 2023Learning for Interval Prediction of Electricity Demand: A Cluster-based Bootstrapping Approachcited by 0
- 2024Improving the accuracy of freight mode choice models: A case study using the 2017 CFS PUF data set and ensemble learning techniquescited by 0
- 2024Optimizing Sales Forecasts through Automated Integration of Market Indicatorscited by 0
- 2024Beyond Trend Following: Deep Learning for Market Trend Predictioncited by 0
- 2024A Benchmark Time Series Dataset for Semiconductor Fabrication Manufacturing Constructed using Component-based Discrete-Event Simulation Modelscited by 0
- 2025Training Set Reconstruction from Differentially Private Forests: How Effective is DP?cited by 0
50 most cited of 55 All 55 (JSON)
- 2026Flaws in the LLM Automation Narrative9 Jun 2026
- 2026DriftGuard: A Hierarchical Framework for Concept Drift Detection and Remediation in Supply Chain Forecasting13 Jan 2026
- 2025TS-Arena -- A Live Forecast Pre-Registration Platform23 Dec 2025
- 2025Identification of Malicious Posts on the Dark Web Using Supervised Machine Learning28 Nov 2025
- 2025Multi-layer Stack Ensembles for Time Series Forecasting19 Nov 2025
- 2025Rethinking Evaluation in the Era of Time Series Foundation Models: (Un)known Information Leakage Challenges15 Oct 2025
- 2025fev-bench: A Realistic Benchmark for Time Series Forecasting30 Sep 2025
- 2025PIPES: A Meta-dataset of Machine Learning Pipelines11 Sep 2025
- 2025Boosting Revisited: Benchmarking and Advancing LP-Based Ensemble Methods24 Jul 2025
- 2025HuggingGraph: Understanding the Supply Chain of LLM Ecosystem17 Jul 2025
- 2025Training Set Reconstruction from Differentially Private Forests: How Effective is DP?7 Feb 2025
- 2025A Short-Term Predict-Then-Cluster Framework for Meal Delivery Services11 Jan 2025
38 more
- 2024Optimizing AI-Assisted Code Generation14 Dec 2024
- 2024A Benchmark Time Series Dataset for Semiconductor Fabrication Manufacturing Constructed using Component-based Discrete-Event Simulation Models17 Aug 2024
- 2024AnnotatedTables: A Large Tabular Dataset with Language Model Annotations24 Jun 2024
- 2024Beyond Trend Following: Deep Learning for Market Trend Prediction10 Jun 2024
- 2024Large language models for newspaper sentiment analysis during COVID-19: The Guardian20 May 2024
- 2024Optimizing Sales Forecasts through Automated Integration of Market Indicators15 May 2024
- 2024Efficient adjustment for complex covariates: Gaining efficiency with DOPE20 Feb 2024
- 2024A step towards the integration of machine learning and classic model-based survey methods12 Feb 2024
- 2024Improving the accuracy of freight mode choice models: A case study using the 2017 CFS PUF data set and ensemble learning techniques1 Feb 2024
- 2023Deep Non-Parametric Time Series Forecaster22 Dec 2023
- 2023Online multiple testing with e-values10 Nov 2023
- 2023Scalable Probabilistic Forecasting in Retail with Gradient Boosted Trees: A Practitioner's Approach2 Nov 2023
- 2023Efficient Social Choice via NLP and Sampling4 Sep 2023
- 2023Learning for Interval Prediction of Electricity Demand: A Cluster-based Bootstrapping Approach4 Sep 2023
- 2023Forecasting Electric Vehicle Charging Station Occupancy: Smarter Mobility Data Challenge9 Jun 2023
- 2023CyPhERS: A Cyber-Physical Event Reasoning System providing real-time situational awareness for attack and fault response26 May 2023
- 2023Enhancing Clinical Predictive Modeling through Model Complexity-Driven Class Proportion Tuning for Class Imbalanced Data: An Empirical Study on Opioid Overdose Prediction9 May 2023
- 2023Streamlined Framework for Agile Forecasting Model Development towards Efficient Inventory Management13 Apr 2023
- 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluation6 Apr 2023
- 2023Variational Boosted Soft Trees21 Feb 2023
- 2023DivBO: Diversity-aware CASH for Ensemble Learning7 Feb 2023
- 2023DANLIP: Deep Autoregressive Networks for Locally Interpretable Probabilistic Forecasting5 Jan 2023
- 2022Contextually Enhanced ES-dRNN with Dynamic Attention for Short-Term Load Forecasting18 Dec 2022
- 2022SETAR-Tree: A Novel and Accurate Tree Algorithm for Global Time Series Forecasting16 Nov 2022
- 2022Experimental study of time series forecasting methods for groundwater level prediction28 Sep 2022
- 2022Interpretable Time Series Clustering Using Local Explanations1 Aug 2022
- 2022A review of machine learning concepts and methods for addressing challenges in probabilistic hydrological post-processing and forecasting17 Jun 2022
- 2022Lassoed Tree Boosting22 May 2022
- 2022Adapting and Evaluating Influence-Estimation Methods for Gradient-Boosted Decision Trees30 Apr 2022
- 2022STD: A Seasonal-Trend-Dispersion Decomposition of Time Series21 Apr 2022
- 2022Aggregating distribution forecasts from deep ensembles5 Apr 2022
- 2022Forecast Evaluation for Data Scientists: Common Pitfalls and Best Practices21 Mar 2022
- 2022LIMREF: Local Interpretable Model Agnostic Rule-based Explanations for Forecasting, with an Application to Electricity Smart Meter Data15 Feb 2022
- 2021LoMEF: A Framework to Produce Local Explanations for Global Model Time Series Forecasts13 Nov 2021
- 2021A Multi-scale Time-series Dataset with Benchmark for Machine Learning in Decarbonized Energy Grids12 Oct 2021
- 2021Coresets for Decision Trees of Signals7 Oct 2021
- 2021Deep Neural Networks and Tabular Data: A Survey5 Oct 2021
- 2021Fit4CAD: A point cloud benchmark for fitting simple geometric primitives in CAD objects14 May 2021
50 newest of 55 All 55 (JSON)
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
- 2021Monash Time Series Forecasting Archivecited by 256
- 2022Forecast Evaluation for Data Scientists: Common Pitfalls and Best Practicescited by 54
- 2025fev-bench: A Realistic Benchmark for Time Series Forecastingcited by 52
- 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluationcited by 24
- 2022Adapting and Evaluating Influence-Estimation Methods for Gradient-Boosted Decision Treescited by 16
- 2022A review of machine learning concepts and methods for addressing challenges in probabilistic hydrological post-processing and forecastingcited by 12
- 2023Online multiple testing with e-valuescited by 12
- 2021A Multi-scale Time-series Dataset with Benchmark for Machine Learning in Decarbonized Energy Gridscited by 11
- 2021Coresets for Decision Trees of Signalscited by 10
- 2025HuggingGraph: Understanding the Supply Chain of LLM Ecosystemcited by 8
- 2022LIMREF: Local Interpretable Model Agnostic Rule-based Explanations for Forecasting, with an Application to Electricity Smart Meter Datacited by 6
12 most cited of 54 All 54 (JSON)
- 2026Flaws in the LLM Automation Narrative9 Jun 2026
- 2026DriftGuard: A Hierarchical Framework for Concept Drift Detection and Remediation in Supply Chain Forecasting13 Jan 2026
- 2025TS-Arena -- A Live Forecast Pre-Registration Platform23 Dec 2025
- 2025Identification of Malicious Posts on the Dark Web Using Supervised Machine Learning28 Nov 2025
- 2025Multi-layer Stack Ensembles for Time Series Forecasting19 Nov 2025
- 2025fev-bench: A Realistic Benchmark for Time Series Forecasting30 Sep 2025
- 2025PIPES: A Meta-dataset of Machine Learning Pipelines11 Sep 2025
- 2025Boosting Revisited: Benchmarking and Advancing LP-Based Ensemble Methods24 Jul 2025
- 2025HuggingGraph: Understanding the Supply Chain of LLM Ecosystem17 Jul 2025
- 2025Training Set Reconstruction from Differentially Private Forests: How Effective is DP?7 Feb 2025
- 2025A Short-Term Predict-Then-Cluster Framework for Meal Delivery Services11 Jan 2025
- 2024Optimizing AI-Assisted Code Generation14 Dec 2024
12 newest of 54 All 54 (JSON)