mlsanityData to 7 Oct 2026

Automated Deep Learning for Load Forecasting

arXiv 2405.08842 ↗First posted 14 May 2024cs.LG cs.AI cs.NEcited by 3

Not on the map. Why?

Abstract (arXiv)

Accurate forecasting of electricity consumption is essential to ensure the performance and stability of the grid, especially as the use of renewable energy increases. Forecasting electricity is challenging because it depends on many external factors, such as weather and calendar variables. While regression-based models are currently effective, the emergence of new explanatory variables and the need to refine the temporality of the signals to be forecasted is encouraging the exploration of novel methodologies, in particular deep learning models. However, Deep Neural Networks (DNNs) struggle with this task due to the lack of data points and the different types of explanatory variables (e.g. integer, float, or categorical). In this paper, we explain why and how we used Automated Deep Learning (AutoDL) to find performing DNNs for load forecasting. We ended up creating an AutoDL framework called EnergyDragon by extending the DRAGON package and applying it to load forecasting. EnergyDragon automatically selects the features embedded in the DNN training in an innovative way and optimizes the architecture and the hyperparameters of the networks. We demonstrate on the French load signal that EnergyDragon can find original DNNs that outperform state-of-the-art load forecasting methods as well as other AutoDL approaches.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 41 references that are in the map. First posted on arXiv 14 May 2024.

Builds on

13 of 41 references.

References · 13

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  4. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  5. 2018DARTS: Differentiable Architecture Searchcited by 1,782
  6. 2017Snapshot Ensembles: Train 1, get M for freecited by 349
  7. 2019On the Relationship between Self-Attention and Convolutional Layerscited by 299
  8. 2022Why do tree-based models still outperform deep learning on tabular data?cited by 198
  9. 2017Hierarchical Representations for Efficient Architecture Searchcited by 188
  10. 2022Efficient Automated Deep Learning for Time Series Forecastingcited by 14
  11. 2021Scale-Aware Neural Architecture Search for Multivariate Time Series Forecastingcited by 9
  12. 2023An algorithmic framework for the optimization of deep neural networks architectures and hyperparameterscited by 6
1 more
  1. 2021A New State-of-the-Art Transformers-Based Load Forecaster on the Smart Grid Domaincited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.