Navigating Out-of-Distribution Electricity Load Forecasting during COVID-19: Benchmarking energy load forecasting models without and with continual learning
Not on the map. Why?
Abstract (arXiv)
In traditional deep learning algorithms, one of the key assumptions is that the data distribution remains constant during both training and deployment. However, this assumption becomes problematic when faced with Out-of-Distribution periods, such as the COVID-19 lockdowns, where the data distribution significantly deviates from what the model has seen during training. This paper employs a two-fold strategy: utilizing continual learning techniques to update models with new data and harnessing human mobility data collected from privacy-preserving pedestrian counters located outside buildings. In contrast to online learning, which suffers from 'catastrophic forgetting' as newly acquired knowledge often erases prior information, continual learning offers a holistic approach by preserving past insights while integrating new data. This research applies FSNet, a powerful continual learning algorithm, to real-world data from 13 building complexes in Melbourne, Australia, a city which had the second longest total lockdown duration globally during the pandemic. Results underscore the crucial role of continual learning in accurate energy forecasting, particularly during Out-of-Distribution periods. Secondary data such as mobility and temperature provided ancillary support to the primary forecasting model. More importantly, while traditional methods struggled to adapt during lockdowns, models featuring at least online learning demonstrated resilience, with lockdown periods posing fewer challenges once armed with adaptive learning techniques. This study contributes valuable methodologies and insights to the ongoing effort to improve energy load forecasting during future Out-of-Distribution periods.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 20 of its 51 references that are in the map. First posted on arXiv 8 Sep 2023.
Builds on
20 of 51 references.
References · 20
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2018Online Learning: A Comprehensive Surveycited by 203
- 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 170
- 2021Darts: User-Friendly Modern Machine Learning for Time Seriescited by 90
- 2021DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Predictioncited by 73
- 2021MobTCast: Leveraging Auxiliary Trajectory Forecasting for Human Mobility Predictioncited by 48
- 2022Learning Fast and Slow for Online Time Series Forecastingcited by 43
- 2023Traffic Forecasting on New Roads Using Spatial Contrastive Pre-Training (SCPT)cited by 11
- 2020TERMCast: Temporal Relation Modeling for Effective Urban Flow Forecastingcited by 10
- 2023Because Every Sensor Is Unique, so Is Every Pair: Handling Dynamicity in Traffic Forecastingcited by 9
8 more
- 2019COLTRANE: ConvolutiOnaL TRAjectory NEtwork for Deep Map Inferencecited by 8
- 2020Pattern-based Long Short-term Memory for Mid-term Electrical Load Forecastingcited by 5
- 2021Predicting Flight Delay with Spatio-Temporal Trajectory Convolutional Network and Airport Situational Awareness Mapcited by 5
- 2021Limitations of machine learning for building energy prediction: ASHRAE Great Energy Predictor III Kaggle competition error analysiscited by 5
- 2023Continually learning out-of-distribution spatiotemporal data for robust energy forecastingcited by 5
- 2021Using Google Trends as a proxy for occupant behavior to predict building energy consumptioncited by 4
- 2023Message Passing Neural Networks for Traffic Forecastingcited by 4
- 2023Self-supervised Activity Representation Learning with Incremental Data: An Empirical Studycited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.