A Natural Gas Consumption Forecasting System for Continual Learning Scenarios based on Hoeffding Trees with Change Point Detection Mechanism
Not on the map. Why?
Abstract (arXiv)
Forecasting natural gas consumption, considering seasonality and trends, is crucial in planning its supply and consumption and optimizing the cost of obtaining it, mainly by industrial entities. However, in times of threats to its supply, it is also a critical element that guarantees the supply of this raw material to meet individual consumers' needs, ensuring society's energy security. This article introduces a novel multistep ahead forecasting of natural gas consumption with change point detection integration for model collection selection with continual learning capabilities using data stream processing. The performance of the forecasting models based on the proposed approach is evaluated in a complex real-world use case of natural gas consumption forecasting. We employed Hoeffding tree predictors as forecasting models and the Pruned Exact Linear Time (PELT) algorithm for the change point detection procedure. The change point detection integration enables selecting a different model collection for successive time frames. Thus, three model collection selection procedures (with and without an error feedback loop) are defined and evaluated for forecasting scenarios with various densities of detected change points. These models were compared with change point agnostic baseline approaches. Our experiments show that fewer change points result in a lower forecasting error regardless of the model collection selection procedure employed. Also, simpler model collection selection procedures omitting forecasting error feedback leads to more robust forecasting models suitable for continual learning tasks.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 65 references that are in the map. First posted on arXiv 7 Sep 2023.
Builds on
18 of 65 references.
References · 18
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2016Progressive Neural Networkscited by 1,361
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
- 2019Online Continual Learning with Maximally Interfered Retrievalcited by 379
- 2019On Tiny Episodic Memories in Continual Learningcited by 307
- 2021New Insights on Reducing Abrupt Representation Change in Online Continual Learningcited by 219
- 2022Class-Incremental Continual Learning into the eXtended DER-versecited by 124
- 2020Optimal Continual Learning has Perfect Memory and is NP-hardcited by 87
- 2018Extremely Fast Decision Treecited by 43
- 2022Memory Efficient Continual Learning with Transformerscited by 43
- 2020Forecasting: theory and practicecited by 36
6 more
- 2021Continual Learning for Recurrent Neural Networks: an Empirical Evaluationcited by 34
- 2022A simple but strong baseline for online continual learning: Repeated Augmented Rehearsalcited by 32
- 2022Continual Learning for Multivariate Time Series Tasks with Variable Input Dimensionscited by 14
- 2022WATCH: Wasserstein Change Point Detection for High-Dimensional Time Series Datacited by 13
- 2018Selective review of offline change point detection methodscited by 8
- 2014Efficient penalty search for multiple changepoint problemscited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.