Leveraging Hypernetworks and Learnable Kernels for Consumer Energy Forecasting Across Diverse Consumer Types
Not on the map. Why?
Abstract (arXiv)
Consumer energy forecasting is essential for managing energy consumption and planning, directly influencing operational efficiency, cost reduction, personalized energy management, and sustainability efforts. In recent years, deep learning techniques, especially LSTMs and transformers, have been greatly successful in the field of energy consumption forecasting. Nevertheless, these techniques have difficulties in capturing complex and sudden variations, and, moreover, they are commonly examined only on a specific type of consumer (e.g., only offices, only schools). Consequently, this paper proposes HyperEnergy, a consumer energy forecasting strategy that leverages hypernetworks for improved modeling of complex patterns applicable across a diversity of consumers. Hypernetwork is responsible for predicting the parameters of the primary prediction network, in our case LSTM. A learnable adaptable kernel, comprised of polynomial and radial basis function kernels, is incorporated to enhance performance. The proposed HyperEnergy was evaluated on diverse consumers including, student residences, detached homes, a home with electric vehicle charging, and a townhouse. Across all consumer types, HyperEnergy consistently outperformed 10 other techniques, including state-of-the-art models such as LSTM, AttentionLSTM, and transformer.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 42 references that are in the map. First posted on arXiv 7 Feb 2025.
Builds on
11 of 42 references.
References · 11
- 2017Attention Is All You Needcited by 60,361
- 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 332
- 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 85
- 2017On weight initialization in deep neural networkscited by 67
- 2019Hypernetwork functional image representationcited by 65
- 2020DHP: Differentiable Meta Pruning via HyperNetworkscited by 57
- 2019HyperGAN: A Generative Model for Diverse, Performant Neural Networkscited by 51
- 2019AR-Net: A simple Auto-Regressive Neural Network for time-seriescited by 20
- 2020N-BEATS neural network for mid-term electricity load forecastingcited by 14
- 2019Modular Universal Reparameterization: Deep Multi-task Learning Across Diverse Domainscited by 13
- 2023Interval Load Forecasting for Individual Households in the Presence of Electric Vehicle Chargingcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.