Utilizing Language Models for Energy Load Forecasting
Not on the map. Why?
Abstract (arXiv)
Energy load forecasting plays a crucial role in optimizing resource allocation and managing energy consumption in buildings and cities. In this paper, we propose a novel approach that leverages language models for energy load forecasting. We employ prompting techniques to convert energy consumption data into descriptive sentences, enabling fine-tuning of language models. By adopting an autoregressive generating approach, our proposed method enables predictions of various horizons of future energy load consumption. Through extensive experiments on real-world datasets, we demonstrate the effectiveness and accuracy of our proposed method. Our results indicate that utilizing language models for energy load forecasting holds promise for enhancing energy efficiency and facilitating intelligent decision-making in energy systems.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 8 of its 10 references that are in the map. First posted on arXiv 26 Oct 2023.
Builds on
8 of 10 references.
References · 8
- 2017Attention Is All You Needcited by 60,361
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
- 2022Leveraging Language Foundation Models for Human Mobility Forecastingcited by 50
- 2021Translating Human Mobility Forecasting through Natural Language Generationcited by 10
Built on by
Citing papers per year: 2024: 2; 2025: 3; 2026: 2.
7 papers.
- 2024Large Language Models for Time Series: A Surveycited by 114
- 2024BTS: Building Timeseries Dataset: Empowering Large-Scale Building Analyticscited by 6
- 2025Urban Computing in the Era of Large Language Modelscited by 2
- 2025Can Time-Series Foundation Models Perform Building Energy Management Tasks?cited by 2
- 2025Zero-shot Load Forecasting for Integrated Energy Systems: A Large Language Model-based Framework with Multi-task Learningcited by 1
- 2026DomusFM: A Foundation Model for Event-Based Behavioral Monitoring in Smart-Homescited by 0
- 2026Privacy-Preserving Machine Learning for IoT: A Cross-Paradigm Survey and Future Roadmapcited by 0
- 2026Privacy-Preserving Machine Learning for IoT: A Cross-Paradigm Survey and Future Roadmap13 Mar 2026
- 2026DomusFM: A Foundation Model for Event-Based Behavioral Monitoring in Smart-Homes2 Feb 2026
- 2025Can Time-Series Foundation Models Perform Building Energy Management Tasks?12 Jun 2025
- 2025Urban Computing in the Era of Large Language Models2 Apr 2025
- 2025Zero-shot Load Forecasting for Integrated Energy Systems: A Large Language Model-based Framework with Multi-task Learning24 Feb 2025
- 2024BTS: Building Timeseries Dataset: Empowering Large-Scale Building Analytics13 Jun 2024
- 2024Large Language Models for Time Series: A Survey2 Feb 2024