Zero-shot Load Forecasting for Integrated Energy Systems: A Large Language Model-based Framework with Multi-task Learning
Not on the map. Why?
Abstract (arXiv)
The growing penetration of renewable energy sources in power systems has increased the complexity and uncertainty of load forecasting, especially for integrated energy systems with multiple energy carriers. Traditional forecasting methods heavily rely on historical data and exhibit limited transferability across different scenarios, posing significant challenges for emerging applications in smart grids and energy internet. This paper proposes the TSLLM-Load Forecasting Mechanism, a novel zero-shot load forecasting framework based on large language models (LLMs) to address these challenges. The framework consists of three key components: a data preprocessing module that handles multi-source energy load data, a time series prompt generation module that bridges the semantic gap between energy data and LLMs through multi-task learning and similarity alignment, and a prediction module that leverages pre-trained LLMs for accurate forecasting. The framework's effectiveness was validated on a real-world dataset comprising load profiles from 20 Australian solar-powered households, demonstrating superior performance in both conventional and zero-shot scenarios. In conventional testing, our method achieved a Mean Squared Error (MSE) of 0.4163 and a Mean Absolute Error (MAE) of 0.3760, outperforming existing approaches by at least 8%. In zero-shot prediction experiments across 19 households, the framework maintained consistent accuracy with a total MSE of 11.2712 and MAE of 7.6709, showing at least 12% improvement over current methods. The results validate the framework's potential for accurate and transferable load forecasting in integrated energy systems, particularly beneficial for renewable energy integration and smart grid applications.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 58 references that are in the map. First posted on arXiv 24 Feb 2025.
Builds on
23 of 58 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
- 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 165
- 2023UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecastingcited by 139
- 2023Language-Guided Traffic Simulation via Scene-Level Diffusioncited by 110
11 more
- 2021Learning Graph Structures with Transformer for Multivariate Time Series Anomaly Detection in IoTcited by 104
- 2021Domain Adaptation for Time Series Forecasting via Attention Sharingcited by 68
- 2022Leveraging Language Foundation Models for Human Mobility Forecastingcited by 50
- 2024Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilitiescited by 48
- 2024Deep learning for precipitation nowcasting: A survey from the perspective of time series forecastingcited by 14
- 2022Can Brain Signals Reveal Inner Alignment with Human Languages?cited by 12
- 2021A Multi-scale Time-series Dataset with Benchmark for Machine Learning in Decarbonized Energy Gridscited by 11
- 2024MCformer: Multivariate Time Series Forecasting with Mixed-Channels Transformercited by 10
- 2023Hybrid Variational Autoencoder for Time Series Forecastingcited by 8
- 2023Utilizing Language Models for Energy Load Forecastingcited by 7
- 2023Transfer learning for day-ahead load forecasting: a case study on European national electricity demand time seriescited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.