Probabilistic Forecasting for Building Energy Systems using Time-Series Foundation Models
Not on the map. Why?
Abstract (arXiv)
Decision-making in building energy systems critically depends on the predictive accuracy of relevant time-series models. In scenarios lacking extensive data from a target building, foundation models (FMs) represent a promising technology that can leverage prior knowledge from vast and diverse pre-training datasets to construct accurate probabilistic predictors for use in decision-making tools. This paper investigates the applicability and fine-tuning strategies of time-series foundation models (TSFMs) in building energy forecasting. We analyze both full fine-tuning and parameter-efficient fine-tuning approaches, particularly low-rank adaptation (LoRA), by using real-world data from a commercial net-zero energy building to capture signals such as room occupancy, carbon emissions, plug loads, and HVAC energy consumption. Our analysis reveals that the zero-shot predictive performance of TSFMs is generally suboptimal. To address this shortcoming, we demonstrate that employing either full fine-tuning or parameter-efficient fine-tuning significantly enhances forecasting accuracy, even with limited historical data. Notably, fine-tuning with low-rank adaptation (LoRA) substantially reduces computational costs without sacrificing accuracy. Furthermore, fine-tuned TSFMs consistently outperform state-of-the-art deep forecasting models (e.g., temporal fusion transformers) in accuracy, robustness, and generalization across varying building zones and seasonal conditions. These results underline the efficacy of TSFMs for practical, data-constrained building energy management systems, enabling improved decision-making in pursuit of energy efficiency and sustainability.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 64 references that are in the map. First posted on arXiv 31 May 2025.
Builds on
26 of 64 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Segment Anythingcited by 8,234
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
14 more
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 168
- 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 127
- 2023The Expressive Power of Low-Rank Adaptationcited by 102
- 2019Stochastic Mirror Descent on Overparameterized Nonlinear Models: Convergence, Implicit Regularization, and Generalizationcited by 40
- 2023BuildingsBench: A Large-Scale Dataset of 900K Buildings and Benchmark for Short-Term Load Forecastingcited by 26
- 2022ORFit: One-Pass Learning via Bridging Orthogonal Gradient Descent and Recursive Least-Squarescited by 12
- 2024TimeGPT in Load Forecasting: A Large Time Series Model Perspectivecited by 8
- 2020A Worrying Analysis of Probabilistic Time-series Models for Sales Forecastingcited by 3
- 2024A Scalable and Transferable Time Series Prediction Framework for Demand Forecastingcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026Thermal-GEMs: Generalized Models for Building Thermal Dynamicscited by 3
- 2025Can Time-Series Foundation Models Perform Building Energy Management Tasks?cited by 2
- 2026ThermoForce: A Physics-Structured Interventional World Model for Building HVAC Controlcited by 2
- 2026Toward a foundational thermal model for residential buildingscited by 1
- 2026ThermoForce: A Physics-Structured Interventional World Model for Building HVAC Control4 Jul 2026
- 2026Toward a foundational thermal model for residential buildings2 May 2026
- 2026Thermal-GEMs: Generalized Models for Building Thermal Dynamics7 Apr 2026
- 2025Can Time-Series Foundation Models Perform Building Energy Management Tasks?12 Jun 2025