mlsanityData to 14 Oct 2026

Thermal-GEMs: Generalized Models for Building Thermal Dynamics

arXiv 2604.16443 ↗First posted 7 Apr 2026eess.SY cs.LG cs.SYcited by 3

Not on the map. Why?

Abstract (arXiv)

Data-driven models for building thermal dynamics are a scalable approach for enabling energy-efficient operation through fault detection & diagnosis or advanced control. To obtain accurate models, measurement data from a target building spanning months to years are required. Transfer Learning (TL) mitigates this challenge by employing pretrained models based on single or multiple source buildings. General multi-source TL models promise to outperform single-source TL, but alternative multi-source modeling architectures remain to be explored, and evaluation on real-world data is missing. Moreover, time series foundation models (TSFM) have emerged as candidates for the best-performing general models. Hence, we conduct a first, comprehensive assessment of general modeling approaches for building thermal dynamics, including multi-source TL and TSFMs. Our assessment includes ablations using four state-of-the-art multi-source TL architectures and evaluations on synthetic as well as real-world data. We demonstrate that multi-source TL models are highly effective in accurately modeling buildings in real-world applications, yielding up to 63% lower forecasting errors compared to single-source TL. Moreover, our results suggest a trade-off between multi-source TL models exclusively pretrained with building data and TSFMs pretrained with a multitude of different time series, revealing that data from 16-32 source buildings must be available over 1 year for pretraining multi-source TL models to consistently outperform TSFMs as evaluated using the mean absolute error. These findings provide practical guidance for selecting modeling strategies based on the number of source buildings available for pretraining multi-source TL models.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 17 of its 50 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

17 of 50 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  4. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  8. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
  9. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  10. 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 127
  11. 2024Is Mamba Effective for Time Series Forecasting?cited by 114
  12. 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 68
5 more
  1. 2025GenTL: A General Transfer Learning Model for Building Thermal Dynamicscited by 9
  2. 2025Adapting to Change: A Comparison of Continual and Transfer Learning for Modeling Building Thermal Dynamics under Concept Driftscited by 7
  3. 2023Transformer Training Strategies for Forecasting Multiple Load Time Seriescited by 6
  4. 2025Probabilistic Forecasting for Building Energy Systems using Time-Series Foundation Modelscited by 4
  5. 2025A Highly Configurable Framework for Large-Scale Thermal Building Data Generation to drive Machine Learning Researchcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.