Performance of Zero-Shot Time Series Foundation Models on Cloud Data
Not on the map. Why?
Abstract (arXiv)
Time series foundation models (FMs) have emerged as a popular paradigm for zero-shot multi-domain forecasting. FMs are trained on numerous diverse datasets and claim to be effective forecasters across multiple different time series domains, including cloud data. In this work we investigate this claim, exploring the effectiveness of FMs on cloud data. We demonstrate that many well-known FMs fail to generate meaningful or accurate zero-shot forecasts in this setting. We support this claim empirically, showing that FMs are outperformed consistently by simple linear baselines. We also illustrate a number of interesting pathologies, including instances where FMs suddenly output seemingly erratic, random-looking forecasts. Our results suggest a widespread failure of FMs to model cloud data.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 18 Feb 2025.
Builds on
17 of 26 references.
References · 17
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Domain Generalization: A Surveycited by 760
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2023A decoder-only foundation model for time-series forecastingcited by 650
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 234
- 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
- 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 120
- 2024VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasterscited by 87
- 2024TSFM-Bench: A Comprehensive and Unified Benchmark of Foundation Models for Time Series Forecastingcited by 55
- 2024An Analysis of Linear Time Series Forecasting Modelscited by 40
5 more
- 2024Empowering Time Series Analysis with Foundation Models: A Comprehensive Surveycited by 23
- 2024Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Modelscited by 17
- 2023How Does It Function? Characterizing Long-term Trends in Production Serverless Workloadscited by 10
- 2024DAM: Towards A Foundation Model for Time Series Forecastingcited by 10
- 2024Serverless Cold Starts and Where to Find Themcited by 5
Built on by
Citing papers per year: 2025: 6; 2026: 4.
10 papers.
- 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 57
- 2025True Zero-Shot Inference of Dynamical Systems Preserving Long-Term Statisticscited by 20
- 2025TelecomTS: A Multi-Modal Observability Dataset for Time Series and Language Analysiscited by 5
- 2025One-Embedding-Fits-All: Efficient Zero-Shot Time Series Forecasting by a Model Zoocited by 3
- 2025Why Cannot Neural Networks Master Extrapolation? Insights from Physical Lawscited by 2
- 2026Adapting Time Series Foundation Models through Data Mixturescited by 2
- 2025BinConv: A Neural Architecture for Ordinal Encoding in Time-Series Forecastingcited by 0
- 2026CloudCons: A Comprehensive End-to-End Benchmark for Cloud Resource Consolidationcited by 0
- 2026A Later Test Set Is Not a New Domain: Pretraining Familiarity Survives a Contamination-Free Hold-Outcited by 0
- 2026Evaluating Accuracy and Probabilistic Reliability of Zero-Shot Time Series Foundation Modelscited by 0
- 2026Evaluating Accuracy and Probabilistic Reliability of Zero-Shot Time Series Foundation Models22 Sep 2026
- 2026A Later Test Set Is Not a New Domain: Pretraining Familiarity Survives a Contamination-Free Hold-Out9 Sep 2026
- 2026CloudCons: A Comprehensive End-to-End Benchmark for Cloud Resource Consolidation11 Jun 2026
- 2026Adapting Time Series Foundation Models through Data Mixtures3 Mar 2026
- 2025TelecomTS: A Multi-Modal Observability Dataset for Time Series and Language Analysis7 Oct 2025
- 2025Why Cannot Neural Networks Master Extrapolation? Insights from Physical Laws5 Oct 2025
- 2025One-Embedding-Fits-All: Efficient Zero-Shot Time Series Forecasting by a Model Zoo4 Sep 2025
- 2025BinConv: A Neural Architecture for Ordinal Encoding in Time-Series Forecasting30 May 2025
- 2025This Time is Different: An Observability Perspective on Time Series Foundation Models20 May 2025
- 2025True Zero-Shot Inference of Dynamical Systems Preserving Long-Term Statistics19 May 2025