Frequency Matters: When Time Series Foundation Models Fail Under Spectral Shift
Not on the map. Why?
Abstract (arXiv)
Time series foundation models (TSFMs) have shown strong results on public benchmarks, prompting comparisons to a "BERT moment" for time series. Their effectiveness in industrial settings, however, remains uncertain. We examine why TSFMs often struggle to generalize and highlight spectral shift (a mismatch between the dominant frequency components in downstream tasks and those represented during pretraining) as a key factor. We present evidence from an industrial-scale player engagement prediction task in mobile gaming, where TSFMs underperform domain-adapted baselines. To isolate the mechanism, we design controlled synthetic experiments contrasting signals with seen versus unseen frequency bands, observing systematic degradation under spectral mismatch. These findings position frequency awareness as critical for robust TSFM deployment and motivate new pretraining and evaluation protocols that explicitly account for spectral diversity.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 13 of its 18 references that are in the map. First posted on arXiv 6 Nov 2025.
Builds on
13 of 18 references.
References · 13
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2019TabNet: Attentive Interpretable Tabular Learningcited by 648
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
- 2018The UCR Time Series Archivecited by 431
1 more
Built on by
Citing papers per year: 2026: 3.
3 papers.