mlsanityData to 14 Oct 2026

Foundations without Fundamentals: Zero-Shot Blind Spots in Time Series FMs

arXiv 2610.02058 ↗First posted 1 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite the success of Time Series Foundation Models (TSFMs) on broad benchmarks, their ability to internalize basic temporal logic, especially in settings supported by exogenous covariates, remains under-examined. We introduce SimpleTimeBench, a diagnostic univariate and multivariate "unit test" suite for primitives such as monotonic trends, periodic signals and leading indicator covariates, scenarios where near-perfect forecasts should be trivial. Surprisingly, prominent multivariate TSFMs (Chronos-2, Moirai and Toto) frequently produce suboptimal zero-shot forecasts for these inputs. While fine-tuning Chronos-2 improves its behaviour on specific tasks, we show that this adaptation degrades performance on other fundamental patterns rather than enhancing its generalizable foundational capabilities. This reveals a gap between pre-training scale and basic temporal reasoning, suggesting that current TSFMs could potentially lack the inductive biases needed to capture simple predictable functions. We further demonstrate that these failures are not merely synthetic curiosities: they persist in real-world sensor forecasting, where TSFMs consistently underutilize leading indicators available in observed covariates. This inability to capture simple relationships limits the practical utility and reliability of current multivariate models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 17 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

14 of 17 references.

References · 14

  1. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  2. 2024Chronos: Learning the Language of Time Seriescited by 759
  3. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  4. 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 503
  5. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 212
  6. 2025Chronos-2: From Univariate to Universal Forecastingcited by 194
  7. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
  8. 2025fev-bench: A Realistic Benchmark for Time Series Forecastingcited by 64
  9. 2024Toto: Time Series Optimized Transformer for Observabilitycited by 48
  10. 2024Exploring Representations and Interventions in Time Series Foundation Modelscited by 20
  11. 2025Empowering Time Series Analysis with Synthetic Data: A Survey and Outlook in the Era of Foundation Modelscited by 15
  12. 2025TimeCopilotcited by 9
2 more
  1. 2025Understanding the Implicit Biases of Design Choices for Time Series Foundation Modelscited by 8
  2. 2025How Foundational are Foundation Models for Time Series Forecasting?cited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Universal Redundancies in Time Series Foundation Models
  2. 2025Rethinking Evaluation in the Era of Time Series Foundation Models: (Un)known Information Leakage Challenges
  3. 2025Forecast2Anomaly (F2A): Adapting Multivariate Time Series Foundation Models for Anomaly Prediction
  4. 2026GRAM: Correcting Frozen Time-Series Foundation Models via Graph-Retrieved Amplitude Memory
  5. 2026When, Not How Much: Evaluating Time-Series Foundation Models on Sparse Events
  6. 2026Tracing the Evidence Behind Zero-Shot Time-Series Forecasting: A Source-First Taxonomy and Audit Framework
  7. 2026Zero-shot Forecasting by Simulation Alone
  8. 2026Diversified Scaling Inference in Time Series Foundation Models