mlsanityData to 7 Oct 2026

Timer-M1: A Multivariate Time Series Foundation Model via Learning Primitives

arXiv 2610.11734 ↗First posted 8 Oct 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce Timer-M1, a pretrained multivariate time series foundation model that learns with primitives for zero-shot forecasting. Across domains, time series share elementary temporal and relational patterns, termed primitives, yet differ in how these primitives manifest and evolve across different contexts. Despite progress in zero-shot and task-general forecasting, existing foundation models may still struggle to generalize to complex real-world scenarios. To this end, we develop a primitive-based data synthesis and pretraining pipeline. The synthesis pipeline generates series with temporal primitives shared across domains and then assembles real and generated series into multivariate samples using relational primitives. Afterwards, samples are organized into episodes by assigning distinct channel roles as target variates, past-only covariates, and known-future covariates, ensuring that the model is optimized on predictable variates using available exogenous information. Technically, Timer-M1 further adapts gated two-dimensional Transformer blocks that dynamically allocate cross-variate attention across layers. Across three large-scale forecasting benchmarks, Timer-M1 ranks first on both FEV and TIME and second on GIFT-Eval among most recent time series foundation models. These results support effective primitive-based pretraining as a route to robust general forecasting technique across domains and task settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 28 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

21 of 28 references.

References · 21

  1. 2024Chronos: Learning the Language of Time Seriescited by 712
  2. 2023A decoder-only foundation model for time-series forecastingcited by 650
  3. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
  4. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  5. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  6. 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 267
  7. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
  8. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 168
  9. 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
  10. 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 107
  11. 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 102
  12. 2024TabDPT: Scaling Tabular Foundation Models on Real Datacited by 97
9 more
  1. 2024Timer-XL: Long-Context Transformers for Unified Time Series Forecastingcited by 83
  2. 2025fev-bench: A Realistic Benchmark for Time Series Forecastingcited by 52
  3. 2026It's TIME: Towards the Next Generation of Time Series Forecasting Benchmarkscited by 25
  4. 2026Timer-S1: A Billion-Scale Time Series Foundation Model with Serial Scalingcited by 24
  5. 2026Toto 2.0: Time Series Forecasting Enters the Scaling Eracited by 21
  6. 2024Can Models Learn Skill Composition from Examples?cited by 17
  7. 2026Revisiting the Generic Transformer: Deconstructing a Strong Baseline for Time Series Foundation Modelscited by 10
  8. 2026TiRex-2: Generalizing TiRex to Multivariate Data and Streamingcited by 10
  9. 2026Falcon-X: A Time Series Foundation Model for Heterogeneous Multivariate Modelingcited by 7

Built on by

Not cited yet.