mlsanityData to 14 Oct 2026

Kairos: Toward Adaptive and Parameter-Efficient Time Series Foundation Models

arXiv 2509.25826 ↗First posted 30 Sep 2025cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

Inherent temporal heterogeneity, such as varying sampling densities and periodic structures, has posed substantial challenges in zero-shot generalization for Time Series Foundation Models (TSFMs). Existing TSFMs predominantly rely on massive parameterization to absorb such heterogeneity, as their static tokenization and positional encoding schemes entangle diverse temporal patterns into a fixed representation space, encouraging memorization rather than adaptation. To address this limitation, we propose Kairos, a flexible and parameter-efficient TSFM dedicated to forecasting tasks, which decouples temporal heterogeneity from model capacity through a novel tokenization perspective. Kairos introduces a dynamic patching tokenizer and a mixture-of-size encoding that adapt observational granularity to local information density, enabling fine-grained temporal abstraction without increasing model width or depth. In addition, we design a multi-granularity positional embedding based on dynamic rotary encodings, which conditions on instance-level spectral features and temporal structure induced by dynamic patching tokenization, allowing robust modeling of diverse temporal dependencies. Trained on a novel Predictability-Stratified Time-Series (PreSTS) corpus, Kairos achieves superior zero-shot performance with substantially fewer parameters on two mainstream benchmarks, GIFT-Eval and Time-Series-Library. The project page is at https://foundation-model-research.github.io/Kairos .

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 41 of its 49 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

41 of 49 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023Segment Anythingcited by 8,234
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  5. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  6. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  7. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  8. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  9. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  10. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  11. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  12. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
29 more
  1. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
  2. 2024Chronos: Learning the Language of Time Seriescited by 759
  3. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  4. 2023A decoder-only foundation model for time-series forecastingcited by 692
  5. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  6. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  7. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  8. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  9. 2018The UCR Time Series Archivecited by 431
  10. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  11. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
  12. 2021Monash Time Series Forecasting Archivecited by 267
  13. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 212
  14. 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
  15. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
  16. 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 127
  17. 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 120
  18. 2024Pathformer: Multi-scale Transformers with Adaptive Pathways for Time Series Forecastingcited by 104
  19. 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 95
  20. 2024VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasterscited by 88
  21. 2024Timer-XL: Long-Context Transformers for Unified Time Series Forecastingcited by 87
  22. 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 68
  23. 2024MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Expertscited by 56
  24. 2024AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Modelscited by 44
  25. 2024DAPE: Data-Adaptive Positional Encoding for Length Extrapolationcited by 31
  26. 2025Output Scaling: YingLong-Delayed Chain of Thought in a Large Pretrained Time Series Forecasting Modelcited by 24
  27. 2024RobustTSF: Towards Theory and Design of Robust Time Series Forecasting with Anomaliescited by 18
  28. 2024Mixture of In-Context Experts Enhance LLMs' Long Context Awarenesscited by 17
  29. 2024ElasTST: Towards Robust Varied-Horizon Forecasting with Elastic Time-Series Transformercited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 8.

9 papers.