mlsanityData to 7 Oct 2026

Zeus: Towards Tuning-Free Foundation Model for Time Series Analysis

arXiv 2607.01918 ↗First posted 2 Jul 2026cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

We present Zeus, a unified tuning-free Time Series Foundation Model (TSFM) that delivers superior performance across diverse analysis tasks without any task-specific fine-tuning. Unlike prior studies that primarily focus on zero-shot forecasting but require task-specific tuning for other tasks, Zeus bridges this gap by addressing two fundamental challenges in multi-task generalization. First, to reconcile point-level granularity with long-sequence scalability, Zeus incorporates a multi-scale Transformer featuring point-wise tokenization and a U-shaped hierarchy, effectively balancing fine-grained fidelity with computational efficiency. Second, to accommodate varying inductive biases across different tasks, Zeus introduces Multi-Objective Temporal Masking (MOTM), a unified strategy that supports heterogeneous tasks (e.g., extrapolation, interpolation, and global abstraction) within a single framework. Extensive experiments across five representative tasks demonstrate that Zeus consistently achieves competitive results in tuning-free settings, underscoring its potential as a general-purpose TSFM.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 57 of its 82 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

57 of 82 references.

References · 57

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  6. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  7. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  8. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  9. 2020GLU Variants Improve Transformercited by 1,724
  10. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  11. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  12. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
38 more
  1. 2020On Layer Normalization in the Transformer Architecturecited by 906
  2. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  3. 2024Chronos: Learning the Language of Time Seriescited by 712
  4. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  5. 2023A decoder-only foundation model for time-series forecastingcited by 650
  6. 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
  7. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  8. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  9. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
  10. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  11. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
  12. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
  13. 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 387
  14. 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
  15. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
  16. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
  17. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
  18. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 170
  19. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 168
  20. 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 163
  21. 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
  22. 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 149
  23. 2020Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progresscited by 148
  24. 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 120
  25. 2023Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity Analysiscited by 113
  26. 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 107
  27. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 93
  28. 2024TSLANet: Rethinking Transformers for Time Series Representation Learningcited by 71
  29. 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 57
  30. 2023DSformer: A Double Sampling Transformer for Multivariate Time Series Long-term Predictioncited by 49
  31. 2021Learning Quantile Functions without Quantile Crossing for Distribution-free Time Series Forecastingcited by 32
  32. 2024Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenizationcited by 26
  33. 2021A Multi-view Multi-task Learning Framework for Multi-variate Time Series Forecastingcited by 21
  34. 2023Disentangling Structured Components: Towards Adaptive, Interpretable and Scalable Time Series Forecastingcited by 19
  35. 2025Merlin: Multi-View Representation Learning for Robust Multivariate Time Series Forecasting with Unfixed Missing Ratescited by 19
  36. 2025BLAST: Balanced Sampling Time Series Corpus for Universal Forecasting Modelscited by 16
  37. 2023HUTFormer: Hierarchical U-Net Transformer for Long-Term Traffic Forecastingcited by 12
  38. 2024Abstracted Shapes as Tokens -- A Generalizable and Interpretable Model for Time-series Classificationcited by 12

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.