Zeus: Towards Tuning-Free Foundation Model for Time Series Analysis
Not on the map. Why?
Abstract (arXiv)
We present Zeus, a unified tuning-free Time Series Foundation Model (TSFM) that delivers superior performance across diverse analysis tasks without any task-specific fine-tuning. Unlike prior studies that primarily focus on zero-shot forecasting but require task-specific tuning for other tasks, Zeus bridges this gap by addressing two fundamental challenges in multi-task generalization. First, to reconcile point-level granularity with long-sequence scalability, Zeus incorporates a multi-scale Transformer featuring point-wise tokenization and a U-shaped hierarchy, effectively balancing fine-grained fidelity with computational efficiency. Second, to accommodate varying inductive biases across different tasks, Zeus introduces Multi-Objective Temporal Masking (MOTM), a unified strategy that supports heterogeneous tasks (e.g., extrapolation, interpolation, and global abstraction) within a single framework. Extensive experiments across five representative tasks demonstrate that Zeus consistently achieves competitive results in tuning-free settings, underscoring its potential as a general-purpose TSFM.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 57 of its 82 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
57 of 82 references.
References · 57
- 2017Attention Is All You Needcited by 59,932
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2020GLU Variants Improve Transformercited by 1,724
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
38 more
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023A decoder-only foundation model for time-series forecastingcited by 650
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
- 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 387
- 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
- 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
- 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
- 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 170
- 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 168
- 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 163
- 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
- 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 149
- 2020Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progresscited by 148
- 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 120
- 2023Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity Analysiscited by 113
- 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 107
- 2024UniTS: A Unified Multi-Task Time Series Modelcited by 93
- 2024TSLANet: Rethinking Transformers for Time Series Representation Learningcited by 71
- 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 57
- 2023DSformer: A Double Sampling Transformer for Multivariate Time Series Long-term Predictioncited by 49
- 2021Learning Quantile Functions without Quantile Crossing for Distribution-free Time Series Forecastingcited by 32
- 2024Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenizationcited by 26
- 2021A Multi-view Multi-task Learning Framework for Multi-variate Time Series Forecastingcited by 21
- 2023Disentangling Structured Components: Towards Adaptive, Interpretable and Scalable Time Series Forecastingcited by 19
- 2025Merlin: Multi-View Representation Learning for Robust Multivariate Time Series Forecasting with Unfixed Missing Ratescited by 19
- 2025BLAST: Balanced Sampling Time Series Corpus for Universal Forecasting Modelscited by 16
- 2023HUTFormer: Hierarchical U-Net Transformer for Long-Term Traffic Forecastingcited by 12
- 2024Abstracted Shapes as Tokens -- A Generalizable and Interpretable Model for Time-series Classificationcited by 12
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.