mlsanityData to 14 Oct 2026

Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfer

arXiv 2405.17478 ↗First posted 24 May 2024cs.LG stat.MLcited by 32

Not on the map. Why?

Abstract (arXiv)

With the growing availability of multi-domain time series data, there is an increasing demand for general forecasting models pre-trained on multi-source datasets to support diverse downstream prediction scenarios. Existing time series foundation models primarily focus on scaling up pre-training datasets and model sizes to enhance generalization performance. In this paper, we take a different approach by addressing two critical aspects of general forecasting models: (1) how to derive unified representations from heterogeneous multi-domain time series data, and (2) how to effectively capture domain-specific features to enable adaptive transfer across various downstream scenarios. To address the first aspect, we propose Decomposed Frequency Learning as the pre-training task, which leverages frequency-based masking and reconstruction to decompose coupled semantic information in time series, resulting in unified representations across domains. For the second aspect, we introduce the Time Series Register, which captures domain-specific representations during pre-training and enhances adaptive transferability to downstream tasks. Our model achieves the state-of-the-art forecasting performance on seven real-world benchmarks, demonstrating remarkable few-shot and zero-shot capabilities.

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 33 of its 56 references that are in the map. First posted on arXiv 24 May 2024.

Builds on

33 of 56 references.

References · 33

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  5. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  6. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  7. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  8. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  9. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  10. 2024Chronos: Learning the Language of Time Seriescited by 759
  11. 2023A decoder-only foundation model for time-series forecastingcited by 692
  12. 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
21 more
  1. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  2. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  3. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  4. 2018The UCR Time Series Archivecited by 431
  5. 2018The UEA multivariate time series classification archive, 2018cited by 338
  6. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 338
  7. 2021Monash Time Series Forecasting Archivecited by 267
  8. 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 250
  9. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
  10. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  11. 2023TimeGPT-1cited by 158
  12. 2023SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modelingcited by 115
  13. 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 104
  14. 2024Pathformer: Multi-scale Transformers with Adaptive Pathways for Time Series Forecastingcited by 104
  15. 2023Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-Seriescited by 59
  16. 2021AutoCTS: Automated Correlated Time Series Forecasting -- Extended Versioncited by 48
  17. 2024A Unified Replay-based Continuous Learning Framework for Spatio-Temporal Prediction on Streaming Datacited by 39
  18. 2023Learning to Embed Time Series Patches Independentlycited by 35
  19. 2021Graph Attention Recurrent Neural Networks for Correlated Time Series Forecasting -- Full versioncited by 24
  20. 2023Large Pre-trained time series models for cross-domain Time series analysis taskscited by 23
  21. 2023Towards Diverse and Coherent Augmentation for Time-Series Forecastingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 15; 2026: 14.

32 papers.

Sort:

By area:

  1. 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patchingcited by 94
  2. 2025Enhancing Time Series Forecasting through Selective Representation Spaces: A Patch Perspectivecited by 39
  3. 2025Aurora: Towards Universal Generative Multimodal Time Series Forecastingcited by 29
  4. 2025LangTime: A Language-Guided Unified Model for Time Series Forecasting with Proximal Policy Optimizationcited by 22
  5. 2025BLAST: Balanced Sampling Time Series Corpus for Universal Forecasting Modelscited by 16
  6. 2025Rethinking Evaluation in the Era of Time Series Foundation Models: (Un)known Information Leakage Challengescited by 16
  7. 2025AlphaCast: A Human Wisdom-LLM Intelligence Co-Reasoning Framework for Interactive Time Series Forecastingcited by 12
  8. 2024OTIS: Learning High-Quality Time Series Features With Tiny Encoderscited by 8
  9. 2025K2VAE: A Koopman-Kalman Enhanced Variational AutoEncoder for Probabilistic Time Series Forecastingcited by 8
  10. 2024User-friendly Foundation Model Adapters for Multivariate Time Series Classificationcited by 3
  11. 2025FLAME: Flow Enhanced Legendre Memory Models for General Time Series Forecastingcited by 3
  12. 2026Empowering Time Series Analysis with Large-Scale Multimodal Pretrainingcited by 3
20 more
  1. 2026EXAONE Finance 1.0: An Attention-free Time Series Foundation Model for Financial Time Seriescited by 3
  2. 2025Data Driven Decision Making with Time Series and Spatio-temporal Datacited by 2
  3. 2025Bridging Distribution Gaps in Time Series Foundation Model Pretraining with Prototype-Guided Normalizationcited by 2
  4. 2025Towards Measuring and Modeling Geometric Structures in Time Series Forecasting via Image Modalitycited by 2
  5. 2025Super-Linear: A Lightweight Pretrained Mixture of Linear Experts for Time Series Forecastingcited by 2
  6. 2026Learning to Factorize and Adapt: A Versatile Approach Toward Universal Spatio-Temporal Foundation Modelscited by 2
  7. 2025Unify and Anchor: A Context-Aware Transformer for Cross-Domain Time Series Forecastingcited by 1
  8. 2025Time Series Forecasting Through the Lens of Dynamicscited by 1
  9. 2026TimeRadar: A Domain-Rotatable Foundation Model for Time Series Anomaly Detectioncited by 1
  10. 2026Olivia: Harmonizing Time Series Foundation Models with Power Spectral Densitycited by 1
  11. 2026QiYao-M: Multimodal Time Series Foundation Model with Role-Aware Modeling of Endogenous and Exogenous Modalitiescited by 1
  12. 2025Invariant Representation Learning for Source-Free Time Series Forecasting with LLM-Centric Proxy Denoisingcited by 0
  13. 2026VLBM: Variational Latent Basis Modeling for OOD Robust Multivariate Time Series Forecastingcited by 0
  14. 2026TimeBlocks: Foundational and Continual Time-Series Blockbase -- Extended Versioncited by 0
  15. 2026REGAIN: REconciliation GAIN-driven Auxiliary Direction Learningcited by 0
  16. 2026Towards a Unified Generative Model for Scarce Time Series with Domain Expertscited by 0
  17. 2026When AI Designs AI: Innovation or Imitation?cited by 0
  18. 2026QUALS: Corpus Equilibrium for Universal Forecasting via Pattern Quantization and Learnability Synchronizationcited by 0
  19. 2026Aurora-X: Built for Extreme Time Series Forecastingcited by 0
  20. 2026QiYao-I: A Manifold Based Foundation Model for Irregular Multivariate Time Series Forecastingcited by 0