Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfer
Not on the map. Why?
Abstract (arXiv)
With the growing availability of multi-domain time series data, there is an increasing demand for general forecasting models pre-trained on multi-source datasets to support diverse downstream prediction scenarios. Existing time series foundation models primarily focus on scaling up pre-training datasets and model sizes to enhance generalization performance. In this paper, we take a different approach by addressing two critical aspects of general forecasting models: (1) how to derive unified representations from heterogeneous multi-domain time series data, and (2) how to effectively capture domain-specific features to enable adaptive transfer across various downstream scenarios. To address the first aspect, we propose Decomposed Frequency Learning as the pre-training task, which leverages frequency-based masking and reconstruction to decompose coupled semantic information in time series, resulting in unified representations across domains. For the second aspect, we introduce the Time Series Register, which captures domain-specific representations during pre-training and enhances adaptive transferability to downstream tasks. Our model achieves the state-of-the-art forecasting performance on seven real-world benchmarks, demonstrating remarkable few-shot and zero-shot capabilities.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 33 of its 56 references that are in the map. First posted on arXiv 24 May 2024.
Builds on
33 of 56 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
21 more
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2018The UCR Time Series Archivecited by 431
- 2018The UEA multivariate time series classification archive, 2018cited by 338
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 338
- 2021Monash Time Series Forecasting Archivecited by 267
- 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 250
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
- 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
- 2023TimeGPT-1cited by 158
- 2023SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modelingcited by 115
- 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 104
- 2024Pathformer: Multi-scale Transformers with Adaptive Pathways for Time Series Forecastingcited by 104
- 2023Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-Seriescited by 59
- 2021AutoCTS: Automated Correlated Time Series Forecasting -- Extended Versioncited by 48
- 2024A Unified Replay-based Continuous Learning Framework for Spatio-Temporal Prediction on Streaming Datacited by 39
- 2023Learning to Embed Time Series Patches Independentlycited by 35
- 2021Graph Attention Recurrent Neural Networks for Correlated Time Series Forecasting -- Full versioncited by 24
- 2023Large Pre-trained time series models for cross-domain Time series analysis taskscited by 23
- 2023Towards Diverse and Coherent Augmentation for Time-Series Forecastingcited by 7
Built on by
Citing papers per year: 2024: 3; 2025: 15; 2026: 14.
32 papers.
Sort:
By area:
- 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patchingcited by 94
- 2025Enhancing Time Series Forecasting through Selective Representation Spaces: A Patch Perspectivecited by 39
- 2025Aurora: Towards Universal Generative Multimodal Time Series Forecastingcited by 29
- 2025LangTime: A Language-Guided Unified Model for Time Series Forecasting with Proximal Policy Optimizationcited by 22
- 2025BLAST: Balanced Sampling Time Series Corpus for Universal Forecasting Modelscited by 16
- 2025Rethinking Evaluation in the Era of Time Series Foundation Models: (Un)known Information Leakage Challengescited by 16
- 2025AlphaCast: A Human Wisdom-LLM Intelligence Co-Reasoning Framework for Interactive Time Series Forecastingcited by 12
- 2024OTIS: Learning High-Quality Time Series Features With Tiny Encoderscited by 8
- 2025K2VAE: A Koopman-Kalman Enhanced Variational AutoEncoder for Probabilistic Time Series Forecastingcited by 8
- 2024User-friendly Foundation Model Adapters for Multivariate Time Series Classificationcited by 3
- 2025FLAME: Flow Enhanced Legendre Memory Models for General Time Series Forecastingcited by 3
- 2026Empowering Time Series Analysis with Large-Scale Multimodal Pretrainingcited by 3
20 more
- 2026EXAONE Finance 1.0: An Attention-free Time Series Foundation Model for Financial Time Seriescited by 3
- 2025Data Driven Decision Making with Time Series and Spatio-temporal Datacited by 2
- 2025Bridging Distribution Gaps in Time Series Foundation Model Pretraining with Prototype-Guided Normalizationcited by 2
- 2025Towards Measuring and Modeling Geometric Structures in Time Series Forecasting via Image Modalitycited by 2
- 2025Super-Linear: A Lightweight Pretrained Mixture of Linear Experts for Time Series Forecastingcited by 2
- 2026Learning to Factorize and Adapt: A Versatile Approach Toward Universal Spatio-Temporal Foundation Modelscited by 2
- 2025Unify and Anchor: A Context-Aware Transformer for Cross-Domain Time Series Forecastingcited by 1
- 2025Time Series Forecasting Through the Lens of Dynamicscited by 1
- 2026TimeRadar: A Domain-Rotatable Foundation Model for Time Series Anomaly Detectioncited by 1
- 2026Olivia: Harmonizing Time Series Foundation Models with Power Spectral Densitycited by 1
- 2026QiYao-M: Multimodal Time Series Foundation Model with Role-Aware Modeling of Endogenous and Exogenous Modalitiescited by 1
- 2025Invariant Representation Learning for Source-Free Time Series Forecasting with LLM-Centric Proxy Denoisingcited by 0
- 2026VLBM: Variational Latent Basis Modeling for OOD Robust Multivariate Time Series Forecastingcited by 0
- 2026TimeBlocks: Foundational and Continual Time-Series Blockbase -- Extended Versioncited by 0
- 2026REGAIN: REconciliation GAIN-driven Auxiliary Direction Learningcited by 0
- 2026Towards a Unified Generative Model for Scarce Time Series with Domain Expertscited by 0
- 2026When AI Designs AI: Innovation or Imitation?cited by 0
- 2026QUALS: Corpus Equilibrium for Universal Forecasting via Pattern Quantization and Learnability Synchronizationcited by 0
- 2026Aurora-X: Built for Extreme Time Series Forecastingcited by 0
- 2026QiYao-I: A Manifold Based Foundation Model for Irregular Multivariate Time Series Forecastingcited by 0
- 2026QiYao-I: A Manifold Based Foundation Model for Irregular Multivariate Time Series Forecasting3 Oct 2026
- 2026QiYao-M: Multimodal Time Series Foundation Model with Role-Aware Modeling of Endogenous and Exogenous Modalities28 Sep 2026
- 2026Aurora-X: Built for Extreme Time Series Forecasting25 Sep 2026
- 2026QUALS: Corpus Equilibrium for Universal Forecasting via Pattern Quantization and Learnability Synchronization17 Sep 2026
- 2026When AI Designs AI: Innovation or Imitation?18 Aug 2026
- 2026EXAONE Finance 1.0: An Attention-free Time Series Foundation Model for Financial Time Series4 Aug 2026
- 2026Towards a Unified Generative Model for Scarce Time Series with Domain Experts13 Jun 2026
- 2026REGAIN: REconciliation GAIN-driven Auxiliary Direction Learning3 Jun 2026
- 2026TimeBlocks: Foundational and Continual Time-Series Blockbase -- Extended Version1 Jun 2026
- 2026VLBM: Variational Latent Basis Modeling for OOD Robust Multivariate Time Series Forecasting1 Jun 2026
- 2026Olivia: Harmonizing Time Series Foundation Models with Power Spectral Density17 May 2026
- 2026TimeRadar: A Domain-Rotatable Foundation Model for Time Series Anomaly Detection22 Feb 2026
20 more
- 2026Empowering Time Series Analysis with Large-Scale Multimodal Pretraining5 Feb 2026
- 2026Learning to Factorize and Adapt: A Versatile Approach Toward Universal Spatio-Temporal Foundation Models17 Jan 2026
- 2025FLAME: Flow Enhanced Legendre Memory Models for General Time Series Forecasting16 Dec 2025
- 2025AlphaCast: A Human Wisdom-LLM Intelligence Co-Reasoning Framework for Interactive Time Series Forecasting12 Nov 2025
- 2025Enhancing Time Series Forecasting through Selective Representation Spaces: A Patch Perspective16 Oct 2025
- 2025Rethinking Evaluation in the Era of Time Series Foundation Models: (Un)known Information Leakage Challenges15 Oct 2025
- 2025Invariant Representation Learning for Source-Free Time Series Forecasting with LLM-Centric Proxy Denoising7 Oct 2025
- 2025Aurora: Towards Universal Generative Multimodal Time Series Forecasting26 Sep 2025
- 2025Super-Linear: A Lightweight Pretrained Mixture of Linear Experts for Time Series Forecasting18 Sep 2025
- 2025Towards Measuring and Modeling Geometric Structures in Time Series Forecasting via Image Modality31 Jul 2025
- 2025Time Series Forecasting Through the Lens of Dynamics21 Jul 2025
- 2025K2VAE: A Koopman-Kalman Enhanced Variational AutoEncoder for Probabilistic Time Series Forecasting29 May 2025
- 2025BLAST: Balanced Sampling Time Series Corpus for Universal Forecasting Models23 May 2025
- 2025Bridging Distribution Gaps in Time Series Foundation Model Pretraining with Prototype-Guided Normalization15 Apr 2025
- 2025Data Driven Decision Making with Time Series and Spatio-temporal Data11 Mar 2025
- 2025LangTime: A Language-Guided Unified Model for Time Series Forecasting with Proximal Policy Optimization11 Mar 2025
- 2025Unify and Anchor: A Context-Aware Transformer for Cross-Domain Time Series Forecasting3 Mar 2025
- 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patching16 Oct 2024
- 2024OTIS: Learning High-Quality Time Series Features With Tiny Encoders9 Oct 2024
- 2024User-friendly Foundation Model Adapters for Multivariate Time Series Classification18 Sep 2024
- 2026When AI Designs AI: Innovation or Imitation?cited by 0
- 2026When AI Designs AI: Innovation or Imitation?18 Aug 2026
- 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patchingcited by 94
- 2025Enhancing Time Series Forecasting through Selective Representation Spaces: A Patch Perspectivecited by 39
- 2025Aurora: Towards Universal Generative Multimodal Time Series Forecastingcited by 29
- 2025LangTime: A Language-Guided Unified Model for Time Series Forecasting with Proximal Policy Optimizationcited by 22
- 2025BLAST: Balanced Sampling Time Series Corpus for Universal Forecasting Modelscited by 16
- 2024OTIS: Learning High-Quality Time Series Features With Tiny Encoderscited by 8
- 2025K2VAE: A Koopman-Kalman Enhanced Variational AutoEncoder for Probabilistic Time Series Forecastingcited by 8
- 2024User-friendly Foundation Model Adapters for Multivariate Time Series Classificationcited by 3
- 2025FLAME: Flow Enhanced Legendre Memory Models for General Time Series Forecastingcited by 3
- 2026Empowering Time Series Analysis with Large-Scale Multimodal Pretrainingcited by 3
- 2026EXAONE Finance 1.0: An Attention-free Time Series Foundation Model for Financial Time Seriescited by 3
- 2025Data Driven Decision Making with Time Series and Spatio-temporal Datacited by 2
12 most cited of 28 All 28 (JSON)
- 2026QiYao-I: A Manifold Based Foundation Model for Irregular Multivariate Time Series Forecasting3 Oct 2026
- 2026QiYao-M: Multimodal Time Series Foundation Model with Role-Aware Modeling of Endogenous and Exogenous Modalities28 Sep 2026
- 2026Aurora-X: Built for Extreme Time Series Forecasting25 Sep 2026
- 2026QUALS: Corpus Equilibrium for Universal Forecasting via Pattern Quantization and Learnability Synchronization17 Sep 2026
- 2026EXAONE Finance 1.0: An Attention-free Time Series Foundation Model for Financial Time Series4 Aug 2026
- 2026Towards a Unified Generative Model for Scarce Time Series with Domain Experts13 Jun 2026
- 2026REGAIN: REconciliation GAIN-driven Auxiliary Direction Learning3 Jun 2026
- 2026TimeBlocks: Foundational and Continual Time-Series Blockbase -- Extended Version1 Jun 2026
- 2026VLBM: Variational Latent Basis Modeling for OOD Robust Multivariate Time Series Forecasting1 Jun 2026
- 2026Olivia: Harmonizing Time Series Foundation Models with Power Spectral Density17 May 2026
- 2026TimeRadar: A Domain-Rotatable Foundation Model for Time Series Anomaly Detection22 Feb 2026
- 2026Empowering Time Series Analysis with Large-Scale Multimodal Pretraining5 Feb 2026
12 newest of 28 All 28 (JSON)