mlsanityData to 14 Oct 2026

Improving the Transferability of Time Series Forecasting with Decomposition Adaptation

arXiv 2307.00066 ↗First posted 30 Jun 2023cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Due to effective pattern mining and feature representation, neural forecasting models based on deep learning have achieved great progress. The premise of effective learning is to collect sufficient data. However, in time series forecasting, it is difficult to obtain enough data, which limits the performance of neural forecasting models. To alleviate the data scarcity limitation, we design Sequence Decomposition Adaptation Network (SeDAN) which is a novel transfer architecture to improve forecasting performance on the target domain by aligning transferable knowledge from cross-domain datasets. Rethinking the transferability of features in time series data, we propose Implicit Contrastive Decomposition to decompose the original features into components including seasonal and trend features, which are easier to transfer. Then we design the corresponding adaptation methods for decomposed features in different domains. Specifically, for seasonal features, we perform joint distribution adaptation and for trend features, we design an Optimal Local Adaptation. We conduct extensive experiments on five benchmark datasets for multivariate time series forecasting. The results demonstrate the effectiveness of our SeDAN. It can provide more efficient and stable knowledge transfer.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 56 references that are in the map. First posted on arXiv 30 Jun 2023.

Builds on

41 of 56 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  6. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  7. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  8. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  9. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  10. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  11. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  12. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
29 more
  1. 2020Reformer: The Efficient Transformercited by 1,668
  2. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  3. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,329
  4. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
  5. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  6. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  7. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
  8. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  9. 2020Self-supervised Learning: Generative or Contrastivecited by 694
  10. 2016Deep Transfer Learning with Joint Adaptation Networkscited by 612
  11. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
  12. 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 600
  13. 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 599
  14. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
  15. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
  16. 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 273
  17. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 269
  18. 2020Time Series Data Augmentation for Deep Learning: A Surveycited by 226
  19. 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 224
  20. 2021AdaRNN: Adaptive Learning and Forecasting of Time Seriescited by 121
  21. 2020A Review of Single-Source Deep Unsupervised Visual Domain Adaptationcited by 96
  22. 2017Dilated Recurrent Neural Networkscited by 83
  23. 2018Trellis Networks for Sequence Modelingcited by 52
  24. 2020Time Series Domain Adaptation via Sparse Associative Structure Alignmentcited by 51
  25. 2021Self-supervised Autoregressive Domain Adaptation for Time Series Datacited by 29
  26. 2021CALDA: Improving Multi-Source Time Series Domain Adaptation with Contrastive Adversarial Learningcited by 23
  27. 2016The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Processcited by 13
  28. 2017Neural Decomposition of Time-Series Data for Effective Generalizationcited by 9
  29. 2020Probabilistic Time Series Forecasting with Structured Shape and Temporal Diversitycited by 9

Built on by

Not cited yet.