mlsanityData to 7 Oct 2026

Modeling Temporal Dependencies within the Target for Long-Term Time Series Forecasting

arXiv 2406.04777 ↗First posted 7 Jun 2024cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Long-term time series forecasting (LTSF) is a critical task across diverse domains. Despite significant advancements in LTSF research, we identify a performance bottleneck in existing LTSF methods caused by the inadequate modeling of Temporal Dependencies within the Target (TDT). To address this issue, we propose a novel and generic temporal modeling framework, Temporal Dependency Alignment (TDAlign), that equips existing LTSF methods with TDT learning capabilities. TDAlign introduces two key innovations: 1) a loss function that aligns the change values between adjacent time steps in the predictions with those in the target, ensuring consistency with variation patterns, and 2) an adaptive loss balancing strategy that seamlessly integrates the new loss function with existing LTSF methods without introducing additional learnable parameters. As a plug-and-play framework, TDAlign enhances existing methods with minimal computational overhead, featuring only linear time complexity and constant space complexity relative to the prediction length. Extensive experiments on six strong LTSF baselines across seven real-world datasets demonstrate the effectiveness and flexibility of TDAlign. On average, TDAlign reduces baseline prediction errors by 1.47% to 9.19% and change value errors by 4.57% to 15.78%, highlighting its substantial performance improvements.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 37 of its 57 references that are in the map. First posted on arXiv 7 Jun 2024.

Builds on

37 of 57 references.

References · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  8. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  9. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  10. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  11. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  12. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
25 more
  1. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  2. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  3. 2023A decoder-only foundation model for time-series forecastingcited by 650
  4. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  5. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  6. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
  7. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
  8. 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 270
  9. 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
  10. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
  11. 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 149
  12. 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 136
  13. 2023Non-autoregressive Conditional Diffusion Models for Time Series Predictioncited by 77
  14. 2024FreDF: Learning to Forecast in the Frequency Domaincited by 77
  15. 2019Shape and Time Distortion Loss for Training Deep Time Series Forecasting Modelscited by 66
  16. 2022A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyondcited by 64
  17. 2023SegRNN: Segment Recurrent Neural Network for Long-Term Time Series Forecastingcited by 53
  18. 2022A Comprehensive Survey of Regression Based Loss Functions for Time Series Forecastingcited by 33
  19. 2022On the Learning of Non-Autoregressive Transformerscited by 27
  20. 2021A Multi-view Multi-task Learning Framework for Multi-variate Time Series Forecastingcited by 21
  21. 2022Multi-scale Attention Flow for Probabilistic Time Series Forecastingcited by 19
  22. 2024RobustTSF: Towards Theory and Design of Robust Time Series Forecasting with Anomaliescited by 17
  23. 2024Continual Learning for Smart City: A Surveycited by 9
  24. 2024A Survey of Route Recommendations: Methods, Applications, and Opportunitiescited by 5
  25. 2023Neural Differential Recurrent Neural Network with Adaptive Time Stepscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.