Modeling Temporal Dependencies within the Target for Long-Term Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Long-term time series forecasting (LTSF) is a critical task across diverse domains. Despite significant advancements in LTSF research, we identify a performance bottleneck in existing LTSF methods caused by the inadequate modeling of Temporal Dependencies within the Target (TDT). To address this issue, we propose a novel and generic temporal modeling framework, Temporal Dependency Alignment (TDAlign), that equips existing LTSF methods with TDT learning capabilities. TDAlign introduces two key innovations: 1) a loss function that aligns the change values between adjacent time steps in the predictions with those in the target, ensuring consistency with variation patterns, and 2) an adaptive loss balancing strategy that seamlessly integrates the new loss function with existing LTSF methods without introducing additional learnable parameters. As a plug-and-play framework, TDAlign enhances existing methods with minimal computational overhead, featuring only linear time complexity and constant space complexity relative to the prediction length. Extensive experiments on six strong LTSF baselines across seven real-world datasets demonstrate the effectiveness and flexibility of TDAlign. On average, TDAlign reduces baseline prediction errors by 1.47% to 9.19% and change value errors by 4.57% to 15.78%, highlighting its substantial performance improvements.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 37 of its 57 references that are in the map. First posted on arXiv 7 Jun 2024.
Builds on
37 of 57 references.
References · 37
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
25 more
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023A decoder-only foundation model for time-series forecastingcited by 650
- 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
- 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
- 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 270
- 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
- 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 149
- 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 136
- 2023Non-autoregressive Conditional Diffusion Models for Time Series Predictioncited by 77
- 2024FreDF: Learning to Forecast in the Frequency Domaincited by 77
- 2019Shape and Time Distortion Loss for Training Deep Time Series Forecasting Modelscited by 66
- 2022A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyondcited by 64
- 2023SegRNN: Segment Recurrent Neural Network for Long-Term Time Series Forecastingcited by 53
- 2022A Comprehensive Survey of Regression Based Loss Functions for Time Series Forecastingcited by 33
- 2022On the Learning of Non-Autoregressive Transformerscited by 27
- 2021A Multi-view Multi-task Learning Framework for Multi-variate Time Series Forecastingcited by 21
- 2022Multi-scale Attention Flow for Probabilistic Time Series Forecastingcited by 19
- 2024RobustTSF: Towards Theory and Design of Robust Time Series Forecasting with Anomaliescited by 17
- 2024Continual Learning for Smart City: A Surveycited by 9
- 2024A Survey of Route Recommendations: Methods, Applications, and Opportunitiescited by 5
- 2023Neural Differential Recurrent Neural Network with Adaptive Time Stepscited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Out-of-Distribution Generalization in Time Series: A Surveycited by 15
- 2026Deep Time-series Forecasting Needs Kernelized Moment Balancingcited by 2
- 2026Multivariate Time Series Forecasting needs Cross Variable Losscited by 1
- 2025ERIS: An Energy-Guided Feature Disentanglement Framework for Out-of-Distribution Time Series Classificationcited by 0
- 2026Deep Time-Series Forecasting in 10 Years: A Surveycited by 0
- 2026CoRe: Coherence and Relational Alignment for Multivariate Time Series Forecastingcited by 0
- 2026CoRe: Coherence and Relational Alignment for Multivariate Time Series Forecasting17 Sep 2026
- 2026Multivariate Time Series Forecasting needs Cross Variable Loss6 Aug 2026
- 2026Deep Time-Series Forecasting in 10 Years: A Survey20 Mar 2026
- 2026Deep Time-series Forecasting Needs Kernelized Moment Balancing31 Jan 2026
- 2025ERIS: An Energy-Guided Feature Disentanglement Framework for Out-of-Distribution Time Series Classification19 Aug 2025
- 2025Out-of-Distribution Generalization in Time Series: A Survey18 Mar 2025