mlsanityData to 14 Oct 2026

Disentangled Parameter-Efficient Linear Model for Long-Term Time Series Forecasting

arXiv 2411.17257 ↗First posted 26 Nov 2024cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Long-term Time Series Forecasting (LTSF) is crucial across various domains, but complex deep models like Transformers are often prone to overfitting on extended sequences. Linear Fully Connected models have emerged as a powerful alternative, achieving competitive results with fewer parameters. However, their reliance on a single, monolithic weight matrix leads to quadratic parameter redundancy and an entanglement of temporal and frequential properties. To address this, we propose DiPE-Linear, a novel model that disentangles this monolithic mapping into a sequence of specialized, parameter-efficient modules. DiPE-Linear features three core components: Static Frequential Attention to prioritize critical frequencies, Static Time Attention to focus on key time steps, and Independent Frequential Mapping to independently process frequency components. A Low-rank Weight Sharing policy further enhances efficiency for multivariate data. This disentangled architecture collectively reduces parameter complexity from quadratic to linear and computational complexity to log-linear. Experiments on real-world datasets show that DiPE-Linear delivers state-of-the-art performance with significantly fewer parameters, establishing a new and highly efficient baseline for LTSF. Our code is available at https://github.com/wintertee/DiPE-Linear/

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 21 of its 26 references that are in the map. First posted on arXiv 26 Nov 2024.

Builds on

21 of 26 references.

References · 21

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  5. 2020Reformer: The Efficient Transformercited by 1,668
  6. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  7. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  8. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  9. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  10. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
  11. 2019Dynamic Convolution: Attention over Convolution Kernelscited by 356
  12. 2023FITS: Modeling Time Series with 10k Parameterscited by 195
9 more
  1. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
  2. 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 116
  3. 2024SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameterscited by 107
  4. 2024FreDF: Learning to Forecast in the Frequency Domaincited by 79
  5. 2024An Analysis of Linear Time Series Forecasting Modelscited by 41
  6. 2023Mixture-of-Linear-Experts for Long-term Time Series Forecastingcited by 29
  7. 2024FTMixer: Frequency and Time Domain Representations Fusion for Time Series Modelingcited by 4
  8. 2023Mlinear: Rethink the Linear Model for Time-series Forecastingcited by 3
  9. 2023Is Channel Independent strategy optimal for Time Series Forecasting?cited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.