mlsanityData to 14 Oct 2026

xLSTMTime : Long-term Time Series Forecasting With xLSTM

arXiv 2407.10240 ↗First posted 14 Jul 2024cs.LG cs.AIcited by 14

Not on the map. Why?

Abstract (arXiv)

In recent years, transformer-based models have gained prominence in multivariate long-term time series forecasting (LTSF), demonstrating significant advancements despite facing challenges such as high computational demands, difficulty in capturing temporal dynamics, and managing long-term dependencies. The emergence of LTSF-Linear, with its straightforward linear architecture, has notably outperformed transformer-based counterparts, prompting a reevaluation of the transformer's utility in time series forecasting. In response, this paper presents an adaptation of a recent architecture termed extended LSTM (xLSTM) for LTSF. xLSTM incorporates exponential gating and a revised memory structure with higher capacity that has good potential for LTSF. Our adopted architecture for LTSF termed as xLSTMTime surpasses current approaches. We compare xLSTMTime's performance against various state-of-the-art models across multiple real-world da-tasets, demonstrating superior forecasting capabilities. Our findings suggest that refined recurrent architectures can offer competitive alternatives to transformer-based models in LTSF tasks, po-tentially redefining the landscape of time series forecasting.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 17 of its 28 references that are in the map. First posted on arXiv 14 Jul 2024.

Builds on

17 of 28 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  3. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  8. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  9. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  10. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  11. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  12. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
5 more
  1. 2024xLSTM: Extended Long Short-Term Memorycited by 327
  2. 2019Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directionscited by 172
  3. 2017Conditional Time Series Forecasting with Convolutional Neural Networkscited by 123
  4. 2023Effectively Modeling Time Series with Simple Discrete State Spacescited by 54
  5. 2019Recurrent Neural Networks for Time Series Forecastingcited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 10; 2026: 3.

14 papers.

Sort:

By area: