An Attention Free Long Short-Term Memory for Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Deep learning is playing an increasingly important role in time series analysis. We focused on time series forecasting using attention free mechanism, a more efficient framework, and proposed a new architecture for time series prediction for which linear models seem to be unable to capture the time dependence. We proposed an architecture built using attention free LSTM layers that overcome linear models for conditional variance prediction. Our findings confirm the validity of our model, which also allowed to improve the prediction capacity of a LSTM, while improving the efficiency of the learning task.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 5 of its 15 references that are in the map. First posted on arXiv 20 Sep 2022.
Builds on
5 of 15 references.
References · 5
- 2017Attention Is All You Needcited by 60,361
- 2016Layer Normalizationcited by 5,669
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2019Attention Augmented Convolutional Networkscited by 363
- 2021An Attention Free Transformercited by 112
Built on by
Citing papers per year: 2023: 1; 2024: 2.
3 papers.