mlsanityData to 14 Oct 2026

PGN: The RNN's New Successor is Effective for Long-Range Time Series Forecasting

arXiv 2409.17703 ↗First posted 26 Sep 2024cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Due to the recurrent structure of RNN, the long information propagation path poses limitations in capturing long-term dependencies, gradient explosion/vanishing issues, and inefficient sequential execution. Based on this, we propose a novel paradigm called Parallel Gated Network (PGN) as the new successor to RNN. PGN directly captures information from previous time steps through the designed Historical Information Extraction (HIE) layer and leverages gated mechanisms to select and fuse it with the current time step information. This reduces the information propagation path to O(1), effectively addressing the limitations of RNN. To enhance PGN's performance in long-range time series forecasting tasks, we propose a novel temporal modeling framework called Temporal PGN (TPGN). TPGN incorporates two branches to comprehensively capture the semantic information of time series. One branch utilizes PGN to capture long-term periodic patterns while preserving their local characteristics. The other branch employs patches to capture short-term information and aggregate the global representation of the series. TPGN achieves a theoretical complexity of O(√L), ensuring efficiency in its operations. Experimental results on five benchmark datasets demonstrate the state-of-the-art (SOTA) performance and high efficiency of TPGN, further confirming the effectiveness of PGN as the new successor to RNN in long-range time series forecasting. The code is available in this repository: urlhttps://github.com/Water2sea/TPGN.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 24 of its 41 references that are in the map. First posted on arXiv 26 Sep 2024.

Builds on

24 of 41 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  7. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  8. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  9. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  10. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  11. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  12. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
12 more
  1. 2015Deep Learning and the Information Bottleneck Principlecited by 802
  2. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
  3. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  4. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 269
  5. 2023FITS: Modeling Time Series with 10k Parameterscited by 195
  6. 2019Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecastingcited by 161
  7. 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
  8. 2023FourierGNN: Rethinking Multivariate Time Series Forecasting from a Pure Graph Perspectivecited by 127
  9. 2017Dilated Recurrent Neural Networkscited by 83
  10. 2023SegRNN: Segment Recurrent Neural Network for Long-Term Time Series Forecastingcited by 55
  11. 2023BasisFormer: Attention-based Time Series Forecasting with Learnable and Interpretable Basiscited by 41
  12. 2018Sliced Recurrent Neural Networkscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.