mlsanityData to 7 Oct 2026

Progressive Neural Network for Multi-Horizon Time Series Forecasting

arXiv 2310.19322 ↗First posted 30 Oct 2023cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

In this paper, we introduce ProNet, an novel deep learning approach designed for multi-horizon time series forecasting, adaptively blending autoregressive (AR) and non-autoregressive (NAR) strategies. Our method involves dividing the forecasting horizon into segments, predicting the most crucial steps in each segment non-autoregressively, and the remaining steps autoregressively. The segmentation process relies on latent variables, which effectively capture the significance of individual time steps through variational inference. In comparison to AR models, ProNet showcases remarkable advantages, requiring fewer AR iterations, resulting in faster prediction speed, and mitigating error accumulation. On the other hand, when compared to NAR models, ProNet takes into account the interdependency of predictions in the output space, leading to improved forecasting accuracy. Our comprehensive evaluation, encompassing four large datasets, and an ablation study, demonstrate the effectiveness of ProNet, highlighting its superior performance in terms of accuracy and prediction speed, outperforming state-of-the-art AR and NAR forecasting models.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 52 references that are in the map. First posted on arXiv 30 Oct 2023.

Builds on

25 of 52 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  4. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  5. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 779
  6. 2016Sequence-Level Knowledge Distillationcited by 761
  7. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  8. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  9. 2017Non-Autoregressive Neural Machine Translationcited by 457
  10. 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 332
  11. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  12. 2022SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Controlcited by 191
13 more
  1. 2020Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translationcited by 104
  2. 2018Fast Decoding in Sequence Models using Discrete Latent Variablescited by 103
  3. 2020Fully Non-autoregressive Neural Machine Translation: Tricks of the Tradecited by 99
  4. 2019Deep Factors for Forecastingcited by 86
  5. 2018Semi-Autoregressive Neural Machine Translationcited by 48
  6. 2020A Study of Non-autoregressive Model for Sequence Generationcited by 31
  7. 2020Learning to Recover from Multi-Modality Errors for Non-Autoregressive Neural Machine Translationcited by 19
  8. 2021SSDNet: State Space Decomposition Neural Network for Time Series Forecastingcited by 15
  9. 2021Semi-Autoregressive Transformer for Image Captioningcited by 12
  10. 2022Probabilistic Decomposition Transformer for Time Series Forecastingcited by 6
  11. 2021Random vector functional link neural network based ensemble deep learning for short-term load forecastingcited by 5
  12. 2022A Decomposition-Based Hybrid Ensemble CNN Framework for Driver Fatigue Recognitioncited by 4
  13. 2020A Study on the Autoregressive and non-Autoregressive Multi-label Learningcited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.