mlsanityData to 7 Oct 2026

Seasonal Encoder-Decoder Architecture for Forecasting

arXiv 2207.04113 ↗First posted 8 Jul 2022cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning (DL) in general and Recurrent neural networks (RNNs) in particular have seen high success levels in sequence based applications. This paper pertains to RNNs for time series modelling and forecasting. We propose a novel RNN architecture capturing (stochastic) seasonal correlations intelligently while capable of accurate multi-step forecasting. It is motivated from the well-known encoder-decoder (ED) architecture and multiplicative seasonal auto-regressive model. It incorporates multi-step (multi-target) learning even in the presence (or absence) of exogenous inputs. It can be employed on single or multiple sequence data. For the multiple sequence case, we also propose a novel greedy recursive procedure to build (one or more) predictive models across sequences when per-sequence data is less. We demonstrate via extensive experiments the utility of our proposed architecture both in single sequence and multiple sequence scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 38 references that are in the map. First posted on arXiv 8 Jul 2022.

Builds on

17 of 38 references.

References · 17

  1. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  2. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  3. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  4. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  5. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  6. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  7. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  8. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  9. 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
  10. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 548
  11. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  12. 2014Unifying Visual-Semantic Embeddings with Multimodal Neural Language Modelscited by 197
5 more
  1. 2019Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecastingcited by 161
  2. 2017Conditional Time Series Forecasting with Convolutional Neural Networkscited by 121
  3. 2018Light Gated Recurrent Units for Speech Recognitioncited by 48
  4. 2016Survey on the attention based RNN model and its applications in computer visioncited by 14
  5. 2017Position-based Content Attention for Time Series Forecasting with Sequence-to-sequence RNNscited by 7

Built on by

Not cited yet.