mlsanityData to 7 Oct 2026

Neural forecasting at scale

arXiv 2109.09705 ↗First posted 20 Sep 2021cs.LG cs.DC cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

We study the problem of efficiently scaling ensemble-based deep neural networks for multi-step time series (TS) forecasting on a large set of time series. Current state-of-the-art deep ensemble models have high memory and computational requirements, hampering their use to forecast millions of TS in practical scenarios. We propose N-BEATS(P), a global parallel variant of the N-BEATS model designed to allow simultaneous training of multiple univariate TS forecasting models. Our model addresses the practical limitations of related models, reducing the training time by half and memory requirement by a factor of 5, while keeping the same level of accuracy in all TS forecasting settings. We have performed multiple experiments detailing the various ways to train our model and have obtained results that demonstrate its capacity to generalize in various forecasting conditions and setups.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 97 references that are in the map. First posted on arXiv 20 Sep 2021.

Builds on

18 of 97 references.

References · 18

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  3. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  4. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  5. 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
  6. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  7. 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 488
  8. 2014Breaking the Curse of Dimensionality with Convex Neural Networkscited by 329
  9. 2014Identifying and attacking the saddle point problem in high-dimensional non-convex optimizationcited by 286
  10. 2014The Loss Surfaces of Multilayer Networkscited by 278
  11. 2020Challenges in Deploying Machine Learning: a Survey of Case Studiescited by 151
  12. 2020Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Casecited by 129
6 more
  1. 2019Deep Factors for Forecastingcited by 86
  2. 2020Meta-learning framework with applications to zero-shot time-series forecastingcited by 70
  3. 2020Principles and Algorithms for Forecasting Groups of Time Series: Locality and Globalitycited by 70
  4. 2019Shape and Time Distortion Loss for Training Deep Time Series Forecasting Modelscited by 66
  5. 2019Transfer Learning for Clinical Time Series Analysis using Deep Neural Networkscited by 22
  6. 2019Energy Predictive Models with Limited Data using Transfer Learningcited by 7

Built on by

Not cited yet.