mlsanityData to 7 Oct 2026

Hierarchically Regularized Deep Forecasting

arXiv 2106.07630 ↗First posted 14 Jun 2021cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

Hierarchical forecasting is a key problem in many practical multivariate forecasting applications - the goal is to simultaneously predict a large number of correlated time series that are arranged in a pre-specified aggregation hierarchy. The main challenge is to exploit the hierarchical correlations to simultaneously obtain good prediction accuracy for time series at different levels of the hierarchy. In this paper, we propose a new approach for hierarchical forecasting which consists of two components. First, decomposing the time series along a global set of basis time series and modeling hierarchical constraints using the coefficients of the basis decomposition. And second, using a linear autoregressive model with coefficients that vary with time. Unlike past methods, our approach is scalable (inference for a specific time series only needs access to its own history) while also modeling the hierarchical structure via (approximate) coherence constraints among the time series forecasts. We experiment on several public datasets and demonstrate significantly improved overall performance on forecasts at different levels of the hierarchy, compared to existing state-of-the-art hierarchical models.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 22 of its 53 references that are in the map. First posted on arXiv 14 Jun 2021.

Builds on

22 of 53 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  5. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  6. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  7. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  8. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  9. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  10. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  11. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
  12. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
10 more
  1. 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 298
  2. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  3. 2020Scaling Graph Neural Networks with Approximate PageRankcited by 174
  4. 2019Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecastingcited by 161
  5. 2019High-Dimensional Multivariate Forecasting with Low-Rank Gaussian Copula Processescited by 147
  6. 2017Conditional Time Series Forecasting with Convolutional Neural Networkscited by 121
  7. 2019Deep Factors for Forecastingcited by 86
  8. 2021Simultaneously Reconciled Quantile Forecasting of Hierarchically Related Time Seriescited by 24
  9. 2019A Self-supervised Approach to Hierarchical Forecasting with Applications to Groupwise Synthetic Controlscited by 3
  10. 2021Hierarchical Dynamic Modeling for Individualized Bayesian Forecastingcited by 1

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 4; 2023: 3; 2024: 1.

9 papers.