mlsanityData to 7 Oct 2026

Meta-Forecasting by combining Global Deep Representations with Local Adaptation

arXiv 2111.03418 ↗First posted 5 Nov 2021cs.LG cs.AI stat.MLcited by 5

Not on the map. Why?

Abstract (arXiv)

While classical time series forecasting considers individual time series in isolation, recent advances based on deep learning showed that jointly learning from a large pool of related time series can boost the forecasting accuracy. However, the accuracy of these methods suffers greatly when modeling out-of-sample time series, significantly limiting their applicability compared to classical forecasting methods. To bridge this gap, we adopt a meta-learning view of the time series forecasting problem. We introduce a novel forecasting method, called Meta Global-Local Auto-Regression (Meta-GLAR), that adapts to each time series by learning in closed-form the mapping from the representations produced by a recurrent neural network (RNN) to one-step-ahead forecasts. Crucially, the parameters ofthe RNN are learned across multiple time series by backpropagating through the closed-form adaptation mechanism. In our extensive empirical evaluation we show that our method is competitive with the state-of-the-art in out-of-sample forecasting accuracy reported in earlier work.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 25 of its 47 references that are in the map. First posted on arXiv 5 Nov 2021.

Builds on

25 of 47 references.

References · 25

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  4. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  5. 2016Matching Networks for One Shot Learningcited by 2,246
  6. 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
  7. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  8. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  9. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 779
  10. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  11. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  12. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
13 more
  1. 2019Differentiable Convex Optimization Layerscited by 458
  2. 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 435
  3. 2018Meta-learning with differentiable closed-form solverscited by 395
  4. 2019Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLcited by 359
  5. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
  6. 2019Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecastingcited by 161
  7. 2019Deep Factors for Forecastingcited by 86
  8. 2020Meta-learning framework with applications to zero-shot time-series forecastingcited by 70
  9. 2016Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activationscited by 54
  10. 2020Few-shot Learning for Time-series Forecastingcited by 15
  11. 2019Meta Learning with Differentiable Closed-form Solver for Fast Video Object Segmentationcited by 6
  12. 2021Representation based meta-learning for few-shot spoken intent recognitioncited by 5
  13. 2019Learning Feature Embeddings for Discriminant Model based Trackingcited by 1

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 3; 2024: 1.

5 papers.