Meta-Forecasting by combining Global Deep Representations with Local Adaptation
Not on the map. Why?
Abstract (arXiv)
While classical time series forecasting considers individual time series in isolation, recent advances based on deep learning showed that jointly learning from a large pool of related time series can boost the forecasting accuracy. However, the accuracy of these methods suffers greatly when modeling out-of-sample time series, significantly limiting their applicability compared to classical forecasting methods. To bridge this gap, we adopt a meta-learning view of the time series forecasting problem. We introduce a novel forecasting method, called Meta Global-Local Auto-Regression (Meta-GLAR), that adapts to each time series by learning in closed-form the mapping from the representations produced by a recurrent neural network (RNN) to one-step-ahead forecasts. Crucially, the parameters ofthe RNN are learned across multiple time series by backpropagating through the closed-form adaptation mechanism. In our extensive empirical evaluation we show that our method is competitive with the state-of-the-art in out-of-sample forecasting accuracy reported in earlier work.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 25 of its 47 references that are in the map. First posted on arXiv 5 Nov 2021.
Builds on
25 of 47 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2018On First-Order Meta-Learning Algorithmscited by 1,003
- 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 779
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
- 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
13 more
- 2019Differentiable Convex Optimization Layerscited by 458
- 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 435
- 2018Meta-learning with differentiable closed-form solverscited by 395
- 2019Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLcited by 359
- 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
- 2019Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecastingcited by 161
- 2019Deep Factors for Forecastingcited by 86
- 2020Meta-learning framework with applications to zero-shot time-series forecastingcited by 70
- 2016Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activationscited by 54
- 2020Few-shot Learning for Time-series Forecastingcited by 15
- 2019Meta Learning with Differentiable Closed-form Solver for Fast Video Object Segmentationcited by 6
- 2021Representation based meta-learning for few-shot spoken intent recognitioncited by 5
- 2019Learning Feature Embeddings for Discriminant Model based Trackingcited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 1.
5 papers.
- 2022Learning Deep Time-index Models for Time Series Forecastingcited by 18
- 2024Joint Estimation and Prediction of City-wide Delivery Demand: A Large Language Model Empowered Graph-based Learning Approachcited by 6
- 2023Cross-Frequency Time Series Meta-Forecastingcited by 5
- 2023Handling Concept Drift in Global Time Series Forecastingcited by 4
- 2023Forecasting Early with Meta Learningcited by 0
- 2024Joint Estimation and Prediction of City-wide Delivery Demand: A Large Language Model Empowered Graph-based Learning Approach30 Aug 2024
- 2023Forecasting Early with Meta Learning19 Jul 2023
- 2023Handling Concept Drift in Global Time Series Forecasting4 Apr 2023
- 2023Cross-Frequency Time Series Meta-Forecasting4 Feb 2023
- 2022Learning Deep Time-index Models for Time Series Forecasting13 Jul 2022