Forecasting Early with Meta Learning
Not on the map. Why?
Abstract (arXiv)
In the early observation period of a time series, there might be only a few historic observations available to learn a model. However, in cases where an existing prior set of datasets is available, Meta learning methods can be applicable. In this paper, we devise a Meta learning method that exploits samples from additional datasets and learns to augment time series through adversarial learning as an auxiliary task for the target dataset. Our model (FEML), is equipped with a shared Convolutional backbone that learns features for varying length inputs from different datasets and has dataset specific heads to forecast for different output lengths. We show that FEML can meta learn across datasets and by additionally learning on adversarial generated samples as auxiliary samples for the target dataset, it can improve the forecasting performance compared to single task learning, and various solutions adapted from Joint learning, Multi-task learning and classic forecasting baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 19 Jul 2023.
Builds on
26 of 44 references.
References · 26
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2017Deep Setscited by 1,394
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2018On First-Order Meta-Learning Algorithmscited by 1,003
- 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
- 2018End-to-End Multi-Task Learning with Attentioncited by 533
- 2016Cross-stitch Networks for Multi-task Learningcited by 466
14 more
- 2021Monash Time Series Forecasting Archivecited by 256
- 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
- 2020Time Series Data Augmentation for Deep Learning: A Surveycited by 225
- 2017Conditional Time Series Forecasting with Convolutional Neural Networkscited by 121
- 2020Meta-learning framework with applications to zero-shot time-series forecastingcited by 70
- 2021Domain Adaptation for Time Series Forecasting via Attention Sharingcited by 68
- 2021Do We Really Need Deep Learning Models for Time Series Forecasting?cited by 45
- 2020Approaches and Applications of Early Classification of Time Series: A Reviewcited by 39
- 2019TEASER: Early and Accurate Time Series Classificationcited by 26
- 2020Few-shot Learning for Time-series Forecastingcited by 15
- 2022Few-Shot Forecasting of Time-Series with Heterogeneous Channelscited by 7
- 2021Multimodal Meta-Learning for Time Series Regressioncited by 6
- 2021Meta-Forecasting by combining Global Deep Representations with Local Adaptationcited by 5
- 2020Two-Step Meta-Learning for Time-Series Forecasting Ensemblecited by 3
Built on by
Not cited yet.