Towards Better Long-range Time Series Forecasting using Generative Adversarial Networks
Not on the map. Why?
Abstract (arXiv)
Long-range time series forecasting is usually based on one of two existing forecasting strategies: Direct Forecasting and Iterative Forecasting, where the former provides low bias, high variance forecasts and the later leads to low variance, high bias forecasts. In this paper, we propose a new forecasting strategy called Generative Forecasting (GenF), which generates synthetic data for the next few time steps and then makes long-range forecasts based on generated and observed data. We theoretically prove that GenF is able to better balance the forecasting variance and bias, leading to a much smaller forecasting error. We implement GenF via three components: (i) a novel conditional Wasserstein Generative Adversarial Network (GAN) based generator for synthetic time series data generation, called CWGAN-TS. (ii) a transformer based predictor, which makes long-range predictions using both generated and observed data. (iii) an information theoretic clustering algorithm to improve the training of both the CWGAN-TS and the transformer based predictor. The experimental results on five public datasets demonstrate that GenF significantly outperforms a diverse range of state-of-the-art benchmarks and classical approaches. Specifically, we find a 5% - 11% improvement in predictive performance (mean absolute error) while having a 15% - 50% reduction in parameters compared to the benchmarks. Lastly, we conduct an ablation study to demonstrate the effectiveness of the components comprising GenF.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 85 references that are in the map. First posted on arXiv 17 Oct 2021.
Builds on
25 of 85 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2020Reformer: The Efficient Transformercited by 1,658
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
- 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
13 more
- 2020Time Series Forecasting With Deep Learning: A Surveycited by 457
- 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 270
- 2018GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classificationcited by 242
- 2016C-RNN-GAN: Continuous recurrent neural networks with adversarial trainingcited by 132
- 2020Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Casecited by 129
- 2018Bias and Generalization in Deep Generative Models: An Empirical Studycited by 83
- 2019Shape and Time Distortion Loss for Training Deep Time Series Forecasting Modelscited by 66
- 2021Neural graphical modelling in continuous-time: consistency guarantees and algorithmscited by 42
- 2017Long-term Forecasting using Higher Order Tensor RNNscited by 34
- 2019LSTM-MSNet: Leveraging Forecasts on Sets of Related Time Series with Multiple Seasonal Patternscited by 23
- 2021Policy Analysis using Synthetic Controls in Continuous-Timecited by 18
- 2019Towards Better Forecasting by Fusing Near and Distant Future Visionscited by 14
- 2019Exploring Bias in GAN-based Data Augmentation for Small Samplescited by 7
Built on by
Not cited yet.