mlsanityData to 14 Oct 2026

GAT-GAN : A Graph-Attention-based Time-Series Generative Adversarial Network

arXiv 2306.01999 ↗First posted 3 Jun 2023cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Generative Adversarial Networks (GANs) have proven to be a powerful tool for generating realistic synthetic data. However, traditional GANs often struggle to capture complex relationships between features which results in generation of unrealistic multivariate time-series data. In this paper, we propose a Graph-Attention-based Generative Adversarial Network (GAT-GAN) that explicitly includes two graph-attention layers, one that learns temporal dependencies while the other captures spatial relationships. Unlike RNN-based GANs that struggle with modeling long sequences of data points, GAT-GAN generates long time-series data of high fidelity using an adversarially trained autoencoder architecture. Our empirical evaluations, using a variety of real-time-series datasets, show that our framework consistently outperforms state-of-the-art benchmarks based on Frechet Transformer distance and Predictive score, that characterizes (Fidelity, Diversity) and predictive performance respectively. Moreover, we introduce a Frechet Inception distance-like (FID) metric for time-series data called Frechet Transformer distance (FTD) score (lower is better), to evaluate the quality and variety of generated data. We also found that low FTD scores correspond to the best-performing downstream predictive experiments. Hence, FTD scores can be used as a standardized metric to evaluate synthetic time-series data.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 54 references that are in the map. First posted on arXiv 3 Jun 2023.

Builds on

32 of 54 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2017Graph Attention Networkscited by 8,923
  4. 2017Inductive Representation Learning on Large Graphscited by 6,320
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  6. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  7. 2016Improved Techniques for Training GANscited by 2,970
  8. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  9. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  10. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  11. 2021How Attentive are Graph Attention Networks?cited by 835
  12. 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
20 more
  1. 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
  2. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
  3. 2016SeqGAN: Sequence Generative Adversarial Nets with Policy Gradientcited by 376
  4. 2015Adversarial Autoencoderscited by 364
  5. 2017Real-valued (Medical) Time Series Generation with Recurrent Conditional GANscited by 333
  6. 2019Theoretical Limitations of Self-Attention in Neural Sequence Modelscited by 288
  7. 2015Diffusion-Convolutional Neural Networkscited by 268
  8. 2021Generating Images with Sparse Representationscited by 266
  9. 2015Generative Moment Matching Networkscited by 257
  10. 2021How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Modelscited by 196
  11. 2019Effectively Unbiased FID and Inception Score and where to find themcited by 165
  12. 2017MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompanimentcited by 151
  13. 2016C-RNN-GAN: Continuous recurrent neural networks with adversarial trainingcited by 132
  14. 2019GANSynth: Adversarial Neural Audio Synthesiscited by 116
  15. 2019Quant GANs: Deep Generation of Financial Time Seriescited by 108
  16. 2021PSA-GAN: Progressive Self Attention GANs for Synthetic Time Seriescited by 58
  17. 2020Do RNN and LSTM have Long Memory?cited by 47
  18. 2022TTS-GAN: A Transformer-based Time-Series Generative Adversarial Networkcited by 41
  19. 2020Generative Adversarial Networks for Spatio-temporal Data: A Surveycited by 35
  20. 2019Quality Evaluation of GANs Using Cross Local Intrinsic Dimensionalitycited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 0; 2025: 1; 2026: 1.

3 papers.