mlsanityData to 7 Oct 2026

GenFormer: A Deep-Learning-Based Approach for Generating Multivariate Stochastic Processes

arXiv 2402.02010 ↗First posted 3 Feb 2024cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Stochastic generators are essential to produce synthetic realizations that preserve target statistical properties. We propose GenFormer, a stochastic generator for spatio-temporal multivariate stochastic processes. It is constructed using a Transformer-based deep learning model that learns a mapping between a Markov state sequence and time series values. The synthetic data generated by the GenFormer model preserves the target marginal distributions and approximately captures other desired statistical properties even in challenging applications involving a large number of spatial locations and a long simulation horizon. The GenFormer model is applied to simulate synthetic wind speed data at various stations in Florida to calculate exceedance probabilities for risk management.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 51 references that are in the map. First posted on arXiv 3 Feb 2024.

Builds on

18 of 51 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2016Layer Normalizationcited by 5,579
  7. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  8. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  9. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  10. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  11. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  12. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
6 more
  1. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  2. 2018A Tutorial on Bayesian Optimizationcited by 734
  3. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  4. 2017Comparative Study of CNN and RNN for Natural Language Processingcited by 81
  5. 2019DSTP-RNN: a dual-stage two-phase attention-based recurrent neural networks for long-term and multivariate time series predictioncited by 20
  6. 2021Deep Adaptive Arbitrary Polynomial Chaos Expansion: A Mini-data-driven Semi-supervised Method for Uncertainty Quantificationcited by 6

Built on by

Not cited yet.