mlsanityData to 7 Oct 2026

SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient

arXiv 1609.05473 ↗First posted 18 Sep 2016cs.LG cs.AIcited by 375

Not on the map. Why?

Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

As a new way of training generative models, Generative Adversarial Nets (GAN) that uses a discriminative model to guide the training of the generative model has enjoyed considerable success in generating real-valued data. However, it has limitations when the goal is for generating sequences of discrete tokens. A major reason lies in that the discrete outputs from the generative model make it difficult to pass the gradient update from the discriminative model to the generative model. Also, the discriminative model can only assess a complete sequence, while for a partially generated sequence, it is non-trivial to balance its current score and the future one once the entire sequence has been generated. In this paper, we propose a sequence generation framework, called SeqGAN, to solve the problems. Modeling the data generator as a stochastic policy in reinforcement learning (RL), SeqGAN bypasses the generator differentiation problem by directly performing gradient policy update. The RL reward signal comes from the GAN discriminator judged on a complete sequence, and is passed back to the intermediate state-action steps using Monte Carlo search. Extensive experiments on synthetic data and real-world tasks demonstrate significant improvements over strong baselines.

Key facts. Cited by 375 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Sep 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2018: 1; 2019: 1; 2020: 4; 2021: 96; 2022: 87; 2023: 78; 2024: 46; 2025: 43; 2026: 19.

375 papers.

Sort:

By area:

  1. 2022Generative Adversarial Networkscited by 5,603
  2. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  4. 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 374
  5. 2022Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioningcited by 362
  6. 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 361
  7. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
  8. 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 187
  9. 2021A Survey on Neural Speech Synthesiscited by 182
  10. 2022Graph neural networks for materials science and chemistrycited by 181
  11. 2021GraphDF: A Discrete Flow Model for Molecular Graph Generationcited by 177
  12. 2021ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmeticcited by 150
38 more
  1. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
  2. 2022Pretrained Language Models for Text Generation: A Surveycited by 121
  3. 2023Machine Learning for Synthetic Data Generation: A Reviewcited by 118
  4. 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
  5. 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
  6. 2023f-Divergence Minimization for Sequence-Level Knowledge Distillationcited by 112
  7. 2021A Survey on Data Augmentation for Text Classificationcited by 111
  8. 2022Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generationcited by 106
  9. 2021Step-unrolled Denoising Autoencoders for Text Generationcited by 102
  10. 2021D2C: Diffusion-Denoising Models for Few-shot Conditional Generationcited by 96
  11. 2023Monocular Depth Estimation using Diffusion Modelscited by 87
  12. 2021Adversarial Retriever-Ranker for dense text retrievalcited by 82
  13. 2023Optimizing DDPM Sampling with Shortcut Fine-Tuningcited by 81
  14. 2022Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methodscited by 75
  15. 2021Controlled Text Generation as Continuous Optimization with Multiple Constraintscited by 70
  16. 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
  17. 2020Text Generation by Learning from Demonstrationscited by 64
  18. 2022Gradient-Based Constrained Sampling from Language Modelscited by 64
  19. 2019Multi-Agent Adversarial Inverse Reinforcement Learningcited by 60
  20. 2023AI-Generated Content (AIGC): A Surveycited by 59
  21. 2018Reliability and Learnability of Human Bandit Feedback for Sequence-to-Sequence Reinforcement Learningcited by 57
  22. 2023On the Creativity of Large Language Modelscited by 57
  23. 2023PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Modelcited by 56
  24. 2021A Plug-and-Play Method for Controlled Text Generationcited by 55
  25. 2024A Dense Reward View on Aligning Text-to-Image Diffusion with Preferencecited by 55
  26. 2025Black-Box On-Policy Distillation of Large Language Modelscited by 53
  27. 2021Generating Synthetic Mixed-type Longitudinal Electronic Health Records for Artificial Intelligent Applicationscited by 47
  28. 2022A Langevin-like Sampler for Discrete Distributionscited by 42
  29. 2023Loss Functions and Metrics in Deep Learningcited by 42
  30. 2021More Photos are All You Need: Semi-Supervised Learning for Fine-Grained Sketch Based Image Retrievalcited by 38
  31. 2022Deep Latent State Space Models for Time-Series Generationcited by 37
  32. 2024Generative Artificial Intelligence: A Systematic Review and Applicationscited by 37
  33. 2023Continuous Trajectory Generation Based on Two-Stage GANcited by 36
  34. 2022Content and Style Aware Generation of Text-line Images for Handwriting Recognitioncited by 35
  35. 2021Gradient Imitation Reinforcement Learning for Low Resource Relation Extractioncited by 33
  36. 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
  37. 2021Survey on reinforcement learning for language processingcited by 31
  38. 2023A Survey on Out-of-Distribution Detection in NLPcited by 31

50 most cited of 375 All 375 (JSON)