mlsanityData to 14 Oct 2026

Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers

arXiv 2311.10242 ↗First posted 17 Nov 2023cs.LG cs.AIcited by 36

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

The launch of ChatGPT has garnered global attention, marking a significant milestone in the field of Generative Artificial Intelligence. While Generative AI has been in effect for the past decade, the introduction of ChatGPT has ignited a new wave of research and innovation in the AI domain. This surge in interest has led to the development and release of numerous cutting-edge tools, such as Bard, Stable Diffusion, DALL-E, Make-A-Video, Runway ML, and Jukebox, among others. These tools exhibit remarkable capabilities, encompassing tasks ranging from text generation and music composition, image creation, video production, code generation, and even scientific work. They are built upon various state-of-the-art models, including Stable Diffusion, transformer models like GPT-3 (recent GPT-4), variational autoencoders, and generative adversarial networks. This advancement in Generative AI presents a wealth of exciting opportunities and, simultaneously, unprecedented challenges. Throughout this paper, we have explored these state-of-the-art models, the diverse array of tasks they can accomplish, the challenges they pose, and the promising future of Generative Artificial Intelligence.

Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 76 of its 256 references that are in the map. First posted on arXiv 17 Nov 2023.

Builds on

76 of 256 references.

Closest ancestors · 2

Same direction, newest first

  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 74

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2023GPT-4 Technical Reportcited by 18,396
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  8. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  9. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  10. 2016Densely Connected Convolutional Networkscited by 6,720
  11. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  12. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
38 more
  1. 2022Generative Adversarial Networkscited by 5,627
  2. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  3. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  6. 2016Improved Techniques for Training GANscited by 2,970
  7. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  8. 2014Conditional Generative Adversarial Netscited by 2,162
  9. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  10. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  11. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  12. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  13. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  14. 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,392
  15. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  16. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
  17. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
  18. 2021Transformers in Vision: A Surveycited by 1,013
  19. 2019An Introduction to Variational Autoencoderscited by 1,000
  20. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
  21. 2022Galactica: A Large Language Model for Sciencecited by 744
  22. 2020A Survey on Visual Transformercited by 654
  23. 2017Wasserstein GANcited by 639
  24. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
  25. 2017Generative Adversarial Networks: An Overviewcited by 590
  26. 2020Jukebox: A Generative Model for Musiccited by 542
  27. 2019Release Strategies and the Social Impacts of Language Modelscited by 513
  28. 2014Semi-Supervised Learning with Deep Generative Modelscited by 496
  29. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
  30. 2021A Survey of Transformerscited by 401
  31. 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 379
  32. 2016Adversarial Feature Learningcited by 350
  33. 2022A Survey on Generative Diffusion Modelcited by 240
  34. 2020Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identitycited by 202
  35. 2023From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacycited by 143
  36. 2023Generative AIcited by 120
  37. 2023Shepherd: A Critic for Language Model Generationcited by 97
  38. 2022PEER: A Collaborative Language Modelcited by 86

50 most cited of 74 All 74 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 5; 2025: 23; 2026: 8.

36 papers.

Sort:

By area:

  1. 2025SoccerChat: Integrating Multimodal Data for Enhanced Soccer Game Understandingcited by 8
  2. 2024Leveraging Generative AI for Urban Digital Twins: A Scoping Review on the Autonomous Generation of Urban Data, Scenarios, Designs, and 3D City Models for Smart City Advancementcited by 7
  3. 2025DropletVideo: A Dataset and Approach to Explore Integral Spatio-Temporal Consistent Video Generationcited by 6
  4. 2024Generative AI in Industrial Machine Vision -- A Reviewcited by 5
  5. 2025A theoretical framework for overfitting in energy-based modelingcited by 5
  6. 2025Prompt to Polyp: Medical Text-Conditioned Image Synthesis with Diffusion Modelscited by 5
  7. 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applicationscited by 5
  8. 2025Optimization-Free Universal Watermark Forgery with Regenerative Diffusion Modelscited by 3
  9. 2025Generative AI for Testing of Autonomous Driving Systems: A Surveycited by 3
  10. 2024Multimodal Human-Autonomous Agents Interaction Using Pre-Trained Language and Visual Foundation Modelscited by 2
  11. 2024Aligning Generalisation Between Humans and Machinescited by 2
  12. 2025A Decade of Deep Learning for Remote Sensing Spatiotemporal Fusion: Advances, Challenges, and Opportunitiescited by 2
24 more
  1. 2025Taxonomy of migration scenarios for Qiskit refactoring using LLMscited by 2
  2. 2025Artificial Intelligence for Atmospheric Sciences: A Research Roadmapcited by 2
  3. 2025A Comprehensive Survey on Network Traffic Synthesis: From Statistical Models to Deep Learningcited by 2
  4. 2025Ethical Concerns of Generative AI and Mitigation Strategies: A Systematic Mapping Studycited by 1
  5. 2025Generative AI in Science: Applications, Challenges, and Emerging Questionscited by 1
  6. 2025GenUQ: Predictive Uncertainty Estimates via Generative Hyper-Networkscited by 1
  7. 2025A parameter-efficient three-branch architecture for multimodal misinformation detection with limited annotationscited by 1
  8. 2024NijiGAN: Transform What You See into Anime with Contrastive Semi-Supervised Learning and Neural Ordinary Differential Equationscited by 0
  9. 2025Comparison of Autoencoders for tokenization of ASL datasetscited by 0
  10. 2025Datum-wise Transformer for Synthetic Tabular Data Detection in the Wildcited by 0
  11. 2025Multimodal Cinematic Video Synthesis Using Text-to-Image and Audio Generation Modelscited by 0
  12. 2025Mechanistic Interpretability in the Presence of Architectural Obfuscationcited by 0
  13. 2025Robust Detection of Synthetic Tabular Data under Schema Variabilitycited by 0
  14. 2025K-Syn: K-space Data Synthesis in Ultra Low-data Regimescited by 0
  15. 2025Provenance of AI-Generated Images: A Vector Similarity and Blockchain-based Approachcited by 0
  16. 2025Batch Transformer Architecture: Case of Synthetic Image Generation for Emotion Expression Facial Recognitioncited by 0
  17. 2026Evasion of IoT Malware Detection via Dummy Code Injectioncited by 0
  18. 2026Mapping Recent Shifts in Digital Art via Conference Discourse: AI, XR, the Metaverse, and Blockchain/NFTs (2021-2025)cited by 0
  19. 2026Safer Trajectory Planning with CBF-guided Diffusion Model for Unmanned Aerial Vehiclescited by 0
  20. 2026Rethinking external validation for the target population: Capturing patient-level similarity with a generative modelcited by 0
  21. 2026PCDM: A Diffusion-Based Data Poisoning Attack Against Federated Learning Systemscited by 0
  22. 2026From Prompt to Service: An SLM-Based Agent Orchestration Gateway for AI-Driven Virtual Worldscited by 0
  23. 2026Agentic and Generative AI for Open-Source Intelligence and Cyber Investigations: Taxonomy, Evaluation, Challenges, and Future Directionscited by 0
  24. 2026Diffusion Models in Medical Image Inpainting: Challenges, Solution Taxonomy, and Future Directionscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023ChatGPT is not all you need. A State of the Art Review of large Generative AI models
  2. 2024Generative AI in Vision: A Survey on Models, Metrics and Applications
  3. 2025Generative AI for Vision: A Comprehensive Study of Frameworks and Applications
  4. 2025An Empirical Study of GPT-4o Image Generation Capabilities
  5. 2024GPTDrawer: Enhancing Visual Synthesis through ChatGPT
  6. 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model
  7. 2023A Survey of Diffusion Based Image Generation Models: Issues and Their Solutions
  8. 2023Generative AI Beyond LLMs: System Implications of Multi-Modal Generation