Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
In recent years, deep learning based generative models, particularly Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), and Diffusion Models (DMs), have been instrumental in in generating diverse, high-quality content across various domains, such as image and video synthesis. This capability has led to widespread adoption of these models and has captured strong public interest. As they continue to advance at a rapid pace, the growing volume of research, expanding application areas, and unresolved technical challenges make it increasingly difficult to stay current. To address this need, this survey introduces a comprehensive taxonomy that organizes the literature and provides a cohesive framework for understanding the development of GANs, VAEs, and DMs, including their many variants and combined approaches. We highlight key innovations that have improved the quality, diversity, and controllability of generated outputs, reflecting the expanding potential of generative artificial intelligence. In addition to summarizing technical progress, we examine rising ethical concerns, including the risks of misuse and the broader societal impact of synthetic media. Finally, we outline persistent challenges and propose future research directions, offering a structured and forward looking perspective for researchers in this fast evolving field.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 128 of its 239 references that are in the map. First posted on arXiv 23 Oct 2025.
Builds on
128 of 239 references.
Closest ancestors · 14
Same direction, newest first
- 2023Analyzing and Improving the Training Dynamics of Diffusion Models5 Dec
- 2023Fast Diffusion Model12 Jun
- 2023On the Design Fundamentals of Diffusion Models: A Survey7 Jun
- 2022Exploring Vision Transformers as Diffusion Learners28 Dec
- 2022Exploring Transformer Backbones for Image Diffusion Models27 Dec
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Diffusion Models in Vision: A Survey10 Sep
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
2 more
Other references · 114
- 2017Attention Is All You Needcited by 59,932
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2023GPT-4 Technical Reportcited by 18,132
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
38 more
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2016Improved Techniques for Training GANscited by 2,938
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2022Video Diffusion Modelscited by 2,280
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 657
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2015Holistically-Nested Edge Detectioncited by 590
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
- 2017Benchmarking Single Image Dehazing and Beyondcited by 445
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
- 2017PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modificationscited by 415
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2017The Effectiveness of Data Augmentation in Image Classification using Deep Learningcited by 368
- 2017Universal Style Transfer via Feature Transformscited by 352
- 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
- 2015WIDER FACE: A Face Detection Benchmarkcited by 297
- 2022Flexible Diffusion Modeling of Long Videoscited by 294
- 2016NIPS 2016 Tutorial: Generative Adversarial Networkscited by 284
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 2017Data Augmentation Generative Adversarial Networkscited by 278
- 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 264
- 2015Generative Moment Matching Networkscited by 252
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
50 most cited of 114 All 114 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025PhysGen: Physically Grounded 3D Shape Generation for Industrial Designcited by 5
- 2026Grounding Synthetic Data Generation With Vision and Language Modelscited by 3
- 2025Fairness-Aware Graph Representation Learning with Limited Demographic Informationcited by 1
- 2026Order-Optimal Sample Complexity of Rectified Flowscited by 1
- 2026Automated In-the-Wild Data Collection for Continual AI Generated Image Detectioncited by 0
- 2026Automated In-the-Wild Data Collection for Continual AI Generated Image Detection4 May 2026
- 2026Grounding Synthetic Data Generation With Vision and Language Models10 Mar 2026
- 2026Order-Optimal Sample Complexity of Rectified Flows28 Jan 2026
- 2025PhysGen: Physically Grounded 3D Shape Generation for Industrial Design29 Nov 2025
- 2025Fairness-Aware Graph Representation Learning with Limited Demographic Information17 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Generative AI for Vision: A Comprehensive Study of Frameworks and Applications
- 2025Generative Adversarial Networks Bridging Art and Machine Intelligence
- 2023Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-art
- 2024Comparative Analysis of Generative Models: Enhancing Image Synthesis with VAEs, GANs, and Stable Diffusion
- 2024Generative AI in Vision: A Survey on Models, Metrics and Applications
- 2022Deep Generative Models on 3D Representations: A Survey
- 2023Reinforcement Learning for Generative AI: A Survey
- 2026The Little Book of Generative AI Foundations: An Intuitive Mathematical Primer