Generative Adversarial Networks (GANs Survey): Challenges, Solutions, and Future Directions
Not on the map. Why?
Abstract (arXiv)
Generative Adversarial Networks (GANs) is a novel class of deep generative models which has recently gained significant attention. GANs learns complex and high-dimensional distributions implicitly over images, audio, and data. However, there exists major challenges in training of GANs, i.e., mode collapse, non-convergence and instability, due to inappropriate design of network architecture, use of objective function and selection of optimization algorithm. Recently, to address these challenges, several solutions for better design and optimization of GANs have been investigated based on techniques of re-engineered network architectures, new objective functions and alternative optimization algorithms. To the best of our knowledge, there is no existing survey that has particularly focused on broad and systematic developments of these solutions. In this study, we perform a comprehensive survey of the advancements in GANs design and optimization solutions proposed to handle GANs challenges. We first identify key research issues within each design and optimization technique and then propose a new taxonomy to structure solutions by key research issues. In accordance with the taxonomy, we provide a detailed discussion on different GANs variants proposed within each solution and their relationships. Finally, based on the insights gained, we present the promising research directions in this rapidly growing field.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 14; 2023: 11; 2024: 11; 2025: 16; 2026: 1.
65 papers.
Sort:
By area:
- 2021Open-world Machine Learning: Applications, Challenges, and Opportunitiescited by 34
- 2022A Survey on Training Challenges in Generative Adversarial Networks for Biomedical Image Analysiscited by 24
- 2022Accelerating Diffusion Sampling with Classifier-based Feature Distillationcited by 15
- 2021Reducing bias and increasing utility by federated generative modeling of medical images using a centralized adversarycited by 14
- 2022Video Unsupervised Domain Adaptation with Deep Learning: A Comprehensive Surveycited by 12
- 2025A Probabilistic Approach to Wildfire Spread Prediction Using a Denoising Diffusion Surrogate Modelcited by 10
- 2021Generalization Error of GAN from the Discriminator's Perspectivecited by 8
- 2021Spiking Generative Adversarial Networks With a Neural Network Discriminator: Local Training, Bayesian Models, and Continual Meta-Learningcited by 8
- 2024A Survey of the Self Supervised Learning Mechanisms for Vision Transformerscited by 8
- 2021A Quantum Generative Adversarial Network for distributionscited by 7
- 2022Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEscited by 7
- 2024Data-driven Machinery Fault Diagnosis: A Comprehensive Reviewcited by 7
38 more
- 2024Leveraging Generative AI for Urban Digital Twins: A Scoping Review on the Autonomous Generation of Urban Data, Scenarios, Designs, and 3D City Models for Smart City Advancementcited by 7
- 2023Evading Forensic Classifiers with Attribute-Conditioned Adversarial Facescited by 6
- 2024An Augmented Surprise-guided Sequential Learning Framework for Predicting the Melt Pool Geometrycited by 6
- 2024Non-Invasive to Invasive: Enhancing FFA Synthesis from CFP with a Benchmark Dataset and a Novel Networkcited by 6
- 2024FedSynthCT-Brain: A Federated Learning Framework for Multi-Institutional Brain MRI-to-CT Synthesiscited by 6
- 2022Hybrid Deep Learning Model using SPCAGAN Augmentation for Insider Threat Analysiscited by 5
- 2023Universal Adversarial Defense in Remote Sensing Based on Pre-trained Denoising Diffusion Modelscited by 5
- 2022Combating Mode Collapse in GANs via Manifold Entropy Estimationcited by 4
- 20223D Brain and Heart Volume Generative Models: A Surveycited by 4
- 2023Synthetic data generation method for data-free knowledge distillation in regression neural networkscited by 4
- 2025Generative Modeling of Microweather Wind Velocities for Urban Air Mobilitycited by 3
- 2022MULTI-FLGANs: Multi-Distributed Adversarial Networks for Non-IID distributioncited by 2
- 2024SplitVAEs: Decentralized scenario generation from siloed data for stochastic optimization problemscited by 2
- 2021An In-depth Summary of Recent Artificial Intelligence Applications in Drug Designcited by 1
- 2021Improving Novelty Detection using the Reconstructions of Nearest Neighbourscited by 1
- 2022Dazzle: Using Optimized Generative Adversarial Networks to Address Security Data Class Imbalance Issuecited by 1
- 2022Deep Learning and Computer Vision Techniques for Microcirculation Analysis: A Reviewcited by 1
- 2023Improving Multimodal Joint Variational Autoencoders through Normalizing Flows and Correlation Analysiscited by 1
- 2023Accurate generation of stochastic dynamics based on multi-model Generative Adversarial Networkscited by 1
- 2024Novel Hybrid Integrated Pix2Pix and WGAN Model with Gradient Penalty for Binary Images Denoisingcited by 1
- 2024Consumer Transactions Simulation through Generative Adversarial Networkscited by 1
- 2024Efficient Semantic Diffusion Architectures for Model Training on Synthetic Echocardiogramscited by 1
- 2025Controlling Ensemble Variance in Diffusion Models: An Application for Reanalyses Downscalingcited by 1
- 2025AI-Driven HSI: Multimodality, Fusion, Challenges, and the Deep Learning Revolutioncited by 1
- 2025Digital Shielding for Cross-Domain Wi-Fi Signal Adaptation using Relativistic Average Generative Adversarial Networkcited by 1
- 2025Conditional Generative Modeling for Enhanced Credit Risk Management in Supply Chain Financecited by 1
- 2025Tumor Synthesis conditioned on Radiomicscited by 1
- 2025Precipitation nowcasting of satellite data using physically-aligned neural networkscited by 1
- 2021Training face verification models from generated face identity datacited by 0
- 2021SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysiscited by 0
- 2021VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Searchcited by 0
- 2021Automatic Feature Highlighting in Noisy RES Data With CycleGANcited by 0
- 2021Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generationcited by 0
- 2022Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectorscited by 0
- 2022Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networkscited by 0
- 2022Explanation-Guided Fairness Testing through Genetic Algorithmcited by 0
- 2022Using Graph Neural Networks for Program Terminationcited by 0
- 2023Face Generation from Textual Features using Conditionally Trained Inputs to Generative Adversarial Networkscited by 0
50 most cited of 65 All 65 (JSON)
- 2026DualDiT: A Conditional Dual-Output Diffusion Transformer for Joint OCT Image and Segmentation Mask Generation31 Jul 2026
- 2025Precipitation nowcasting of satellite data using physically-aligned neural networks7 Nov 2025
- 2025Tumor Synthesis conditioned on Radiomics29 Sep 2025
- 2025Potential and challenges of generative adversarial networks for super-resolution in 4D Flow MRI20 Aug 2025
- 2025MInDI-3D: Iterative Deep Learning in 3D for Sparse-view Cone Beam Computed Tomography13 Aug 2025
- 2025Improving Diagnostic Accuracy for Oral Cancer with inpainting Synthesis Lesions Generated Using Diffusion Models8 Aug 2025
- 2025Emotion Detection Using Conditional Generative Adversarial Networks (cGAN): A Deep Learning Approach6 Aug 2025
- 2025Decoding the Multimodal Maze: A Systematic Review on the Adoption of Explainability in Multimodal Attention-based Models6 Aug 2025
- 2025Tackling fake images in cybersecurity -- Interpretation of a StyleGAN and lifting its black-box18 Jul 2025
- 2025A Probabilistic Approach to Wildfire Spread Prediction Using a Denoising Diffusion Surrogate Model1 Jul 2025
- 2025Machine-Learning-Assisted Photonic Device Development: A Multiscale Approach from Theory to Characterization24 Jun 2025
- 2025Conditional Generative Modeling for Enhanced Credit Risk Management in Supply Chain Finance18 Jun 2025
38 more
- 2025Digital Shielding for Cross-Domain Wi-Fi Signal Adaptation using Relativistic Average Generative Adversarial Network29 Apr 2025
- 2025Shape Modeling of Longitudinal Medical Images: From Diffeomorphic Metric Mapping to Deep Learning27 Mar 2025
- 2025Generative Modeling of Microweather Wind Velocities for Urban Air Mobility4 Mar 2025
- 2025AI-Driven HSI: Multimodality, Fusion, Challenges, and the Deep Learning Revolution9 Feb 2025
- 2025Controlling Ensemble Variance in Diffusion Models: An Application for Reanalyses Downscaling21 Jan 2025
- 2024FedSynthCT-Brain: A Federated Learning Framework for Multi-Institutional Brain MRI-to-CT Synthesis9 Dec 2024
- 2024DeepSPV: A Deep Learning Pipeline for 3D Spleen Volume Estimation from 2D Ultrasound Images17 Nov 2024
- 2024Non-Invasive to Invasive: Enhancing FFA Synthesis from CFP with a Benchmark Dataset and a Novel Network19 Oct 2024
- 2024Efficient Semantic Diffusion Architectures for Model Training on Synthetic Echocardiograms28 Sep 2024
- 2024SplitVAEs: Decentralized scenario generation from siloed data for stochastic optimization problems18 Sep 2024
- 2024A Survey of the Self Supervised Learning Mechanisms for Vision Transformers30 Aug 2024
- 2024Consumer Transactions Simulation through Generative Adversarial Networks7 Aug 2024
- 2024Novel Hybrid Integrated Pix2Pix and WGAN Model with Gradient Penalty for Binary Images Denoising16 Jul 2024
- 2024Leveraging Generative AI for Urban Digital Twins: A Scoping Review on the Autonomous Generation of Urban Data, Scenarios, Designs, and 3D City Models for Smart City Advancement29 May 2024
- 2024Data-driven Machinery Fault Diagnosis: A Comprehensive Review29 May 2024
- 2024An Augmented Surprise-guided Sequential Learning Framework for Predicting the Melt Pool Geometry10 Jan 2024
- 2023Conformalised data synthesis14 Dec 2023
- 2023Universal Adversarial Defense in Remote Sensing Based on Pre-trained Denoising Diffusion Models31 Jul 2023
- 2023Evading Forensic Classifiers with Attribute-Conditioned Adversarial Faces22 Jun 2023
- 2023Automated Speaker Independent Visual Speech Recognition: A Comprehensive Survey14 Jun 2023
- 2023A Robust Likelihood Model for Novelty Detection6 Jun 2023
- 2023Accurate generation of stochastic dynamics based on multi-model Generative Adversarial Networks25 May 2023
- 2023Improving Multimodal Joint Variational Autoencoders through Normalizing Flows and Correlation Analysis19 May 2023
- 2023Tribe or Not? Critical Inspection of Group Differences Using TribalGram16 Mar 2023
- 2023A General Framework for Learning Procedural Audio Models of Environmental Sounds4 Mar 2023
- 2023Face Generation from Textual Features using Conditionally Trained Inputs to Generative Adversarial Networks22 Jan 2023
- 2023Synthetic data generation method for data-free knowledge distillation in regression neural networks11 Jan 2023
- 2022Accelerating Diffusion Sampling with Classifier-based Feature Distillation22 Nov 2022
- 2022Video Unsupervised Domain Adaptation with Deep Learning: A Comprehensive Survey17 Nov 2022
- 20223D Brain and Heart Volume Generative Models: A Survey12 Oct 2022
- 2022Combating Mode Collapse in GANs via Manifold Entropy Estimation25 Aug 2022
- 2022Using Graph Neural Networks for Program Termination28 Jul 2022
- 2022Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs28 Jun 2022
- 2022MULTI-FLGANs: Multi-Distributed Adversarial Networks for Non-IID distribution24 Jun 2022
- 2022Explanation-Guided Fairness Testing through Genetic Algorithm16 May 2022
- 2022Deep Learning and Computer Vision Techniques for Microcirculation Analysis: A Review11 May 2022
- 2022Dazzle: Using Optimized Generative Adversarial Networks to Address Security Data Class Imbalance Issue22 Mar 2022
- 2022Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networks8 Mar 2022
50 newest of 65 All 65 (JSON)
- 2022Accelerating Diffusion Sampling with Classifier-based Feature Distillationcited by 15
- 2025A Probabilistic Approach to Wildfire Spread Prediction Using a Denoising Diffusion Surrogate Modelcited by 10
- 2023Universal Adversarial Defense in Remote Sensing Based on Pre-trained Denoising Diffusion Modelscited by 5
- 2024Efficient Semantic Diffusion Architectures for Model Training on Synthetic Echocardiogramscited by 1
- 2025Controlling Ensemble Variance in Diffusion Models: An Application for Reanalyses Downscalingcited by 1
- 2025Improving Diagnostic Accuracy for Oral Cancer with inpainting Synthesis Lesions Generated Using Diffusion Modelscited by 0
- 2026DualDiT: A Conditional Dual-Output Diffusion Transformer for Joint OCT Image and Segmentation Mask Generationcited by 0
- 2026DualDiT: A Conditional Dual-Output Diffusion Transformer for Joint OCT Image and Segmentation Mask Generation31 Jul 2026
- 2025Improving Diagnostic Accuracy for Oral Cancer with inpainting Synthesis Lesions Generated Using Diffusion Models8 Aug 2025
- 2025A Probabilistic Approach to Wildfire Spread Prediction Using a Denoising Diffusion Surrogate Model1 Jul 2025
- 2025Controlling Ensemble Variance in Diffusion Models: An Application for Reanalyses Downscaling21 Jan 2025
- 2024Efficient Semantic Diffusion Architectures for Model Training on Synthetic Echocardiograms28 Sep 2024
- 2023Universal Adversarial Defense in Remote Sensing Based on Pre-trained Denoising Diffusion Models31 Jul 2023
- 2022Accelerating Diffusion Sampling with Classifier-based Feature Distillation22 Nov 2022
- 2021Open-world Machine Learning: Applications, Challenges, and Opportunitiescited by 34
- 2022A Survey on Training Challenges in Generative Adversarial Networks for Biomedical Image Analysiscited by 24
- 2021Reducing bias and increasing utility by federated generative modeling of medical images using a centralized adversarycited by 14
- 2022Video Unsupervised Domain Adaptation with Deep Learning: A Comprehensive Surveycited by 12
- 2021Generalization Error of GAN from the Discriminator's Perspectivecited by 8
- 2021Spiking Generative Adversarial Networks With a Neural Network Discriminator: Local Training, Bayesian Models, and Continual Meta-Learningcited by 8
- 2024A Survey of the Self Supervised Learning Mechanisms for Vision Transformerscited by 8
- 2021A Quantum Generative Adversarial Network for distributionscited by 7
- 2022Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEscited by 7
- 2024Data-driven Machinery Fault Diagnosis: A Comprehensive Reviewcited by 7
- 2024Leveraging Generative AI for Urban Digital Twins: A Scoping Review on the Autonomous Generation of Urban Data, Scenarios, Designs, and 3D City Models for Smart City Advancementcited by 7
- 2023Evading Forensic Classifiers with Attribute-Conditioned Adversarial Facescited by 6
12 most cited of 58 All 58 (JSON)
- 2025Precipitation nowcasting of satellite data using physically-aligned neural networks7 Nov 2025
- 2025Tumor Synthesis conditioned on Radiomics29 Sep 2025
- 2025Potential and challenges of generative adversarial networks for super-resolution in 4D Flow MRI20 Aug 2025
- 2025MInDI-3D: Iterative Deep Learning in 3D for Sparse-view Cone Beam Computed Tomography13 Aug 2025
- 2025Emotion Detection Using Conditional Generative Adversarial Networks (cGAN): A Deep Learning Approach6 Aug 2025
- 2025Decoding the Multimodal Maze: A Systematic Review on the Adoption of Explainability in Multimodal Attention-based Models6 Aug 2025
- 2025Tackling fake images in cybersecurity -- Interpretation of a StyleGAN and lifting its black-box18 Jul 2025
- 2025Machine-Learning-Assisted Photonic Device Development: A Multiscale Approach from Theory to Characterization24 Jun 2025
- 2025Conditional Generative Modeling for Enhanced Credit Risk Management in Supply Chain Finance18 Jun 2025
- 2025Digital Shielding for Cross-Domain Wi-Fi Signal Adaptation using Relativistic Average Generative Adversarial Network29 Apr 2025
- 2025Shape Modeling of Longitudinal Medical Images: From Diffeomorphic Metric Mapping to Deep Learning27 Mar 2025
- 2025Generative Modeling of Microweather Wind Velocities for Urban Air Mobility4 Mar 2025
12 newest of 58 All 58 (JSON)