How good is my GAN?
Not on the map. Why?
Abstract (arXiv)
Generative adversarial networks (GANs) are one of the most popular methods for generating images today. While impressive results have been validated by visual inspection, a number of quantitative criteria have emerged only recently. We argue here that the existing ones are insufficient and need to be in adequation with the task at hand. In this paper we introduce two measures based on image classification---GAN-train and GAN-test, which approximate the recall (diversity) and precision (quality of the image) of GANs respectively. We evaluate a number of recent GAN approaches based on these two measures and demonstrate a clear difference in performance. Furthermore, we observe that the increasing difficulty of the dataset, from CIFAR10 over CIFAR100 to ImageNet, shows an inverse correlation with the quality of the GANs, as clearly evident from our measures.
Key facts. Cited by 74 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 17; 2023: 11; 2024: 13; 2025: 10; 2026: 3.
74 papers.
Sort:
By area:
- 2021Pros and Cons of GAN Evaluation Measures: New Developmentscited by 121
- 2024Understanding Hallucinations in Diffusion Models through Mode Interpolationcited by 87
- 2022PoseGPT: Quantization-based 3D Human Motion Generation and Forecastingcited by 78
- 2021GANs for Medical Image Synthesis: An Empirical Studycited by 64
- 2024SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?cited by 64
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2023Diffusion Models for Counterfactual Generation and Anomaly Detection in Brain Imagescited by 30
- 2021Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencodercited by 27
- 2022Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Casecited by 26
- 2023Toward Understanding Generative Data Augmentationcited by 25
- 2024A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatarscited by 18
- 2021Inverting Generative Adversarial Renderer for Face Reconstructioncited by 17
38 more
- 2021LARGE: Latent-Based Regression through GAN Semanticscited by 17
- 2024Unveiling Differences in Generative Models: A Scalable Differential Clustering Approachcited by 16
- 2021Generative Zero-shot Network Quantizationcited by 15
- 2021Semantic Palette: Guiding Scene Generation with Class Proportionscited by 14
- 2021Generative Modeling for Multi-task Visual Learningcited by 14
- 2022A Unified Contrastive Energy-based Model for Understanding the Generative Ability of Adversarial Trainingcited by 13
- 2021MoRe-Fi: Motion-robust and Fine-grained Respiration Monitoring via Deep-Learning UWB Radarcited by 11
- 2022On the Robustness of Quality Measures for GANscited by 11
- 2023Bridging the Gap: Enhancing the Utility of Synthetic Data via Post-Processing Techniquescited by 11
- 2021PATE-AAE: Incorporating Adversarial Autoencoder into Private Aggregation of Teacher Ensembles for Spoken Command Classificationcited by 10
- 2021Beta-VAE Reproducibility: Challenges and Extensionscited by 10
- 2021Exploring the Quality of GAN Generated Images for Person Re-Identificationcited by 9
- 2022RareGAN: Generating Samples for Rare Classescited by 9
- 2025AIM 2025 challenge on Inverse Tone Mapping Report: Methods and Resultscited by 8
- 2021TransferI2I: Transfer Learning for Image-to-Image Translation from Small Datasetscited by 7
- 2022Improved Input Reprogramming for GAN Conditioningcited by 7
- 2022FedSyn: Synthetic Data Generation using Federated Learningcited by 7
- 2024Leveraging Generative AI for Urban Digital Twins: A Scoping Review on the Autonomous Generation of Urban Data, Scenarios, Designs, and 3D City Models for Smart City Advancementcited by 7
- 2021Ensembles of GANs for synthetic training data generationcited by 6
- 2022Font Generation with Missing Impression Labelscited by 6
- 2022Generalizability of Adversarial Robustness Under Distribution Shiftscited by 6
- 2024Rethinking HTG Evaluation: Bridging Generation and Recognitioncited by 6
- 2023Regularizing Neural Networks with Meta-Learning Generative Modelscited by 5
- 2025Deterministic Image-to-Image Translation via Denoising Brownian Bridge Models with Dual Approximatorscited by 5
- 2023A Diffusion-based Method for Multi-turn Compositional Image Generationcited by 4
- 2024Bridging the Gap between Real-world and Synthetic Images for Testing Autonomous Driving Systemscited by 4
- 2025Data Can Speak for Itself: Quality-guided Utilization of Wireless Synthetic Datacited by 4
- 2021On The Distribution of Penultimate Activations of Classification Networkscited by 3
- 2022Reinforcing Generated Images via Meta-learning for One-Shot Fine-Grained Visual Recognitioncited by 3
- 2023Understanding Deep Generative Models with Generalized Empirical Likelihoodscited by 3
- 2024Synthetic Medical Imaging Generation with Generative Adversarial Networks For Plain Radiographscited by 3
- 2024Purposer: Putting Human Motion Generation in Contextcited by 3
- 2021H-GAN: the power of GANs in your Handscited by 2
- 2022Evaluating the Quality and Diversity of DCGAN-based Generatively Synthesized Diabetic Retinopathy Imagerycited by 2
- 2023Learning to Generate Training Datasets for Robust Semantic Segmentationcited by 2
- 2023Preserving Privacy in GANs Against Membership Inference Attackcited by 2
- 2024Modeling Eye Gaze Velocity Trajectories using GANs with Spectral Loss for Enhanced Fidelitycited by 2
- 2021Stein Latent Optimization for Generative Adversarial Networkscited by 1
50 most cited of 74 All 74 (JSON)
- 2026EmbeddGAN: A Novel GAN Framework Using an Embedding Network and Gini Distance Correlation18 Sep 2026
- 2026Amplifying the imaging power of digital sky surveys with space telescopes data and generative AI21 Aug 2026
- 2026Trustworthy deep domain adaptation for wearable photoplethysmography signal analysis with decision-theoretic uncertainty quantification19 Apr 2026
- 2025Deterministic Image-to-Image Translation via Denoising Brownian Bridge Models with Dual Approximators29 Dec 2025
- 2025Generative deep learning for foundational video translation in ultrasound5 Nov 2025
- 2025FedMMKT:Co-Enhancing a Server Text-to-Image Model and Client Task Models in Multi-Modal Federated Learning14 Oct 2025
- 2025Efficiently Generating Multidimensional Calorimeter Data with Tensor Decomposition Parameterization26 Aug 2025
- 2025AIM 2025 challenge on Inverse Tone Mapping Report: Methods and Results19 Aug 2025
- 2025Galaxy image simplification using Generative AI15 Jul 2025
- 2025Enhanced Generative Model Evaluation with Clipped Density and Coverage2 Jul 2025
- 2025Data Can Speak for Itself: Quality-guided Utilization of Wireless Synthetic Data29 Jun 2025
- 2025VibrantLeaves: A principled parametric image generator for training deep restoration models14 Apr 2025
38 more
- 2025CREATE-FFPE: Cross-Resolution Compensated and Multi-Frequency Enhanced FS-to-FFPE Stain Transfer for Intraoperative IHC Images2 Mar 2025
- 2024GeFL: Model-Agnostic Federated Learning with Generative Models24 Dec 2024
- 2024Modeling Eye Gaze Velocity Trajectories using GANs with Spectral Loss for Enhanced Fidelity5 Dec 2024
- 2024Rethinking HTG Evaluation: Bridging Generation and Recognition4 Sep 2024
- 2024Bridging the Gap between Real-world and Synthetic Images for Testing Autonomous Driving Systems25 Aug 2024
- 2024Multitask Fine-Tuning and Generative Adversarial Learning for Improved Auxiliary Classification11 Aug 2024
- 2024CSI4Free: GAN-Augmented mmWave CSI for Improved Pose Classification26 Jun 2024
- 2024Understanding Hallucinations in Diffusion Models through Mode Interpolation13 Jun 2024
- 2024Leveraging Generative AI for Urban Digital Twins: A Scoping Review on the Autonomous Generation of Urban Data, Scenarios, Designs, and 3D City Models for Smart City Advancement29 May 2024
- 2024Unveiling Differences in Generative Models: A Scalable Differential Clustering Approach4 May 2024
- 2024Purposer: Putting Human Motion Generation in Context19 Apr 2024
- 2024Synthetic Medical Imaging Generation with Generative Adversarial Networks For Plain Radiographs28 Mar 2024
- 2024SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?2 Feb 2024
- 2024A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars9 Jan 2024
- 2023Dendrogram distance: an evaluation metric for generative networks using hierarchical clustering28 Nov 2023
- 2023Preserving Privacy in GANs Against Membership Inference Attack6 Nov 2023
- 2023A Chronological Survey of Theoretical Advancements in Generative Adversarial Networks for Computer Vision2 Nov 2023
- 2023Diffusion Models for Counterfactual Generation and Anomaly Detection in Brain Images3 Aug 2023
- 2023Learning to Generate Training Datasets for Robust Semantic Segmentation1 Aug 2023
- 2023Regularizing Neural Networks with Meta-Learning Generative Models26 Jul 2023
- 2023Understanding Deep Generative Models with Generalized Empirical Likelihoods16 Jun 2023
- 2023Toward Understanding Generative Data Augmentation27 May 2023
- 2023Bridging the Gap: Enhancing the Utility of Synthetic Data via Post-Processing Techniques17 May 2023
- 2023A Diffusion-based Method for Multi-turn Compositional Image Generation5 Apr 2023
- 2023Class-Continuous Conditional Generative Neural Radiance Field3 Jan 2023
- 2022Time to Market Reduction for Hydrogen Fuel Cell Stacks using Generative Adversarial Networks22 Dec 2022
- 2022Prediction of Scene Plausibility2 Dec 2022
- 2022PoseGPT: Quantization-based 3D Human Motion Generation and Forecasting19 Oct 2022
- 2022Quantifying Quality of Class-Conditional Generative Models in Time-Series Domain14 Oct 2022
- 2022Generalizability of Adversarial Robustness Under Distribution Shifts29 Sep 2022
- 2022Evaluating the Quality and Diversity of DCGAN-based Generatively Synthesized Diabetic Retinopathy Imagery10 Aug 2022
- 2022Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Case16 Jun 2022
- 2022Generative Models with Information-Theoretic Protection Against Membership Inference Attacks31 May 2022
- 2022Adversarial random forests for density estimation and generative modeling19 May 2022
- 2022Reinforcing Generated Images via Meta-learning for One-Shot Fine-Grained Visual Recognition22 Apr 2022
- 2022Evaluating Procedures for Establishing Generative Adversarial Network-based Stochastic Image Models in Medical Imaging7 Apr 2022
- 2022A Unified Contrastive Energy-based Model for Understanding the Generative Ability of Adversarial Training25 Mar 2022
- 2022RareGAN: Generating Samples for Rare Classes20 Mar 2022
50 newest of 74 All 74 (JSON)
- 2021Pros and Cons of GAN Evaluation Measures: New Developmentscited by 121
- 2022PoseGPT: Quantization-based 3D Human Motion Generation and Forecastingcited by 78
- 2021GANs for Medical Image Synthesis: An Empirical Studycited by 64
- 2024SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?cited by 64
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2021Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencodercited by 27
- 2022Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Casecited by 26
- 2023Toward Understanding Generative Data Augmentationcited by 25
- 2024A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatarscited by 18
- 2021Inverting Generative Adversarial Renderer for Face Reconstructioncited by 17
- 2021LARGE: Latent-Based Regression through GAN Semanticscited by 17
- 2024Unveiling Differences in Generative Models: A Scalable Differential Clustering Approachcited by 16
12 most cited of 69 All 69 (JSON)
- 2026EmbeddGAN: A Novel GAN Framework Using an Embedding Network and Gini Distance Correlation18 Sep 2026
- 2026Amplifying the imaging power of digital sky surveys with space telescopes data and generative AI21 Aug 2026
- 2026Trustworthy deep domain adaptation for wearable photoplethysmography signal analysis with decision-theoretic uncertainty quantification19 Apr 2026
- 2025Deterministic Image-to-Image Translation via Denoising Brownian Bridge Models with Dual Approximators29 Dec 2025
- 2025Generative deep learning for foundational video translation in ultrasound5 Nov 2025
- 2025FedMMKT:Co-Enhancing a Server Text-to-Image Model and Client Task Models in Multi-Modal Federated Learning14 Oct 2025
- 2025Efficiently Generating Multidimensional Calorimeter Data with Tensor Decomposition Parameterization26 Aug 2025
- 2025AIM 2025 challenge on Inverse Tone Mapping Report: Methods and Results19 Aug 2025
- 2025Galaxy image simplification using Generative AI15 Jul 2025
- 2025Enhanced Generative Model Evaluation with Clipped Density and Coverage2 Jul 2025
- 2025Data Can Speak for Itself: Quality-guided Utilization of Wireless Synthetic Data29 Jun 2025
- 2025VibrantLeaves: A principled parametric image generator for training deep restoration models14 Apr 2025
12 newest of 69 All 69 (JSON)