Diverse Image Generation via Self-Conditioned GANs
Not on the map. Why?
Abstract (arXiv)
We introduce a simple but effective unsupervised method for generating realistic and diverse images. We train a class-conditional GAN model without using manually annotated class labels. Instead, our model is conditional on labels automatically derived from clustering in the discriminator's feature space. Our clustering step automatically discovers diverse modes, and explicitly requires the generator to cover them. Experiments on standard mode collapse benchmarks show that our method outperforms several competing methods when addressing mode collapse. Our method also performs well on large-scale datasets such as ImageNet and Places365, improving both image diversity and standard quality metrics, compared to previous methods.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 16; 2023: 7; 2024: 7; 2025: 5; 2026: 3.
54 papers.
Sort:
By area:
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
- 2022MaxViT: Multi-Axis Vision Transformercited by 476
- 2024The Platonic Representation Hypothesiscited by 362
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesiscited by 222
- 2022TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Datacited by 211
- 2021Instance-Conditioned GANcited by 119
- 2023Return of Unconditional Generation: A Self-supervised Representation Generation Methodcited by 95
- 2021Improved Transformer for High-Resolution GANscited by 59
- 2024Diffusion Models and Representation Learning: A Surveycited by 53
- 2021On Aliased Resizing and Surprising Subtleties in GAN Evaluationcited by 51
- 2021Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Modelscited by 44
38 more
- 2022Self-Distilled StyleGAN: Towards Generation from Internet Photoscited by 37
- 2023Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labelscited by 37
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
- 2021Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspectivecited by 25
- 2023KD-DLGAN: Data Limited Image Generation via Knowledge Distillationcited by 16
- 2021GenCo: Generative Co-training for Generative Adversarial Networks with Limited Datacited by 14
- 2024Diffusion Posterior Proximal Sampling for Image Restorationcited by 14
- 2021MCL-GAN: Generative Adversarial Networks with Multiple Specialized Discriminatorscited by 11
- 2022Secure Federated Clusteringcited by 10
- 2021Partition-Guided GANscited by 9
- 2021Contrastive Fine-grained Class Clustering via Generative Adversarial Networkscited by 9
- 2022Improved Input Reprogramming for GAN Conditioningcited by 7
- 2022Unsupervised Learning of Structured Representations via Closed-Loop Transcriptioncited by 7
- 2022Do DALL-E and Flamingo Understand Each Other?cited by 7
- 2023Learning Profitable NFT Image Diffusions via Multiple Visual-Policy Guided Reinforcement Learningcited by 7
- 2021Ensembles of GANs for synthetic training data generationcited by 6
- 2022Self-Conditioned Generative Adversarial Networks for Image Editingcited by 6
- 2022LANIT: Language-Driven Image-to-Image Translation for Unlabeled Datacited by 5
- 2024Rethinking cluster-conditioned diffusion models for label-free image synthesiscited by 5
- 2025Measuring Diversity in Synthetic Datasetscited by 5
- 2022Multi-level Latent Space Structuring for Generative Controlcited by 4
- 2024Ambiguous Annotations: When is a Pedestrian not a Pedestrian?cited by 4
- 2021Cluster-guided Image Synthesis with Unconditional Modelscited by 3
- 2022Diversity in deep generative models and generative AIcited by 2
- 2023Structural Adversarial Objectives for Self-Supervised Representation Learningcited by 2
- 2025Discovering Latent Graphs with GFlowNets for Diverse Conditional Image Generationcited by 2
- 2021IID-GAN: an IID Sampling Perspective for Regularizing Mode Collapsecited by 1
- 2021Stein Latent Optimization for Generative Adversarial Networkscited by 1
- 2021Unsupervised Image Generation with Infinite Generative Adversarial Networkscited by 1
- 2022S2-Flow: Joint Semantic and Style Editing of Facial Imagescited by 1
- 2024MS3D: A RG Flow-Based Regularization for GAN Training with Limited Datacited by 1
- 2021Enhancing Stability in Training Conditional Generative Adversarial Networks via Selective Data Matchingcited by 0
- 2021Leveraging in-domain supervision for unsupervised image-to-image translation tasks via multi-stream generatorscited by 0
- 2022Distribution Fitting for Combating Mode Collapse in Generative Adversarial Networkscited by 0
- 2023Likely, Light, and Accurate Context-Free Clusters-based Trajectory Predictioncited by 0
- 2024Beyond Traditional Single Object Tracking: A Surveycited by 0
- 2025Conjuring Positive Pairs for Efficient Unification of Representation Learning and Image Synthesiscited by 0
- 2025Style Quantization for Data-Efficient GAN Trainingcited by 0
50 most cited of 54 All 54 (JSON)
- 2026Generative AI-Based Data Augmentation for Oral Lesion Classification: The PhotoMOCI Dataset and Benchmark28 Sep 2026
- 2026CoFi-UCGen: Coarse-to-Fine Unsupervised Conditional Generation without Label Priors4 Jun 2026
- 2026Context-free Self-Conditioned GAN for Trajectory Forecasting9 Mar 2026
- 2025DiverseVAR: Balancing Diversity and Quality of Next-Scale Visual Autoregressive Models26 Nov 2025
- 2025Discovering Latent Graphs with GFlowNets for Diverse Conditional Image Generation25 Oct 2025
- 2025Style Quantization for Data-Efficient GAN Training31 Mar 2025
- 2025Conjuring Positive Pairs for Efficient Unification of Representation Learning and Image Synthesis19 Mar 2025
- 2025Measuring Diversity in Synthetic Datasets12 Feb 2025
- 2024MS3D: A RG Flow-Based Regularization for GAN Training with Limited Data20 Aug 2024
- 2024Diffusion Models and Representation Learning: A Survey30 Jun 2024
- 2024Beyond Traditional Single Object Tracking: A Survey16 May 2024
- 2024Ambiguous Annotations: When is a Pedestrian not a Pedestrian?14 May 2024
38 more
- 2024The Platonic Representation Hypothesis13 May 2024
- 2024Rethinking cluster-conditioned diffusion models for label-free image synthesis1 Mar 2024
- 2024Diffusion Posterior Proximal Sampling for Image Restoration25 Feb 2024
- 2023Return of Unconditional Generation: A Self-supervised Representation Generation Method6 Dec 2023
- 2023Structural Adversarial Objectives for Self-Supervised Representation Learning30 Sep 2023
- 2023NExT-GPT: Any-to-Any Multimodal LLM11 Sep 2023
- 2023Likely, Light, and Accurate Context-Free Clusters-based Trajectory Prediction27 Jul 2023
- 2023Learning Profitable NFT Image Diffusions via Multiple Visual-Policy Guided Reinforcement Learning20 Jun 2023
- 2023KD-DLGAN: Data Limited Image Generation via Knowledge Distillation30 Mar 2023
- 2023Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labels21 Feb 2023
- 2022Do DALL-E and Flamingo Understand Each Other?23 Dec 2022
- 2022Distribution Fitting for Combating Mode Collapse in Generative Adversarial Networks3 Dec 2022
- 2022S2-Flow: Joint Semantic and Style Editing of Facial Images22 Nov 2022
- 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesis16 Nov 2022
- 2022Unsupervised Learning of Structured Representations via Closed-Loop Transcription30 Oct 2022
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learning5 Oct 2022
- 2022LANIT: Language-Driven Image-to-Image Translation for Unlabeled Data31 Aug 2022
- 2022Secure Federated Clustering31 May 2022
- 2022MaxViT: Multi-Axis Vision Transformer4 Apr 2022
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGAN28 Feb 2022
- 2022Self-Distilled StyleGAN: Towards Generation from Internet Photos24 Feb 2022
- 2022Diversity in deep generative models and generative AI19 Feb 2022
- 2022Multi-level Latent Space Structuring for Generative Control11 Feb 2022
- 2022Self-Conditioned Generative Adversarial Networks for Image Editing8 Feb 2022
- 2022TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Data18 Jan 2022
- 2022Improved Input Reprogramming for GAN Conditioning7 Jan 2022
- 2021Leveraging in-domain supervision for unsupervised image-to-image translation tasks via multi-stream generators30 Dec 2021
- 2021Contrastive Fine-grained Class Clustering via Generative Adversarial Networks30 Dec 2021
- 2021Cluster-guided Image Synthesis with Unconditional Models24 Dec 2021
- 2021GenCo: Generative Co-training for Generative Adversarial Networks with Limited Data4 Oct 2021
- 2021Instance-Conditioned GAN10 Sep 2021
- 2021Unsupervised Image Generation with Infinite Generative Adversarial Networks18 Aug 2021
- 2021MCL-GAN: Generative Adversarial Networks with Multiple Specialized Discriminators15 Jul 2021
- 2021Enhancing Stability in Training Conditional Generative Adversarial Networks via Selective Data Matching8 Jul 2021
- 2021Improved Transformer for High-Resolution GANs14 Jun 2021
- 2021Stein Latent Optimization for Generative Adversarial Networks9 Jun 2021
- 2021IID-GAN: an IID Sampling Perspective for Regularizing Mode Collapse1 Jun 2021
- 2021Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Models17 May 2021
50 newest of 54 All 54 (JSON)
- 2024Diffusion Models and Representation Learning: A Surveycited by 53
- 2023Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labelscited by 37
- 2024Diffusion Posterior Proximal Sampling for Image Restorationcited by 14
- 2023Learning Profitable NFT Image Diffusions via Multiple Visual-Policy Guided Reinforcement Learningcited by 7
- 2024Rethinking cluster-conditioned diffusion models for label-free image synthesiscited by 5
- 2025DiverseVAR: Balancing Diversity and Quality of Next-Scale Visual Autoregressive Modelscited by 0
- 2025DiverseVAR: Balancing Diversity and Quality of Next-Scale Visual Autoregressive Models26 Nov 2025
- 2024Diffusion Models and Representation Learning: A Survey30 Jun 2024
- 2024Rethinking cluster-conditioned diffusion models for label-free image synthesis1 Mar 2024
- 2024Diffusion Posterior Proximal Sampling for Image Restoration25 Feb 2024
- 2023Learning Profitable NFT Image Diffusions via Multiple Visual-Policy Guided Reinforcement Learning20 Jun 2023
- 2023Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labels21 Feb 2023
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
- 2023NExT-GPT: Any-to-Any Multimodal LLM11 Sep 2023
- 2025Measuring Diversity in Synthetic Datasetscited by 5
- 2025Measuring Diversity in Synthetic Datasets12 Feb 2025
- 2022MaxViT: Multi-Axis Vision Transformercited by 476
- 2024The Platonic Representation Hypothesiscited by 362
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesiscited by 222
- 2022TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Datacited by 211
- 2021Instance-Conditioned GANcited by 119
- 2023Return of Unconditional Generation: A Self-supervised Representation Generation Methodcited by 95
- 2021Improved Transformer for High-Resolution GANscited by 59
- 2021On Aliased Resizing and Surprising Subtleties in GAN Evaluationcited by 51
- 2021Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Modelscited by 44
- 2022Self-Distilled StyleGAN: Towards Generation from Internet Photoscited by 37
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
12 most cited of 46 All 46 (JSON)
- 2026Generative AI-Based Data Augmentation for Oral Lesion Classification: The PhotoMOCI Dataset and Benchmark28 Sep 2026
- 2026CoFi-UCGen: Coarse-to-Fine Unsupervised Conditional Generation without Label Priors4 Jun 2026
- 2026Context-free Self-Conditioned GAN for Trajectory Forecasting9 Mar 2026
- 2025Discovering Latent Graphs with GFlowNets for Diverse Conditional Image Generation25 Oct 2025
- 2025Style Quantization for Data-Efficient GAN Training31 Mar 2025
- 2025Conjuring Positive Pairs for Efficient Unification of Representation Learning and Image Synthesis19 Mar 2025
- 2024MS3D: A RG Flow-Based Regularization for GAN Training with Limited Data20 Aug 2024
- 2024Beyond Traditional Single Object Tracking: A Survey16 May 2024
- 2024Ambiguous Annotations: When is a Pedestrian not a Pedestrian?14 May 2024
- 2024The Platonic Representation Hypothesis13 May 2024
- 2023Return of Unconditional Generation: A Self-supervised Representation Generation Method6 Dec 2023
- 2023Structural Adversarial Objectives for Self-Supervised Representation Learning30 Sep 2023
12 newest of 46 All 46 (JSON)