# Gaussian Mixture Generative Adversarial Networks for Diverse Datasets, and the Unsupervised Clustering of Images

arXiv: https://arxiv.org/abs/1808.10356 · HTML: https://mlsanity.com/paper/1808.10356/

## Key facts

- Cited by 15 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Aug 2018.

## Built on by (most cited first, 15 of 15)

- [A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directions](https://mlsanity.com/paper/2206.07579/) (2022)
- [Verifying the Union of Manifolds Hypothesis for Image Data](https://mlsanity.com/paper/2207.02862/) (2022)
- [Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connections](https://mlsanity.com/paper/2404.02954/) (2024)
- [MaGNET: Uniform Sampling from Deep Generative Network Manifolds Without Retraining](https://mlsanity.com/paper/2110.08009/) (2021)
- [Gaussian Mixture Flow Matching Models](https://mlsanity.com/paper/2504.05304/) (2025)
- [Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Experts](https://mlsanity.com/paper/2212.07328/) (2022)
- [Precision-Recall Divergence Optimization for Generative Modeling with GANs and Normalizing Flows](https://mlsanity.com/paper/2305.18910/) (2023)
- [MGF: Mixed Gaussian Flow for Diverse Trajectory Prediction](https://mlsanity.com/paper/2402.12238/) (2024)
- [Non-Exhaustive Learning Using Gaussian Mixture Generative Adversarial Networks](https://mlsanity.com/paper/2106.14344/) (2021)
- [Multi-level Latent Space Structuring for Generative Control](https://mlsanity.com/paper/2202.05910/) (2022)
- [Quantum latent distributions in deep generative models](https://mlsanity.com/paper/2508.19857/) (2025)
- [Unsupervised Image Generation with Infinite Generative Adversarial Networks](https://mlsanity.com/paper/2108.07975/) (2021)
- [Cramer Type Distances for Learning Gaussian Mixture Models by Gradient Descent](https://mlsanity.com/paper/2307.06753/) (2023)
- [Latent Combinational Game Design](https://mlsanity.com/paper/2206.14203/) (2022)
- [CoFi-UCGen: Coarse-to-Fine Unsupervised Conditional Generation without Label Priors](https://mlsanity.com/paper/2606.05652/) (2026)

## Abstract (arXiv)

Generative Adversarial Networks (GANs) have been shown to produce realistically looking synthetic images with remarkable success, yet their performance seems less impressive when the training set is highly diverse. In order to provide a better fit to the target data distribution when the dataset includes many different classes, we propose a variant of the basic GAN model, called Gaussian Mixture GAN (GM-GAN), where the probability distribution over the latent space is a mixture of Gaussians. We also propose a supervised variant which is capable of conditional sample synthesis. In order to evaluate the model's performance, we propose a new scoring method which separately takes into account two (typically conflicting) measures - diversity vs. quality of the generated data. Through a series of empirical experiments, using both synthetic and real-world datasets, we quantitatively show that GM-GANs outperform baselines, both when evaluated using the commonly used Inception Score, and when evaluated using our own alternative scoring method. In addition, we qualitatively demonstrate how the textitunsupervised variant of GM-GAN tends to map latent vectors sampled from different Gaussians in the latent space to samples of different classes in the data space. We show how this phenomenon can be exploited for the task of unsupervised clustering, and provide quantitative evaluation showing the superiority of our method for the unsupervised clustering of image datasets. Finally, we demonstrate a feature which further sets our model apart from other GAN models: the option to control the quality-diversity trade-off by altering, post-training, the probability distribution of the latent space. This allows one to sample higher quality and lower diversity samples, or vice versa, according to one's needs.
