Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoders
Not on the map. Why?
Abstract (arXiv)
We study a variant of the variational autoencoder model (VAE) with a Gaussian mixture as a prior distribution, with the goal of performing unsupervised clustering through deep generative models. We observe that the known problem of over-regularisation that has been shown to arise in regular VAEs also manifests itself in our model and leads to cluster degeneracy. We show that a heuristic called minimum information constraint that has been shown to mitigate this effect in VAEs can also be applied to improve unsupervised clustering performance with our model. Furthermore we analyse the effect of this heuristic and provide an intuition of the various processes with the help of visualizations. Finally, we demonstrate the performance of our model on synthetic data, MNIST and SVHN, showing that the obtained clusters are distinct, interpretable and result in achieving competitive performance on unsupervised clustering to the state-of-the-art results.
Key facts. Cited by 219 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 49; 2022: 47; 2023: 40; 2024: 29; 2025: 29; 2026: 25.
219 papers.
Sort:
By area:
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
- 2021SPICE: Semantic Pseudo-labeling for Image Clusteringcited by 104
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2023Learning Linear Causal Representations from Interventions under General Nonlinear Mixingcited by 92
- 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modelingcited by 85
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2022Deep Clustering: A Comprehensive Surveycited by 78
- 2022A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directionscited by 73
- 2022Identifiability of deep generative models without auxiliary informationcited by 70
38 more
- 2023ClusterLLM: Large Language Models as a Guide for Text Clusteringcited by 69
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
- 2021Clustering-friendly Representation Learning via Instance Discrimination and Feature Decorrelationcited by 65
- 2022Verifying the Union of Manifolds Hypothesis for Image Datacited by 62
- 2021The Wanderings of Odysseus in 3D Scenescited by 59
- 2023Posterior Collapse and Latent Variable Non-identifiabilitycited by 57
- 2024SoftVQ-VAE: Efficient 1-Dimensional Continuous Tokenizercited by 55
- 2024Learning by Reconstruction Produces Uninformative Features For Perceptioncited by 54
- 2021Multi-VAE: Learning Disentangled View-common and View-peculiar Visual Representations for Multi-view Clusteringcited by 51
- 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 47
- 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connectionscited by 47
- 2021MiCE: Mixture of Contrastive Experts for Unsupervised Image Clusteringcited by 42
- 2021You Never Cluster Alonecited by 38
- 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchorscited by 34
- 2022A generic diffusion-based approach for 3D human pose prediction in the wildcited by 33
- 2022Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary Spacecited by 32
- 2022Motron: Multimodal Probabilistic Human Motion Forecastingcited by 30
- 2024Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Modelscited by 29
- 2022Human Joint Kinematics Diffusion-Refinement for Stochastic Motion Predictioncited by 28
- 2023Stochastic Multi-Person 3D Motion Forecastingcited by 28
- 2021Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencodercited by 27
- 2022Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Casecited by 26
- 2021A Deep Variational Approach to Clustering Survival Datacited by 25
- 2025A Survey on Human Interaction Motion Generationcited by 25
- 2022A Geometric Perspective on Variational Autoencoderscited by 24
- 2021A survey on Variational Autoencoders from a GreenAI perspectivecited by 22
- 2021Congestion-aware Multi-agent Trajectory Prediction for Collision Avoidancecited by 21
- 2021Better Latent Spaces for Better Autoencoderscited by 20
- 2023t3-Variational Autoencoder: Learning Heavy-tailed Data with Student's t and Power Divergencecited by 17
- 2022HiT-DVAE: Human Motion Generation via Hierarchical Transformer Dynamical VAEcited by 16
- 2021Gaussian Mixture Variational Autoencoder with Contrastive Learning for Multi-Label Classificationcited by 15
- 2021TrajeVAE: Controllable Human Motion Generation from Trajectoriescited by 14
- 2021Deep Conditional Gaussian Mixture Model for Constrained Clusteringcited by 14
- 2021MUGL: Large Scale Multi Person Conditional Action Generation with Locomotioncited by 14
- 2022Strongly Augmented Contrastive Clusteringcited by 14
- 2022Deep Clustering with Features from Self-Supervised Pretrainingcited by 14
- 2021Cauchy-Schwarz Regularized Autoencodercited by 13
- 2022Towards Unsupervised Open World Semantic Segmentationcited by 13
50 most cited of 219 All 219 (JSON)
- 2026LinSlot: Exploiting Linear Representation hypothesis for unsupervised attribute discovery from slot based object representation7 Oct 2026
- 2026Beyond Unimodal Bases: Pullback Geometry for Multimodal Data30 Sep 2026
- 2026Information Bottleneck-Guided Adaptive Hypergraph Transformer for Brain Disease Diagnosis29 Sep 2026
- 2026What Makes a Good Medical Image Tokenizer? Rethinking Reconstruction and Generation in Medical Image Tokenization21 Sep 2026
- 2026Target-Aware State-Adaptive p-Dirichlet Graph Neural Regression for Non-Invasive Body-Composition Estimation30 Aug 2026
- 2026Gaussian-Mixture Latent Flow for Stochastic 3D Human Motion Prediction21 Aug 2026
- 2026IP Protection in the Era of Visual Generative AI: A Survey13 Aug 2026
- 2026K-Survival Means27 Jul 2026
- 2026A Multi-stage Constrained Optimization Framework for Data-driven Problems26 Jul 2026
- 2026eXact-Prior Variational Autoencoder (X-VAE): Learning Data-Adaptive Gaussian Mixture Priors for Latent Distributions30 Jun 2026
- 2026Generative Robust Optimisation21 Jun 2026
- 2026Deep Image Prototype Learning with Geometric Heat-Kernel Priors17 Jun 2026
38 more
- 2026Knowledge Reutilization in Meta-Reinforcement Learning16 Jun 2026
- 2026Constructing VAE Latent Spaces with Prescribed Topology5 Jun 2026
- 2026CLUBench: A Clustering Benchmark28 May 2026
- 2026Learning Disentangled Representations for Generalized Multi-view Clustering15 May 2026
- 2026Prototype Guided Post-pretraining for Single-Cell Representation Learning8 May 2026
- 2026Structured Coupling for Flow Matching8 May 2026
- 2026A Testable Certificate for Constant Collapse in Teacher-Guided VAEs7 May 2026
- 2026PDGMM-VAE: A Variational Autoencoder with Adaptive Per-Dimension Gaussian Mixture Model Priors for Nonlinear ICA20 Mar 2026
- 2026Multi-Domain Empirical Bayes for Linearly-Mixed Causal Representations19 Mar 2026
- 2026Spherical VAE with Cluster-Aware Feasible Regions: Guaranteed Prevention of Posterior Collapse11 Mar 2026
- 2026AI-Driven Phase Identification from X-ray Hyperspectral Imaging of cycled Na-ion Cathode Materials8 Mar 2026
- 2026ReGuLaR: Variational Latent Reasoning Guided by Rendered Chain-of-Thought30 Jan 2026
- 2026Aligning the Unseen in Attributed Graphs: Interplay between Graph Geometry and Node Attributes Manifold30 Jan 2026
- 2025Simple Yet Effective Selective Imputation for Incomplete Multi-view Clustering11 Dec 2025
- 2025ClusterFusion: Hybrid Clustering with Embedding Guidance and LLM Adaptation4 Dec 2025
- 2025Physically Interpretable Representation Learning with Gaussian Mixture Variational AutoEncoder (GM-VAE)26 Nov 2025
- 2025ε-Seg: Sparsely Supervised Semantic Segmentation of Microscopy Data21 Oct 2025
- 2025Synthesising Counterfactual Explanations via Label-Conditional Gaussian Mixture Variational Autoencoders6 Oct 2025
- 2025Heavy-Tailed Class-Conditional Priors for Long-Tailed Generative Modeling2 Sep 2025
- 2025SDEC: Semantic Deep Embedded Clustering18 Aug 2025
- 2025Toward Architecture-Agnostic Local Control of Posterior Collapse in VAEs17 Aug 2025
- 2025Cloud Model Characteristic Function Auto-Encoder: Integrating Cloud Model Theory with MMD Regularization for Enhanced Generative Modeling6 Aug 2025
- 2025A Spatio-temporal Continuous Network for Stochastic 3D Human Motion Prediction3 Aug 2025
- 2025Towards Explainable Deep Clustering for Time Series Data28 Jul 2025
- 2025A Matrix Variational Auto-Encoder for Variant Effect Prediction in Pharmacogenes3 Jul 2025
- 2025Exploring Image Generation via Mutually Exclusive Probability Spaces and Local Correlation Hypothesis26 Jun 2025
- 2025DynaSubVAE: Adaptive Subgrouping for Scalable and Robust OOD Detection11 Jun 2025
- 2025VIVAT: Virtuous Improving VAE Training through Artifact Mitigation9 Jun 2025
- 2025Identifiable Object Representations under Spatial Ambiguities9 Jun 2025
- 2025CacheFlow: Fast Human Motion Prediction by Cached Normalizing Flow19 May 2025
- 2025A Tutorial on Discriminative Clustering and Mutual Information7 May 2025
- 2025Plasma State Monitoring and Disruption Characterization using Multimodal VAEs24 Apr 2025
- 2025Cequel: Cost-Effective Querying of Large Language Models for Text Clustering22 Apr 2025
- 2025Leveraging VAE-Derived Latent Spaces for Enhanced Malware Detection with Machine Learning Classifiers24 Mar 2025
- 2025A Survey on Human Interaction Motion Generation17 Mar 2025
- 2025An Information-Theoretic Approach to Identifying Formulaic Clusters in Textual Data10 Mar 2025
- 2025Designing a Conditional Prior Distribution for Flow-Based Generative Models13 Feb 2025
- 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modeling13 Feb 2025
50 newest of 219 All 219 (JSON)
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connectionscited by 47
- 2022A generic diffusion-based approach for 3D human pose prediction in the wildcited by 33
- 2024Unified Generation, Reconstruction, and Representation: Generalized Diffusion with Adaptive Latent Encoding-Decodingcited by 10
- 2024DivDiff: A Conditional Diffusion Model for Diverse Human Motion Predictioncited by 6
- 2026Structured Coupling for Flow Matchingcited by 0
- 2026What Makes a Good Medical Image Tokenizer? Rethinking Reconstruction and Generation in Medical Image Tokenizationcited by 0
- 2026What Makes a Good Medical Image Tokenizer? Rethinking Reconstruction and Generation in Medical Image Tokenization21 Sep 2026
- 2026Structured Coupling for Flow Matching8 May 2026
- 2024DivDiff: A Conditional Diffusion Model for Diverse Human Motion Prediction16 Aug 2024
- 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connections3 Apr 2024
- 2024Unified Generation, Reconstruction, and Representation: Generalized Diffusion with Adaptive Latent Encoding-Decoding29 Feb 2024
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction25 Nov 2022
- 2022A generic diffusion-based approach for 3D human pose prediction in the wild11 Oct 2022
- 2022Continual Predictive Learning from Videoscited by 8
- 2023Continual Visual Reinforcement Learning with A Life-Long World Modelcited by 2
- 2023Continual Visual Reinforcement Learning with A Life-Long World Model12 Mar 2023
- 2022Continual Predictive Learning from Videos12 Apr 2022
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
- 2021SPICE: Semantic Pseudo-labeling for Image Clusteringcited by 104
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2023Learning Linear Causal Representations from Interventions under General Nonlinear Mixingcited by 92
- 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modelingcited by 85
- 2022Deep Clustering: A Comprehensive Surveycited by 78
- 2022A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directionscited by 73
- 2022Identifiability of deep generative models without auxiliary informationcited by 70
- 2023ClusterLLM: Large Language Models as a Guide for Text Clusteringcited by 69
12 most cited of 206 All 206 (JSON)
- 2026LinSlot: Exploiting Linear Representation hypothesis for unsupervised attribute discovery from slot based object representation7 Oct 2026
- 2026Beyond Unimodal Bases: Pullback Geometry for Multimodal Data30 Sep 2026
- 2026Information Bottleneck-Guided Adaptive Hypergraph Transformer for Brain Disease Diagnosis29 Sep 2026
- 2026Target-Aware State-Adaptive p-Dirichlet Graph Neural Regression for Non-Invasive Body-Composition Estimation30 Aug 2026
- 2026Gaussian-Mixture Latent Flow for Stochastic 3D Human Motion Prediction21 Aug 2026
- 2026IP Protection in the Era of Visual Generative AI: A Survey13 Aug 2026
- 2026K-Survival Means27 Jul 2026
- 2026A Multi-stage Constrained Optimization Framework for Data-driven Problems26 Jul 2026
- 2026eXact-Prior Variational Autoencoder (X-VAE): Learning Data-Adaptive Gaussian Mixture Priors for Latent Distributions30 Jun 2026
- 2026Generative Robust Optimisation21 Jun 2026
- 2026Deep Image Prototype Learning with Geometric Heat-Kernel Priors17 Jun 2026
- 2026Knowledge Reutilization in Meta-Reinforcement Learning16 Jun 2026
12 newest of 206 All 206 (JSON)