# Deep Descriptive Clustering

arXiv: https://arxiv.org/abs/2105.11549 · HTML: https://mlsanity.com/paper/2105.11549/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 10 of its 30 references that are in the map.
- First posted on arXiv 24 May 2021.

## Builds on (most cited first, 10 of 10)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- ["Why Should I Trust You?": Explaining the Predictions of Any Classifier](https://mlsanity.com/paper/1602.04938/) (2016)
- [A Survey on Multi-view Learning](https://mlsanity.com/paper/1304.5634/) (2013)
- [Explainable k-Means and k-Medians Clustering](https://mlsanity.com/paper/2002.12538/) (2020)
- [Doubly Aligned Incomplete Multi-view Clustering](https://mlsanity.com/paper/1903.02785/) (2019)
- [Multi-View Spectral Clustering via Structured Low-Rank Matrix Factorization](https://mlsanity.com/paper/1709.01212/) (2017)
- [A Framework for Deep Constrained Clustering -- Algorithms and Advances](https://mlsanity.com/paper/1901.10061/) (2019)
- [Clustering-driven Deep Embedding with Pairwise Constraints](https://mlsanity.com/paper/1803.08457/) (2018)
- [Efficient Algorithms for Generating Provably Near-Optimal Cluster Descriptors for Explainability](https://mlsanity.com/paper/2002.02487/) (2020)

## Built on by (most cited first, 5 of 5)

- [A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directions](https://mlsanity.com/paper/2206.07579/) (2022)
- [Interpretable Clustering: A Survey](https://mlsanity.com/paper/2409.00743/) (2024)
- [Text-Guided Image Clustering](https://mlsanity.com/paper/2402.02996/) (2024)
- [Unsupervised Deep Discriminant Analysis Based Clustering](https://mlsanity.com/paper/2206.04686/) (2022)
- [Towards Explainable Clustering: A Constrained Declarative based Approach](https://mlsanity.com/paper/2403.18101/) (2024)

## Abstract (arXiv)

Recent work on explainable clustering allows describing clusters when the features are interpretable. However, much modern machine learning focuses on complex data such as images, text, and graphs where deep learning is used but the raw features of data are not interpretable. This paper explores a novel setting for performing clustering on complex data while simultaneously generating explanations using interpretable tags. We propose deep descriptive clustering that performs sub-symbolic representation learning on complex data while generating explanations based on symbolic data. We form good clusters by maximizing the mutual information between empirical distribution on the inputs and the induced clustering labels for clustering objectives. We generate explanations by solving an integer linear programming that generates concise and orthogonal descriptions for each cluster. Finally, we allow the explanation to inform better clustering by proposing a novel pairwise loss with self-generated constraints to maximize the clustering and explanation module's consistency. Experimental results on public data demonstrate that our model outperforms competitive baselines in clustering performance while offering high-quality cluster-level explanations.
