mlsanityData to 14 Oct 2026

Clustering High-dimensional Data: Balancing Abstraction and Representation Tutorial at AAAI 2026

arXiv 2601.11160 ↗First posted 16 Jan 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

How to find a natural grouping of a large real data set? Clustering requires a balance between abstraction and representation. To identify clusters, we need to abstract from superfluous details of individual objects. But we also need a rich representation that emphasizes the key features shared by groups of objects that distinguish them from other groups of objects. Each clustering algorithm implements a different trade-off between abstraction and representation. Classical K-means implements a high level of abstraction - details are simply averaged out - combined with a very simple representation - all clusters are Gaussians in the original data space. We will see how approaches to subspace and deep clustering support high-dimensional and complex data by allowing richer representations. However, with increasing representational expressiveness comes the need to explicitly enforce abstraction in the objective function to ensure that the resulting method performs clustering and not just representation learning. We will see how current deep clustering methods define and enforce abstraction through centroid-based and density-based clustering losses. Balancing the conflicting goals of abstraction and representation is challenging. Ideas from subspace clustering help by learning one latent space for the information that is relevant to clustering and another latent space to capture all other information in the data. The tutorial ends with an outlook on future research in clustering. Future methods will more adaptively balance abstraction and representation to improve performance, energy efficiency and interpretability. By automatically finding the sweet spot between abstraction and representation, the human brain is very good at clustering and other related tasks such as single-shot learning. So, there is still much room for improvement.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 32 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

8 of 32 references.

References · 8

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2015Unsupervised Deep Embedding for Clustering Analysiscited by 767
  3. 2020Contrastive Clusteringcited by 265
  4. 2016Variational Deep Embedding: An Unsupervised and Generative Approach to Clusteringcited by 220
  5. 2018ClusterGAN : Latent Space Clustering in Generative Adversarial Networkscited by 75
  6. 2021Multi-VAE: Learning Disentangled View-common and View-peculiar Visual Representations for Multi-view Clusteringcited by 51
  7. 2021Top-Down Deep Clustering with Multi-generator GANscited by 6
  8. 2024Breaking the Reclustering Barrier in Centroid-based Deep Clusteringcited by 4

Built on by

Not cited yet.