mlsanityData to 7 Oct 2026

UMAP Is Spectral Clustering on the Fuzzy Nearest-Neighbor Graph

arXiv 2602.11662 ↗First posted 12 Feb 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

UMAP (Uniform Manifold Approximation and Projection) is among the most widely used algorithms for non linear dimensionality reduction and data visualisation. Despite its popularity, and despite being presented through the lens of algebraic topology, the exact relationship between UMAP and classical spectral methods has remained informal. In this work, we prove that UMAP performs spectral clustering on the fuzzy k nearest neighbour graph. Our proof proceeds in three steps: (1) we show that UMAP's stochastic optimisation with negative sampling is a contrastive learning objective on the similarity graph; (2) we invoke the result of HaoChen et al. [8], establishing that contrastive learning on a similarity graph is equivalent to spectral clustering; and (3) we verify that UMAP's spectral initialisation computes the exact linear solution to this spectral problem. The equivalence is exact for Gaussian kernels, and holds as a first order approximation for UMAP's default Cauchy type kernel. Our result unifies UMAP, contrastive learning, and spectral clustering under a single framework, and provides theoretical grounding for several empirical observations about UMAP's behaviour.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 24 references that are in the map. First posted on arXiv 12 Feb 2026.

Builds on

10 of 24 references.

References · 10

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  5. 2021Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Losscited by 311
  6. 2022Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methodscited by 146
  7. 2021On UMAP's true loss functioncited by 32
  8. 2022Your Contrastive Learning Is Secretly Doing Stochastic Neighbor Embeddingcited by 28
  9. 2022A Probabilistic Graph Coupling View of Dimension Reductioncited by 13
  10. 2022Interpretable Dimensionality Reduction by Feature Preserving Manifold Approximation and Projectioncited by 3

Built on by

Not cited yet.