Clustering with t-SNE, provably
Not on the map. Why?
Abstract (arXiv)
t-distributed Stochastic Neighborhood Embedding (t-SNE), a clustering and visualization method proposed by van der Maaten & Hinton in 2008, has rapidly become a standard tool in a number of natural sciences. Despite its overwhelming success, there is a distinct lack of mathematical foundations and the inner workings of the algorithm are not well understood. The purpose of this paper is to prove that t-SNE is able to recover well-separated clusters; more precisely, we prove that t-SNE in the `early exaggeration' phase, an optimization technique proposed by van der Maaten & Hinton (2008) and van der Maaten (2014), can be rigorously analyzed. As a byproduct, the proof suggests novel ways for setting the exaggeration parameter α and step size h. Numerical examples illustrate the effectiveness of these rules: in particular, the quality of embedding of topological structures (e.g. the swiss roll) improves. We also discuss a connection to spectral clustering methods.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 7; 2023: 10; 2024: 15; 2025: 7; 2026: 4.
51 papers.
Sort:
- 2023Manifold learning: what, how, and whycited by 66
- 2021Theoretical Foundations of t-SNE for Visualizing High-Dimensional Clustered Datacited by 55
- 2021On UMAP's true loss functioncited by 32
- 2022Your Contrastive Learning Is Secretly Doing Stochastic Neighbor Embeddingcited by 28
- 2021Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolutioncited by 14
- 2022A Probabilistic Graph Coupling View of Dimension Reductioncited by 13
- 2023SNEkhorn: Dimension Reduction with Symmetric Entropic Affinitiescited by 12
- 2021t-SNE, Forceful Colorings and Mean Field Limitscited by 10
- 2022Learning Low-Dimensional Nonlinear Structures from High-Dimensional Noisy Data: An Integral Operator Approachcited by 8
- 2021Multidimensional Scaling: Approximation and Complexitycited by 7
- 2022Enhancing cluster analysis via topological manifold learningcited by 6
- 2023A Heat Diffusion Perspective on Geodesic Preserving Dimensionality Reductioncited by 6
38 more
- 2025DeepGB-TB: A Risk-Balanced Cross-Attention Gradient-Boosted Convolutional Network for Rapid, Interpretable Tuberculosis Screeningcited by 6
- 2025The Shape of Attraction in UMAP: Exploring the Embedding Forces in Dimensionality Reductioncited by 5
- 2024Quantum Architecture Search with Unsupervised Representation Learningcited by 4
- 2024Convergence analysis of t-SNE as a gradient flow for point cloud on a manifoldcited by 4
- 2024Large data limits and scaling laws for tSNEcited by 4
- 2024Assessing and improving reliability of neighbor embedding methods: a map-continuity perspectivecited by 4
- 2021T-SNE Is Not Optimized to Reveal Clusters in Datacited by 3
- 2024Outlier Detection in Large Radiological Datasets using UMAPcited by 3
- 2025t-SNE Exaggerates Clusters, Provablycited by 3
- 2022Semantic properties of English nominal pluralization: Insights from word embeddingscited by 2
- 2024Sailing in high-dimensional spaces: Low-dimensional embeddings through angle preservationcited by 2
- 2022AVIDA: Alternating method for Visualizing and Integrating Datacited by 1
- 2023MN-Pair Contrastive Damage Representation and Clustering for Prognostic Explanationcited by 1
- 2023Preserving local densities in low-dimensional embeddingscited by 1
- 2023From structure mining to unsupervised exploration of atomic octahedral networkscited by 1
- 2023Few-shot 1/a Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalancecited by 1
- 2023DatasetEquity: Are All Samples Created Equal? In The Quest For Equity Within Datasetscited by 1
- 2023Universal Deoxidation of Semiconductor Substrates Assisted by Machine-Learning and Real-Time-Feedback-Controlcited by 1
- 2024Feature Clock: High-Dimensional Effects in Two-Dimensional Plotscited by 1
- 2024Stochastic neighborhood embedding and the gradient flow of relative entropycited by 1
- 2024MIK: Modified Isolation Kernel for Biological Sequence Visualization, Classification, and Clusteringcited by 1
- 2024In-situ Self-optimization of Quantum Dot Emission for Lasers by Machine-Learning Assisted Epitaxycited by 1
- 2024Intrinsic Dimensionality of Fermi-Pasta-Ulam-Tsingou High-Dimensional Trajectories Through Manifold Learning: A Linear Approachcited by 1
- 2024Attraction-Repulsion Swarming: A Generalized Framework of t-SNE via Force Normalization and Tunable Interactionscited by 1
- 2024Federated t-SNE and UMAP for Distributed Data Visualizationcited by 1
- 2025Node Embeddings via Neighbor Embeddingscited by 1
- 2026On the continuum limit of t-SNE for data visualizationcited by 1
- 2026Some Theoretical Limitations of t-SNEcited by 1
- 2021Advances in Electron Microscopy with Deep Learningcited by 0
- 2021Topological Indoor Mapping through WiFi Signalscited by 0
- 2022May the force be with youcited by 0
- 2023Materials Informatics: An Algorithmic Design Rulecited by 0
- 2024Cell Culture Assistive Application for Precipitation Image Diagnosiscited by 0
- 2024Convergence Guarantees for the DeepWalk Embedding on Block Modelscited by 0
- 2025HDTree: Generative Modeling of Cellular Hierarchies for Robust Lineage Inferencecited by 0
- 2025Cluster and then Embed: A Modular Approach for Visualizationcited by 0
- 2025The Tree-SNE Tree Existscited by 0
- 2026A Comparative Study of UMAP and Other Dimensionality Reduction Methodscited by 0
50 most cited of 51 All 51 (JSON)
- 2026On the Abundance of Critical Points of the t-SNE Energy3 Sep 2026
- 2026Some Theoretical Limitations of t-SNE14 Apr 2026
- 2026On the continuum limit of t-SNE for data visualization13 Apr 2026
- 2026A Comparative Study of UMAP and Other Dimensionality Reduction Methods1 Mar 2026
- 2025The Tree-SNE Tree Exists16 Oct 2025
- 2025t-SNE Exaggerates Clusters, Provably9 Oct 2025
- 2025Cluster and then Embed: A Modular Approach for Visualization27 Aug 2025
- 2025DeepGB-TB: A Risk-Balanced Cross-Attention Gradient-Boosted Convolutional Network for Rapid, Interpretable Tuberculosis Screening2 Aug 2025
- 2025HDTree: Generative Modeling of Cellular Hierarchies for Robust Lineage Inference29 Jun 2025
- 2025Node Embeddings via Neighbor Embeddings31 Mar 2025
- 2025The Shape of Attraction in UMAP: Exploring the Embedding Forces in Dimensionality Reduction12 Mar 2025
- 2024Federated t-SNE and UMAP for Distributed Data Visualization18 Dec 2024
38 more
- 2024Attraction-Repulsion Swarming: A Generalized Framework of t-SNE via Force Normalization and Tunable Interactions15 Nov 2024
- 2024Intrinsic Dimensionality of Fermi-Pasta-Ulam-Tsingou High-Dimensional Trajectories Through Manifold Learning: A Linear Approach4 Nov 2024
- 2024In-situ Self-optimization of Quantum Dot Emission for Lasers by Machine-Learning Assisted Epitaxy1 Nov 2024
- 2024Convergence Guarantees for the DeepWalk Embedding on Block Models26 Oct 2024
- 2024Assessing and improving reliability of neighbor embedding methods: a map-continuity perspective22 Oct 2024
- 2024MIK: Modified Isolation Kernel for Biological Sequence Visualization, Classification, and Clustering21 Oct 2024
- 2024Large data limits and scaling laws for tSNE16 Oct 2024
- 2024Stochastic neighborhood embedding and the gradient flow of relative entropy25 Sep 2024
- 2024Feature Clock: High-Dimensional Effects in Two-Dimensional Plots2 Aug 2024
- 2024Outlier Detection in Large Radiological Datasets using UMAP31 Jul 2024
- 2024Cell Culture Assistive Application for Precipitation Image Diagnosis29 Jul 2024
- 2024Sailing in high-dimensional spaces: Low-dimensional embeddings through angle preservation14 Jun 2024
- 2024Convergence analysis of t-SNE as a gradient flow for point cloud on a manifold31 Jan 2024
- 2024Quantum Architecture Search with Unsupervised Representation Learning21 Jan 2024
- 2023Universal Deoxidation of Semiconductor Substrates Assisted by Machine-Learning and Real-Time-Feedback-Control4 Dec 2023
- 2023Manifold learning: what, how, and why7 Nov 2023
- 2023DatasetEquity: Are All Samples Created Equal? In The Quest For Equity Within Datasets19 Aug 2023
- 2023Few-shot 1/a Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance24 Jul 2023
- 2023From structure mining to unsupervised exploration of atomic octahedral networks21 Jun 2023
- 2023A Heat Diffusion Perspective on Geodesic Preserving Dimensionality Reduction30 May 2023
- 2023SNEkhorn: Dimension Reduction with Symmetric Entropic Affinities23 May 2023
- 2023Materials Informatics: An Algorithmic Design Rule5 May 2023
- 2023Preserving local densities in low-dimensional embeddings31 Jan 2023
- 2023MN-Pair Contrastive Damage Representation and Clustering for Prognostic Explanation15 Jan 2023
- 2022May the force be with you13 Aug 2022
- 2022Enhancing cluster analysis via topological manifold learning1 Jul 2022
- 2022AVIDA: Alternating method for Visualizing and Integrating Data31 May 2022
- 2022Your Contrastive Learning Is Secretly Doing Stochastic Neighbor Embedding30 May 2022
- 2022Semantic properties of English nominal pluralization: Insights from word embeddings29 Mar 2022
- 2022Learning Low-Dimensional Nonlinear Structures from High-Dimensional Noisy Data: An Integral Operator Approach28 Feb 2022
- 2022A Probabilistic Graph Coupling View of Dimension Reduction31 Jan 2022
- 2021T-SNE Is Not Optimized to Reveal Clusters in Data6 Oct 2021
- 2021Multidimensional Scaling: Approximation and Complexity23 Sep 2021
- 2021Topological Indoor Mapping through WiFi Signals17 Jun 2021
- 2021Theoretical Foundations of t-SNE for Visualizing High-Dimensional Clustered Data16 May 2021
- 2021Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolution26 Mar 2021
- 2021On UMAP's true loss function26 Mar 2021
- 2021t-SNE, Forceful Colorings and Mean Field Limits25 Feb 2021
50 newest of 51 All 51 (JSON)
- 2023Manifold learning: what, how, and whycited by 66
- 2021Theoretical Foundations of t-SNE for Visualizing High-Dimensional Clustered Datacited by 55
- 2021On UMAP's true loss functioncited by 32
- 2022Your Contrastive Learning Is Secretly Doing Stochastic Neighbor Embeddingcited by 28
- 2021Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolutioncited by 14
- 2022A Probabilistic Graph Coupling View of Dimension Reductioncited by 13
- 2023SNEkhorn: Dimension Reduction with Symmetric Entropic Affinitiescited by 12
- 2021t-SNE, Forceful Colorings and Mean Field Limitscited by 10
- 2022Learning Low-Dimensional Nonlinear Structures from High-Dimensional Noisy Data: An Integral Operator Approachcited by 8
- 2021Multidimensional Scaling: Approximation and Complexitycited by 7
- 2022Enhancing cluster analysis via topological manifold learningcited by 6
- 2023A Heat Diffusion Perspective on Geodesic Preserving Dimensionality Reductioncited by 6
12 most cited of 51 All 51 (JSON)
- 2026On the Abundance of Critical Points of the t-SNE Energy3 Sep 2026
- 2026Some Theoretical Limitations of t-SNE14 Apr 2026
- 2026On the continuum limit of t-SNE for data visualization13 Apr 2026
- 2026A Comparative Study of UMAP and Other Dimensionality Reduction Methods1 Mar 2026
- 2025The Tree-SNE Tree Exists16 Oct 2025
- 2025t-SNE Exaggerates Clusters, Provably9 Oct 2025
- 2025Cluster and then Embed: A Modular Approach for Visualization27 Aug 2025
- 2025DeepGB-TB: A Risk-Balanced Cross-Attention Gradient-Boosted Convolutional Network for Rapid, Interpretable Tuberculosis Screening2 Aug 2025
- 2025HDTree: Generative Modeling of Cellular Hierarchies for Robust Lineage Inference29 Jun 2025
- 2025Node Embeddings via Neighbor Embeddings31 Mar 2025
- 2025The Shape of Attraction in UMAP: Exploring the Embedding Forces in Dimensionality Reduction12 Mar 2025
- 2024Federated t-SNE and UMAP for Distributed Data Visualization18 Dec 2024
12 newest of 51 All 51 (JSON)