Selective inference for k-means clustering
Not on the map. Why?
Abstract (arXiv)
We consider the problem of testing for a difference in means between clusters of observations identified via k-means clustering. In this setting, classical hypothesis tests lead to an inflated Type I error rate. To overcome this problem, we take a selective inference approach. We propose a finite-sample p-value that controls the selective Type I error for a test of the difference in means between a pair of clusters obtained using k-means clustering, and show that it can be efficiently computed. We apply our proposal in simulation, and on hand-written digits data and single-cell RNA-sequencing data.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 34 of its 104 references that are in the map. First posted on arXiv 29 Mar 2022.
Builds on
34 of 104 references.
References · 34
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2014Statistical guarantees for the EM algorithm: From population to sample-based analysiscited by 131
- 2013Exact post-selection inference, with application to the lassocited by 90
- 2014Optimal Inference After Model Selectioncited by 63
- 2016Statistical and Computational Guarantees of Lloyd's Algorithm and its Variantscited by 52
- 2014Exact Post-Selection Inference for Sequential Regression Procedurescited by 47
- 2015Robust Covariance and Scatter Matrix Estimation under Huber's Contamination Modelcited by 47
- 2019Optimality of Spectral Clustering in the Gaussian Mixture Modelcited by 42
- 2020Selective Inference for Hierarchical Clusteringcited by 37
- 2017Valid Inference Corrected for Outlier Removalcited by 25
- 2019Testing for a Change in Mean After Changepoint Detectioncited by 25
- 2020Computing Valid p-value for Optimal Changepoint by Selective Inference using Dynamic Programmingcited by 25
22 more
- 2021More Powerful Conditional Selective Inference for Generalized Lasso by Parametric Programmingcited by 24
- 2018More powerful post-selection inference, with application to the Lassocited by 22
- 2016Selective Inference for Group-Sparse Linear Modelscited by 21
- 2015Regularized EM Algorithms: A Unified Framework and Statistical Guaranteescited by 19
- 2018Post-Selection Inference for Changepoint Detection Algorithms with Application to Copy Number Variation Datacited by 19
- 2014A significance test for forward stepwise model selectioncited by 17
- 2021Splitting strategies for post-selection inferencecited by 14
- 2014Influential Feature PCA for high dimensional clusteringcited by 13
- 2015Selective inference in regression models with groups of variablescited by 9
- 2014Statistical Significance for Hierarchical Clusteringcited by 8
- 2017Unifying approach to selective inference with applications to cross-validationcited by 8
- 2017Permutation methods for factor analysis and PCAcited by 7
- 2020Scientific intuition inspired by machine learning generated hypothesescited by 7
- 2020Finite mixture models do not reliably learn the number of componentscited by 6
- 2021More powerful selective inference for the graph fused lassocited by 6
- 2020Multicarving for high-dimensional post-selection inferencecited by 5
- 2020Selective Inference for Latent Block Modelscited by 3
- 2017Sparse covariance matrix estimation in high-dimensional deconvolutioncited by 2
- 2019Statistical Methods for Replicability Assessmentcited by 2
- 2020Selective Inference for Additive and Linear Mixed Modelscited by 2
- 2013Statistical significance of variables driving systematic variationcited by 1
- 2021Quantifying uncertainty in spikes estimated from calcium imaging datacited by 1
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 3; 2025: 5; 2026: 7.
21 papers.
Sort:
- 2023CAD-DA: Controllable Anomaly Detection after Domain Adaptation by Statistical Inferencecited by 10
- 2023Generalized Data Thinning Using Sufficient Statisticscited by 7
- 2024Efficient Sparse PCA via Block-Diagonalizationcited by 4
- 2022Kernel Biclustering algorithm in Hilbert Spacescited by 3
- 2025Quantifying Statistical Significance of Deep Nearest Neighbor Anomaly Detection via Selective Inferencecited by 3
- 2025Change Point Detection in the Frequency Domain with Statistical Reliabilitycited by 2
- 2025Statistical Inference for Autoencoder-based Anomaly Detection after Representation Learning-based Domain Adaptationcited by 2
- 2023Bounded P-values in Parametric Programming-based Selective Inferencecited by 1
- 2024Adaptively Robust and Sparse K-means Clusteringcited by 1
- 2026Weighted Conformal Clusteringcited by 1
- 2022Inferring independent sets of Gaussian variables after thresholding correlationscited by 0
- 2023Unsupervised Learning of Phylogenetic Trees via Split-Weight Embeddingcited by 0
9 more
- 2024Interpretable Clustering with the Distinguishability Criterioncited by 0
- 2025Two-cluster testcited by 0
- 2025Hierarchical Clustering With Confidencecited by 0
- 2026The Condition-Number Principle for Prototype Clusteringcited by 0
- 2026Drawing Lines in Psychological Space: What K-means Clustering Reveals in Simulated and Real Psychometric Datacited by 0
- 2026Testing hypotheses via orthogonalizationcited by 0
- 2026Automatic Statistical Test for Rationally Expressible Algorithms by Selective Inference, with Applications to Feature Selectioncited by 0
- 2026Nonparametric Hypothesis Testing of High-dimensional Clustering With Application to Single-cell RNA Datacited by 0
- 2026Statistical Testing for Multiple Instance Learning via Selective Inference with Applications to Computational Pathologycited by 0
- 2026Statistical Testing for Multiple Instance Learning via Selective Inference with Applications to Computational Pathology21 Sep 2026
- 2026Nonparametric Hypothesis Testing of High-dimensional Clustering With Application to Single-cell RNA Data4 Sep 2026
- 2026Automatic Statistical Test for Rationally Expressible Algorithms by Selective Inference, with Applications to Feature Selection5 Aug 2026
- 2026Testing hypotheses via orthogonalization29 Jun 2026
- 2026Weighted Conformal Clustering29 May 2026
- 2026Drawing Lines in Psychological Space: What K-means Clustering Reveals in Simulated and Real Psychometric Data7 May 2026
- 2026The Condition-Number Principle for Prototype Clustering9 Apr 2026
- 2025Hierarchical Clustering With Confidence6 Dec 2025
- 2025Statistical Inference for Autoencoder-based Anomaly Detection after Representation Learning-based Domain Adaptation9 Aug 2025
- 2025Two-cluster test11 Jul 2025
- 2025Quantifying Statistical Significance of Deep Nearest Neighbor Anomaly Detection via Selective Inference18 Feb 2025
- 2025Change Point Detection in the Frequency Domain with Statistical Reliability5 Feb 2025
9 more
- 2024Efficient Sparse PCA via Block-Diagonalization18 Oct 2024
- 2024Adaptively Robust and Sparse K-means Clustering9 Jul 2024
- 2024Interpretable Clustering with the Distinguishability Criterion24 Apr 2024
- 2023Unsupervised Learning of Phylogenetic Trees via Split-Weight Embedding26 Dec 2023
- 2023CAD-DA: Controllable Anomaly Detection after Domain Adaptation by Statistical Inference23 Oct 2023
- 2023Bounded P-values in Parametric Programming-based Selective Inference21 Jul 2023
- 2023Generalized Data Thinning Using Sufficient Statistics22 Mar 2023
- 2022Inferring independent sets of Gaussian variables after thresholding correlations2 Nov 2022
- 2022Kernel Biclustering algorithm in Hilbert Spaces7 Aug 2022
- 2023CAD-DA: Controllable Anomaly Detection after Domain Adaptation by Statistical Inferencecited by 10
- 2023Generalized Data Thinning Using Sufficient Statisticscited by 7
- 2024Efficient Sparse PCA via Block-Diagonalizationcited by 4
- 2022Kernel Biclustering algorithm in Hilbert Spacescited by 3
- 2025Quantifying Statistical Significance of Deep Nearest Neighbor Anomaly Detection via Selective Inferencecited by 3
- 2025Change Point Detection in the Frequency Domain with Statistical Reliabilitycited by 2
- 2025Statistical Inference for Autoencoder-based Anomaly Detection after Representation Learning-based Domain Adaptationcited by 2
- 2023Bounded P-values in Parametric Programming-based Selective Inferencecited by 1
- 2024Adaptively Robust and Sparse K-means Clusteringcited by 1
- 2026Weighted Conformal Clusteringcited by 1
- 2022Inferring independent sets of Gaussian variables after thresholding correlationscited by 0
- 2023Unsupervised Learning of Phylogenetic Trees via Split-Weight Embeddingcited by 0
12 most cited of 21 All 21 (JSON)
- 2026Statistical Testing for Multiple Instance Learning via Selective Inference with Applications to Computational Pathology21 Sep 2026
- 2026Nonparametric Hypothesis Testing of High-dimensional Clustering With Application to Single-cell RNA Data4 Sep 2026
- 2026Automatic Statistical Test for Rationally Expressible Algorithms by Selective Inference, with Applications to Feature Selection5 Aug 2026
- 2026Testing hypotheses via orthogonalization29 Jun 2026
- 2026Weighted Conformal Clustering29 May 2026
- 2026Drawing Lines in Psychological Space: What K-means Clustering Reveals in Simulated and Real Psychometric Data7 May 2026
- 2026The Condition-Number Principle for Prototype Clustering9 Apr 2026
- 2025Hierarchical Clustering With Confidence6 Dec 2025
- 2025Statistical Inference for Autoencoder-based Anomaly Detection after Representation Learning-based Domain Adaptation9 Aug 2025
- 2025Two-cluster test11 Jul 2025
- 2025Quantifying Statistical Significance of Deep Nearest Neighbor Anomaly Detection via Selective Inference18 Feb 2025
- 2025Change Point Detection in the Frequency Domain with Statistical Reliability5 Feb 2025
12 newest of 21 All 21 (JSON)