mlsanityData to 7 Oct 2026

Selecting the number of principal components: estimation of the true rank of a noisy matrix

arXiv 1410.8260 ↗First posted 30 Oct 2014stat.MEcited by 18

Not on the map. Why?

Abstract (arXiv)

Principal component analysis (PCA) is a well-known tool in multivariate statistics. One significant challenge in using PCA is the choice of the number of components. In order to address this challenge, we propose an exact distribution-based method for hypothesis testing and construction of confidence intervals for signals in a noisy matrix. Assuming Gaussian noise, we use the conditional distribution of the singular values of a Wishart matrix and derive exact hypothesis tests and confidence intervals for the true signals. Our paper is based on the approach of Taylor, Loftus and Tibshirani (2013) for testing the global null: we generalize it to test for any number of principal components, and derive an integrated version with greater power. In simulation studies we find that our proposed methods compare well to existing approaches.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Oct 2014.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 3; 2023: 4; 2024: 3; 2025: 3; 2026: 1.

18 papers.

Sort:

  1. 2021More Powerful Conditional Selective Inference for Generalized Lasso by Parametric Programmingcited by 24
  2. 2021Conditional Selective Inference for Robust Regression and Outlier Detection using Piecewise-Linear Homotopy Continuationcited by 16
  3. 2021Fast and More Powerful Selective Inference for Sparse High-order Interaction Modelcited by 15
  4. 2021Exact Statistical Inference for the Wasserstein Distance by Selective Inferencecited by 7
  5. 2023Is your data alignable? Principled and interpretable alignability testing and integration of single-cell datacited by 6
  6. 2024Statistical Test for Attention Map in Vision Transformercited by 6
  7. 2024Statistical Test for Anomaly Detections by Variational Auto-Encoderscited by 6
  8. 2023Post-selection Inference for Conformal Prediction: Trading off Coverage for Precisioncited by 5
  9. 2022Robust Regularized Low-Rank Matrix Models for Regression and Classificationcited by 2
  10. 2022Multivariate Analysis for Multiple Network Data via Semi-Symmetric Tensor PCAcited by 1
  11. 2023Heuristic Hyperparameter Choice for Image Anomaly Detectioncited by 1
  12. 2023Bounded P-values in Parametric Programming-based Selective Inferencecited by 1
6 more
  1. 2024Improving Forward Compatibility in Class Incremental Learning by Increasing Representation Rank and Feature Richnesscited by 1
  2. 2025Statistical Test for Saliency Maps of Graph Neural Networks via Selective Inferencecited by 1
  3. 2022Statistical Inference for the Dynamic Time Warping Distance, with Application to Abnormal Time-Series Detectioncited by 0
  4. 2025The Nondecreasing Rankcited by 0
  5. 2025Counterfactual Forecasting for Panel Datacited by 0
  6. 2026Enhancing Spectral Embedding through Robust and Flexible Knowledge Transfer in Electronic Health Recordscited by 0