# Permutation methods for factor analysis and PCA

arXiv: https://arxiv.org/abs/1710.00479 · HTML: https://mlsanity.com/paper/1710.00479/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Oct 2017.

## Built on by (most cited first, 9 of 9)

- [Selective inference for k-means clustering](https://mlsanity.com/paper/2203.15267/) (2022)
- [Pursuit of a Discriminative Representation for Multiple Subspaces via Sequential Games](https://mlsanity.com/paper/2206.09120/) (2022)
- [ALPCAH: Subspace Learning for Sample-wise Heteroscedastic Data](https://mlsanity.com/paper/2505.07272/) (2025)
- [Detection problems in the spiked matrix models](https://mlsanity.com/paper/2301.05331/) (2023)
- [A statistical framework for GWAS of high dimensional phenotypes using summary statistics, with application to metabolite GWAS](https://mlsanity.com/paper/2303.10221/) (2023)
- [Mathematics of Data Science](https://mlsanity.com/paper/2607.11938/) (2026)
- [RETRACE: Resilience-Guided Trait-Conditioned Craving Estimation from Wearable Physiology in Opioid Use Disorder](https://mlsanity.com/paper/2608.14947/) (2026)
- [Representation Measurements Under Function-Preserving Reparameterizations](https://mlsanity.com/paper/2608.27020/) (2026)
- [Selective Inference for Clustering Under Unknown Covariance](https://mlsanity.com/paper/2610.17458/) (2026)

## Abstract (arXiv)

Researchers often have datasets measuring features xij of samples, such as test scores of students. In factor analysis and PCA, these features are thought to be influenced by unobserved factors, such as skills. Can we determine how many components affect the data? This is an important problem, because it has a large impact on all downstream data analysis. Consequently, many approaches have been developed to address it. Parallel Analysis is a popular permutation method. It works by randomly scrambling each feature of the data. It selects components if their singular values are larger than those of the permuted data. Despite widespread use in leading textbooks and scientific publications, as well as empirical evidence for its accuracy, it currently has no theoretical justification. In this paper, we show that the parallel analysis permutation method consistently selects the large components in certain high-dimensional factor models. However, it does not select the smaller components. The intuition is that permutations keep the noise invariant, while "destroying" the low-rank signal. This provides justification for permutation methods in PCA and factor models under some conditions. Our work uncovers drawbacks of permutation methods, and paves the way to improvements.