Estimating Number of Factors by Adjusted Eigenvalues Thresholding
Not on the map. Why?
Abstract (arXiv)
Determining the number of common factors is an important and practical topic in high dimensional factor models. The existing literatures are mainly based on the eigenvalues of the covariance matrix. Due to the incomparability of the eigenvalues of the covariance matrix caused by heterogeneous scales of observed variables, it is very difficult to give an accurate relationship between these eigenvalues and the number of common factors. To overcome this limitation, we appeal to the correlation matrix and show surprisingly that the number of eigenvalues greater than 1 of population correlation matrix is the same as the number of common factors under some mild conditions. To utilize such a relationship, we study the random matrix theory based on the sample correlation matrix in order to correct the biases in estimating the top eigenvalues and to take into account of estimation errors in eigenvalue estimation. This leads us to propose adjusted correlation thresholding (ACT) for determining the number of common factors in high dimensional factor models, taking into account the sampling variabilities and biases of top sample eigenvalues. We also establish the optimality of the proposed methods in terms of minimal signal strength and optimal threshold. Simulation studies lend further support to our proposed method and show that our estimator outperforms other competing methods in most of our testing cases.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 1; 2024: 2; 2025: 5.
14 papers.
Sort:
- 2021Deviance Matrix Factorizationcited by 5
- 2022Are Latent Factor Regression and Sparse Regression Adequate?cited by 5
- 2021Sparse GCA and Thresholded Gradient Descentcited by 4
- 2021The Interplay of Demographic Variables and Social Distancing Scores in Deep Prediction of U.S. COVID-19 Casescited by 2
- 2022Factor-Augmented Regularized Model for Hazard Regressioncited by 1
- 2022Spectrally-Corrected and Regularized Linear Discriminant Analysis for Spiked Covariance Modelcited by 1
- 2024Factor Adjusted Spectral Clustering for Mixture Modelscited by 1
- 2025Supervised Dynamic Dimension Reduction with Deep Neural Networkcited by 1
- 2025Factor Augmented Supervised Learning with Text Embeddingscited by 1
- 2023A Bayesian sparse factor model with adaptive posterior concentrationcited by 0
- 2024Stochastic gradient descent estimation of generalized matrix factorization models with application to single-cell RNA sequencing datacited by 0
- 2025Spectrally-Corrected and Regularized QDA Classifier for Spiked Covariance Modelcited by 0
2 more
- 2025Feature Augmentations for High-Dimensional Learning29 Aug 2025
- 2025Latent Factor Point Processes for Patient Representation in Electronic Health Records28 Aug 2025
- 2025Factor Augmented Supervised Learning with Text Embeddings6 Aug 2025
- 2025Supervised Dynamic Dimension Reduction with Deep Neural Network5 Aug 2025
- 2025Spectrally-Corrected and Regularized QDA Classifier for Spiked Covariance Model17 Mar 2025
- 2024Stochastic gradient descent estimation of generalized matrix factorization models with application to single-cell RNA sequencing data29 Dec 2024
- 2024Factor Adjusted Spectral Clustering for Mixture Models22 Aug 2024
- 2023A Bayesian sparse factor model with adaptive posterior concentration29 May 2023
- 2022Spectrally-Corrected and Regularized Linear Discriminant Analysis for Spiked Covariance Model8 Oct 2022
- 2022Factor-Augmented Regularized Model for Hazard Regression3 Oct 2022
- 2022Are Latent Factor Regression and Sparse Regression Adequate?2 Mar 2022
- 2021Deviance Matrix Factorization12 Oct 2021
- 2021Deviance Matrix Factorizationcited by 5
- 2022Are Latent Factor Regression and Sparse Regression Adequate?cited by 5
- 2021Sparse GCA and Thresholded Gradient Descentcited by 4
- 2021The Interplay of Demographic Variables and Social Distancing Scores in Deep Prediction of U.S. COVID-19 Casescited by 2
- 2022Factor-Augmented Regularized Model for Hazard Regressioncited by 1
- 2022Spectrally-Corrected and Regularized Linear Discriminant Analysis for Spiked Covariance Modelcited by 1
- 2024Factor Adjusted Spectral Clustering for Mixture Modelscited by 1
- 2025Supervised Dynamic Dimension Reduction with Deep Neural Networkcited by 1
- 2025Factor Augmented Supervised Learning with Text Embeddingscited by 1
- 2023A Bayesian sparse factor model with adaptive posterior concentrationcited by 0
- 2024Stochastic gradient descent estimation of generalized matrix factorization models with application to single-cell RNA sequencing datacited by 0
- 2025Spectrally-Corrected and Regularized QDA Classifier for Spiked Covariance Modelcited by 0
12 most cited of 14 All 14 (JSON)
- 2025Feature Augmentations for High-Dimensional Learning29 Aug 2025
- 2025Latent Factor Point Processes for Patient Representation in Electronic Health Records28 Aug 2025
- 2025Factor Augmented Supervised Learning with Text Embeddings6 Aug 2025
- 2025Supervised Dynamic Dimension Reduction with Deep Neural Network5 Aug 2025
- 2025Spectrally-Corrected and Regularized QDA Classifier for Spiked Covariance Model17 Mar 2025
- 2024Stochastic gradient descent estimation of generalized matrix factorization models with application to single-cell RNA sequencing data29 Dec 2024
- 2024Factor Adjusted Spectral Clustering for Mixture Models22 Aug 2024
- 2023A Bayesian sparse factor model with adaptive posterior concentration29 May 2023
- 2022Spectrally-Corrected and Regularized Linear Discriminant Analysis for Spiked Covariance Model8 Oct 2022
- 2022Factor-Augmented Regularized Model for Hazard Regression3 Oct 2022
- 2022Are Latent Factor Regression and Sparse Regression Adequate?2 Mar 2022
- 2021Deviance Matrix Factorization12 Oct 2021
12 newest of 14 All 14 (JSON)