Spectral Thresholds in Correlated Spiked Models and Fundamental Limits of Partial Least Squares
Not on the map. Why?
Abstract (arXiv)
We provide a rigorous random matrix theory analysis of spiked cross-covariance models where the signals across two high-dimensional data channels are partially aligned. These models are motivated by multi-modal learning and form the standard generative setting underlying Partial Least Squares (PLS), a widely used yet theoretically underdeveloped method. We show that the leading singular values of the sample cross-covariance matrix undergo a Baik-Ben Arous-Peche (BBP)-type phase transition, and we characterize the precise thresholds for the emergence of informative components. Our results yield the first sharp asymptotic description of the signal recovery capabilities of PLS in this setting, revealing a fundamental performance gap between PLS and the Bayes-optimal estimator. In particular, we identify the SNR and correlation regimes where PLS fails to recover any signal, despite detectability being possible in principle. These findings clarify the theoretical limits of PLS and provide guidance for the design of reliable multi-modal inference methods in high dimensions.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 8 of its 47 references that are in the map. First posted on arXiv 20 Oct 2025.
Builds on
8 of 47 references.
References · 8
- 2023Multimodal Deep Learningcited by 257
- 2018Optimality and Sub-optimality of PCA I: Spiked Random Matrix Modelscited by 33
- 2023Optimal Inference in Contextual Stochastic Block Modelscited by 11
- 2019Canonical Correlation Analysis (CCA) Based Multi-View Learning: An Overviewcited by 10
- 2024Fundamental limits of community detection from multi-view data: multi-layer, dynamic and partially labeled block modelscited by 7
- 2023Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learningcited by 6
- 2025Computational Thresholds in Multi-Modal Learning via the Spiked Matrix-Tensor Modelcited by 5
- 2024Optimal thresholds and algorithms for a model of multi-modal learning in high dimensionscited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026Multi-layer Cross-attention is Provably Optimal for Multi-modal In-context Learningcited by 2
- 2026Information bottleneck for learning the phase space of dynamics from high-dimensional experimental datacited by 1
- 2026When to Align, When to Predict: A Phase Diagram for Multimodal Learningcited by 1
- 2025High-Dimensional Partial Least Squares: Spectral Analysis and Fundamental Limitationscited by 0
- 2026When to Align, When to Predict: A Phase Diagram for Multimodal Learning9 Jun 2026
- 2026Information bottleneck for learning the phase space of dynamics from high-dimensional experimental data27 Apr 2026
- 2026Multi-layer Cross-attention is Provably Optimal for Multi-modal In-context Learning4 Feb 2026
- 2025High-Dimensional Partial Least Squares: Spectral Analysis and Fundamental Limitations17 Dec 2025