Estimating shared subspace with AJIVE: the power and limitation of multiple data matrices
Not on the map. Why?
Abstract (arXiv)
Integrative data analysis often requires disentangling joint and individual variations across multiple datasets, a challenge commonly addressed by the Joint and Individual Variation Explained (JIVE) model. While numerous methods have been developed to estimate the shared subspace under JIVE, the theoretical understanding of their performance remains limited, particularly in the context of multiple matrices and varying degrees of subspace misalignment. This paper bridges this gap by providing a systematic analysis of shared subspace estimation in multi-matrix settings. We focus on the Angle-based Joint and Individual Variation Explained (AJIVE) method, a two-stage spectral approach, and establish new performance guarantees that uncover its strengths and limitations. Specifically, we show that in high signal-to-noise ratio (SNR) regimes, AJIVE's estimation error decreases with the number of matrices, demonstrating the power of multi-matrix integration. Conversely, in low-SNR settings, AJIVE exhibits a non-diminishing error, highlighting fundamental limitations. To complement these results, we derive minimax lower bounds, showing that AJIVE achieves optimal rates in high-SNR regimes. Furthermore, we analyze an oracle-aided spectral estimator to demonstrate that the non-diminishing error in low-SNR scenarios is a fundamental barrier. Extensive numerical experiments corroborate our theoretical findings, providing insights into the interplay between SNR, the number of matrices, and subspace misalignment.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Jan 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025Stacked SVD or SVD stacked? A Random Matrix Theory perspective on data integrationcited by 6
- 2026Rethinking LoRA for Data Heterogeneous Federated Learning: Subspace and State Alignmentcited by 2
- 2025Inference on covariance structure in high-dimensional multi-view datacited by 1
- 2026Hierarchical Contrastive Learning for Multimodal Datacited by 0
- 2026Unveiling Invariant and Transferable Latent Factors Across Heterogeneous Environments via ATLAScited by 0
- 2026DAIF: A Data-Driven Intermediate Fusion Framework for Multimodal Supervised Learning via Approximate Message Passingcited by 0
- 2026Bias-Corrected Subspace Intersection: Minimax-Optimal Shared Subspace Estimation in Multi-View Datacited by 0
- 2026Bias-Corrected Subspace Intersection: Minimax-Optimal Shared Subspace Estimation in Multi-View Data4 Sep 2026
- 2026DAIF: A Data-Driven Intermediate Fusion Framework for Multimodal Supervised Learning via Approximate Message Passing3 Aug 2026
- 2026Unveiling Invariant and Transferable Latent Factors Across Heterogeneous Environments via ATLAS20 Jul 2026
- 2026Hierarchical Contrastive Learning for Multimodal Data7 Apr 2026
- 2026Rethinking LoRA for Data Heterogeneous Federated Learning: Subspace and State Alignment2 Feb 2026
- 2025Inference on covariance structure in high-dimensional multi-view data2 Sep 2025
- 2025Stacked SVD or SVD stacked? A Random Matrix Theory perspective on data integration29 Jul 2025