Provable Subspace Identification of Nonlinear Multi-view CCA
Not on the map. Why?
Abstract (arXiv)
We investigate the identifiability of nonlinear canonical correlation analysis (CCA) in a multi-view setup, in which each view is generated by applying an unknown nonlinear map to a linear mixture of shared latent variables plus view-private noise. Rather than pursuing exact unmixing, which is known to be ill-posed under general nonlinear mixing, we instead reframe multi-view CCA as a basis-invariant subspace identification problem. Under suitable latent priors and spectral separation conditions, we prove that the pairwise population CCA objective recovers correlated signal subspaces up to view-wise orthogonal ambiguity. For N ≥ 3 views, their multi-view aggregation provably isolates the jointly correlated subspaces shared across all views while eliminating view-private variation. We further establish finite-sample statistical consistency guarantees by translating the concentration of empirical cross-covariances into explicit subspace error bounds via spectral perturbation theory. Experiments on synthetic and rendered image datasets support our theoretical findings and illustrate the necessity of the assumed conditions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 50 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
33 of 50 references.
References · 33
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
- 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 308
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
- 2020Whitening for Self-Supervised Representation Learningcited by 278
- 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 270
- 2020Weakly-Supervised Disentanglement Without Compromisescited by 237
- 2021Contrastive Learning Inverts the Data Generating Processcited by 220
- 2019The Incomplete Rosetta Stone Problem: Identifiability Results for Multi-View Nonlinear ICAcited by 86
- 2019Weakly Supervised Disentanglement with Guaranteescited by 82
21 more
- 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 72
- 2022Weakly Supervised Representation Learning with Sparse Perturbationscited by 64
- 2023Identifiability Results for Multimodal Contrastive Learningcited by 58
- 2016Rate-Optimal Perturbation Bounds for Singular Subspaces with Applications to High-Dimensional Statisticscited by 45
- 2021Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspectivecited by 37
- 2024A Sparsity Principle for Partially Observable Causal Representation Learningcited by 34
- 2023Unpaired Multi-Domain Causal Representation Learningcited by 32
- 2024Unifying Causal Representation Learning with the Invariance Principlecited by 30
- 2014Sparse CCA: Adaptive Estimation and Computational Barrierscited by 25
- 2022An Investigation into Whitening Loss for Self-supervised Learningcited by 21
- 2023The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learningcited by 13
- 2023Towards a Unified Framework of Contrastive Learning for Disentangled Representationscited by 13
- 2020Generalized Canonical Correlation Analysis: A Subspace Intersection Approachcited by 11
- 2022Multi-View Independent Component Analysis with Shared and Individual Sourcescited by 6
- 2023Revisiting Deep Generalized Canonical Correlation Analysiscited by 6
- 2024Whitening Consistently Improves Self-Supervised Learningcited by 5
- 2016Subspace Perspective on Canonical Correlation Analysis: Dimension Reduction and Minimax Ratescited by 4
- 2016Beyond CCA: Moment Matching for Multi-View Modelscited by 2
- 2022Provable Subspace Identification Under Post-Nonlinear Mixturescited by 2
- 2025Subspace Clustering of Subspaces: Unifying Canonical Correlation Analysis and Subspace Clusteringcited by 1
- 2025Provable Affine Identifiability of Nonlinear CCA under Latent Distributional Priorscited by 1
Built on by
Not cited yet.