Deep Generalized Canonical Correlation Analysis
Not on the map. Why?
Abstract (arXiv)
We present Deep Generalized Canonical Correlation Analysis (DGCCA) -- a method for learning nonlinear transformations of arbitrarily many views of data, such that the resulting transformations are maximally informative of each other. While methods for nonlinear two-view representation learning (Deep CCA, (Andrew et al., 2013)) and linear many-view representation learning (Generalized CCA (Horst, 1961)) exist, DGCCA is the first CCA-style multiview representation learning technique that combines the flexibility of nonlinear (deep) representation learning with the statistical power of incorporating information from many independent sources, or views. We present the DGCCA formulation as well as an efficient stochastic optimization algorithm for solving it. We learn DGCCA representations on two distinct datasets for three downstream tasks: phonetic transcription from acoustic and articulatory measurements, and recommending hashtags and friends on a dataset of Twitter users. We find that DGCCA representations soundly beat existing methods at phonetic transcription and hashtag recommendation, and in general perform no worse than standard linear many-view techniques.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 3; 2023: 9; 2024: 3; 2025: 9; 2026: 4.
32 papers.
Sort:
By area:
- 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 72
- 2023Understanding Multimodal Contrastive Learning and Incorporating Unpaired Datacited by 43
- 2021Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspectivecited by 37
- 2023Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Lossescited by 6
- 2023Revisiting Deep Generalized Canonical Correlation Analysiscited by 6
- 2025From Classical Machine Learning to Emerging Foundation Models: Review on Multimodal Data Integration for Cancer Researchcited by 6
- 2021Deep IDA: A Deep Learning Method for Integrative Discriminant Analysis of Multi-View Data with Feature Ranking -- An Application to COVID-19 severitycited by 5
- 2023Interpretable Deep Learning Methods for Multiview Learningcited by 5
- 2022SDGCCA: Supervised Deep Generalized Canonical Correlation Analysis for Multi-omics Integrationcited by 3
- 2023Scalable Randomized Kernel Methods for Multiview Data Integration and Predictioncited by 2
- 2023A Quantitative Approach to Understand Self-Supervised Models as Cross-lingual Feature Extractorscited by 2
- 2025Multimodal Data Storage and Retrieval for Embodied AI: A Surveycited by 2
20 more
- 2025Roles of MLLMs in Visually Rich Document Retrieval for RAG: A Surveycited by 2
- 2023Learning Representations without Compositional Assumptionscited by 1
- 2024Self Supervised Correlation-based Permutations for Multi-View Clusteringcited by 1
- 2024Preventing Model Collapse in Deep Canonical Correlation Analysis by Noise Regularizationcited by 1
- 2025Nonlinear Sparse Generalized Canonical Correlation Analysis for Multi-view High-dimensional Datacited by 1
- 2025Provable Affine Identifiability of Nonlinear CCA under Latent Distributional Priorscited by 1
- 2025Advanced Unsupervised Learning: A Comprehensive Overview of Multi-View Clustering Techniquescited by 1
- 2026Time Series, Vision, and Language: Exploring the Limits of Alignment in Contrastive Representation Spacescited by 1
- 2021Multi-view Deep One-class Classification: A Systematic Explorationcited by 0
- 2021Communication-Efficient Federated Linear and Deep Generalized Canonical Correlation Analysiscited by 0
- 2022Deep Multi-View Semi-Supervised Clustering with Sample Pairwise Constraintscited by 0
- 2022How do Cross-View and Cross-Modal Alignment Affect Representations in Contrastive Learning?cited by 0
- 2023A deep learning pipeline for cross-sectional and longitudinal multiview data integrationcited by 0
- 2024Brain-Cognition Fingerprinting via Graph-GCCA with Contrastive Learningcited by 0
- 2025Generalized probabilistic canonical correlation analysis for multi-modal data integration with full or partial observationscited by 0
- 2025Generative Flexible Latent Structure Regression (GFLSR) modelcited by 0
- 2025CLARGA: Multimodal Graph Representation Learning over Arbitrary Sets of Modalitiescited by 0
- 2026Emergent Structured Representations Support Flexible In-Context Inference in Large Language Modelscited by 0
- 2026Representation Selection via Cross-Model Agreement using Canonical Correlation Analysiscited by 0
- 2026Supervised Deep Multimodal Matrix Factorization for Interpretable Brain Network Analysiscited by 0
- 2026Supervised Deep Multimodal Matrix Factorization for Interpretable Brain Network Analysis13 May 2026
- 2026Representation Selection via Cross-Model Agreement using Canonical Correlation Analysis1 Apr 2026
- 2026Time Series, Vision, and Language: Exploring the Limits of Alignment in Contrastive Representation Spaces22 Feb 2026
- 2026Emergent Structured Representations Support Flexible In-Context Inference in Large Language Models8 Feb 2026
- 2025Roles of MLLMs in Visually Rich Document Retrieval for RAG: A Survey16 Dec 2025
- 2025CLARGA: Multimodal Graph Representation Learning over Arbitrary Sets of Modalities10 Dec 2025
- 2025Advanced Unsupervised Learning: A Comprehensive Overview of Multi-View Clustering Techniques4 Dec 2025
- 2025Provable Affine Identifiability of Nonlinear CCA under Latent Distributional Priors6 Oct 2025
- 2025Multimodal Data Storage and Retrieval for Embodied AI: A Survey19 Aug 2025
- 2025Generative Flexible Latent Structure Regression (GFLSR) model6 Aug 2025
- 2025From Classical Machine Learning to Emerging Foundation Models: Review on Multimodal Data Integration for Cancer Research11 Jul 2025
- 2025Generalized probabilistic canonical correlation analysis for multi-modal data integration with full or partial observations15 Apr 2025
20 more
- 2025Nonlinear Sparse Generalized Canonical Correlation Analysis for Multi-view High-dimensional Data26 Feb 2025
- 2024Preventing Model Collapse in Deep Canonical Correlation Analysis by Noise Regularization1 Nov 2024
- 2024Brain-Cognition Fingerprinting via Graph-GCCA with Contrastive Learning20 Sep 2024
- 2024Self Supervised Correlation-based Permutations for Multi-View Clustering26 Feb 2024
- 2023Revisiting Deep Generalized Canonical Correlation Analysis20 Dec 2023
- 2023A deep learning pipeline for cross-sectional and longitudinal multiview data integration2 Dec 2023
- 2023A Quantitative Approach to Understand Self-Supervised Models as Cross-lingual Feature Extractors27 Nov 2023
- 2023Multi-View Causal Representation Learning with Partial Observability7 Nov 2023
- 2023Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses5 Oct 2023
- 2023Learning Representations without Compositional Assumptions31 May 2023
- 2023Scalable Randomized Kernel Methods for Multiview Data Integration and Prediction10 Apr 2023
- 2023Interpretable Deep Learning Methods for Multiview Learning15 Feb 2023
- 2023Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data13 Feb 2023
- 2022How do Cross-View and Cross-Modal Alignment Affect Representations in Contrastive Learning?23 Nov 2022
- 2022Deep Multi-View Semi-Supervised Clustering with Sample Pairwise Constraints10 Jun 2022
- 2022SDGCCA: Supervised Deep Generalized Canonical Correlation Analysis for Multi-omics Integration17 Apr 2022
- 2021Deep IDA: A Deep Learning Method for Integrative Discriminant Analysis of Multi-View Data with Feature Ranking -- An Application to COVID-19 severity18 Nov 2021
- 2021Communication-Efficient Federated Linear and Deep Generalized Canonical Correlation Analysis25 Sep 2021
- 2021Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspective14 Jun 2021
- 2021Multi-view Deep One-class Classification: A Systematic Exploration27 Apr 2021
- 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 72
- 2023Understanding Multimodal Contrastive Learning and Incorporating Unpaired Datacited by 43
- 2021Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspectivecited by 37
- 2023Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Lossescited by 6
- 2023Revisiting Deep Generalized Canonical Correlation Analysiscited by 6
- 2025From Classical Machine Learning to Emerging Foundation Models: Review on Multimodal Data Integration for Cancer Researchcited by 6
- 2021Deep IDA: A Deep Learning Method for Integrative Discriminant Analysis of Multi-View Data with Feature Ranking -- An Application to COVID-19 severitycited by 5
- 2023Interpretable Deep Learning Methods for Multiview Learningcited by 5
- 2022SDGCCA: Supervised Deep Generalized Canonical Correlation Analysis for Multi-omics Integrationcited by 3
- 2023Scalable Randomized Kernel Methods for Multiview Data Integration and Predictioncited by 2
- 2023A Quantitative Approach to Understand Self-Supervised Models as Cross-lingual Feature Extractorscited by 2
- 2025Multimodal Data Storage and Retrieval for Embodied AI: A Surveycited by 2
12 most cited of 30 All 30 (JSON)
- 2026Supervised Deep Multimodal Matrix Factorization for Interpretable Brain Network Analysis13 May 2026
- 2026Representation Selection via Cross-Model Agreement using Canonical Correlation Analysis1 Apr 2026
- 2026Time Series, Vision, and Language: Exploring the Limits of Alignment in Contrastive Representation Spaces22 Feb 2026
- 2026Emergent Structured Representations Support Flexible In-Context Inference in Large Language Models8 Feb 2026
- 2025CLARGA: Multimodal Graph Representation Learning over Arbitrary Sets of Modalities10 Dec 2025
- 2025Advanced Unsupervised Learning: A Comprehensive Overview of Multi-View Clustering Techniques4 Dec 2025
- 2025Provable Affine Identifiability of Nonlinear CCA under Latent Distributional Priors6 Oct 2025
- 2025Multimodal Data Storage and Retrieval for Embodied AI: A Survey19 Aug 2025
- 2025Generative Flexible Latent Structure Regression (GFLSR) model6 Aug 2025
- 2025From Classical Machine Learning to Emerging Foundation Models: Review on Multimodal Data Integration for Cancer Research11 Jul 2025
- 2025Generalized probabilistic canonical correlation analysis for multi-modal data integration with full or partial observations15 Apr 2025
- 2025Nonlinear Sparse Generalized Canonical Correlation Analysis for Multi-view High-dimensional Data26 Feb 2025
12 newest of 30 All 30 (JSON)