Deep Variational Canonical Correlation Analysis
Not on the map. Why?
Abstract (arXiv)
We present deep variational canonical correlation analysis (VCCA), a deep multi-view learning model that extends the latent variable model interpretation of linear CCA to nonlinear observation models parameterized by deep neural networks. We derive variational lower bounds of the data likelihood by parameterizing the posterior probability of the latent variables from the view that is available at test time. We also propose a variant of VCCA called VCCA-private that can, in addition to the "common variables" underlying both views, extract the "private variables" within each view, and disentangles the shared and private information for multi-view data without hard supervision. Experimental results on real-world datasets show that our methods are competitive across domains.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Oct 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 6; 2022: 10; 2023: 8; 2024: 8; 2025: 6; 2026: 5.
44 papers.
Sort:
By area:
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
- 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 177
- 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 167
- 2021Trusted Multi-View Classificationcited by 94
- 2023Identifiability Results for Multimodal Contrastive Learningcited by 58
- 2022A survey of multimodal deep generative modelscited by 47
- 2023Understanding Multimodal Contrastive Learning and Incorporating Unpaired Datacited by 43
- 2021Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspectivecited by 37
- 2021Deep Co-Attention Network for Multi-View Subspace Learningcited by 17
- 2022Gacs-Korner Common Information Variational Autoencodercited by 12
- 2021Multimodal Variational Autoencoders for Semi-Supervised Learning: In Defense of Product-of-Expertscited by 9
- 2024A Survey on Deep Clustering: From the Prior Perspectivecited by 9
32 more
- 2021Disentangled Variational Information Bottleneck for Multiview Representation Learningcited by 8
- 2022Interpretability with full complexity by constraining feature informationcited by 7
- 2022Towards Robust Unsupervised Disentanglement of Sequential Data -- A Case Study Using Music Audiocited by 6
- 2022Multi-View Independent Component Analysis with Shared and Individual Sourcescited by 6
- 2023Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Lossescited by 6
- 2023Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learningcited by 6
- 2023Revisiting Deep Generalized Canonical Correlation Analysiscited by 6
- 2021Discriminative Multimodal Learning via Conditional Priors in Generative Modelscited by 4
- 2023Learning multi-modal generative models with permutation-invariant encoders and tighter variational objectivescited by 4
- 2025Disentanglement of Variations with Multimodal Generative Modelingcited by 4
- 2024Disentangling shared and private latent factors in multimodal Variational Autoencoderscited by 3
- 2024Identifiable Shared Component Analysis of Unpaired Multimodal Mixturescited by 3
- 2025Aggregation of Dependent Expert Distributions in Multimodal Variational Autoencoderscited by 3
- 2024Content-Style Learning from Unaligned Domains: Identifiability under Unknown Latent Dimensionscited by 2
- 2025Accurate Estimation of Mutual Information in High Dimensional Datacited by 2
- 2022Multimodal Generative Models for Bankruptcy Prediction Using Textual Datacited by 1
- 2023Improving Multimodal Joint Variational Autoencoders through Normalizing Flows and Correlation Analysiscited by 1
- 2024A tutorial on multi-view autoencoders using the multi-view-AE librarycited by 1
- 2024Unsupervised discovery of the shared and private geometry in multi-view datacited by 1
- 2024Preventing Model Collapse in Deep Canonical Correlation Analysis by Noise Regularizationcited by 1
- 2025Multi-view autoencoders for Fake News Detectioncited by 1
- 2026Content-Style Identification via Differential Independencecited by 1
- 2026Diff-CA: Separating Common and Salient Factors with Diffusion Modelscited by 1
- 2022Variational Interpretable Learning from Multi-view Datacited by 0
- 2022A Graphical Model for Fusing Diverse Microbiome Datacited by 0
- 2023Speech representation learning: Learning bidirectional encoders with single-view, multi-view, and multi-task methodscited by 0
- 2024Correlating Variational Autoencoders Natively For Multi-View Imputationcited by 0
- 2025InfoDPCCA: Information-Theoretic Dynamic Probabilistic Canonical Correlation Analysiscited by 0
- 2025No Data Wasted: A Semi-supervised Generative Model for Incomplete Multi-view Data Integration with Missing Labelscited by 0
- 2026H"older++: Improving the Quality-Coherence Trade-off in Multimodal VAEscited by 0
- 2026TreeCCA: Canonical Correlation Analysis via Gradient-Boosted Treescited by 0
- 2026Structured Latent Modeling for Supervised Multimodal Information Decompositioncited by 0
- 2026Structured Latent Modeling for Supervised Multimodal Information Decomposition28 Sep 2026
- 2026TreeCCA: Canonical Correlation Analysis via Gradient-Boosted Trees29 Jul 2026
- 2026H"older++: Improving the Quality-Coherence Trade-off in Multimodal VAEs11 Jun 2026
- 2026Diff-CA: Separating Common and Salient Factors with Diffusion Models4 Jun 2026
- 2026Content-Style Identification via Differential Independence18 May 2026
- 2025Disentanglement of Variations with Multimodal Generative Modeling28 Sep 2025
- 2025No Data Wasted: A Semi-supervised Generative Model for Incomplete Multi-view Data Integration with Missing Labels15 Aug 2025
- 2025InfoDPCCA: Information-Theoretic Dynamic Probabilistic Canonical Correlation Analysis10 Jun 2025
- 2025Accurate Estimation of Mutual Information in High Dimensional Data31 May 2025
- 2025Aggregation of Dependent Expert Distributions in Multimodal Variational Autoencoders2 May 2025
- 2025Multi-view autoencoders for Fake News Detection10 Apr 2025
- 2024Content-Style Learning from Unaligned Domains: Identifiability under Unknown Latent Dimensions6 Nov 2024
32 more
- 2024Correlating Variational Autoencoders Natively For Multi-View Imputation5 Nov 2024
- 2024Preventing Model Collapse in Deep Canonical Correlation Analysis by Noise Regularization1 Nov 2024
- 2024Identifiable Shared Component Analysis of Unpaired Multimodal Mixtures28 Sep 2024
- 2024Unsupervised discovery of the shared and private geometry in multi-view data22 Aug 2024
- 2024A Survey on Deep Clustering: From the Prior Perspective28 Jun 2024
- 2024A tutorial on multi-view autoencoders using the multi-view-AE library12 Mar 2024
- 2024Disentangling shared and private latent factors in multimodal Variational Autoencoders10 Mar 2024
- 2023Revisiting Deep Generalized Canonical Correlation Analysis20 Dec 2023
- 2023Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learning5 Oct 2023
- 2023Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses5 Oct 2023
- 2023Learning multi-modal generative models with permutation-invariant encoders and tighter variational objectives1 Sep 2023
- 2023Speech representation learning: Learning bidirectional encoders with single-view, multi-view, and multi-task methods25 Jul 2023
- 2023Improving Multimodal Joint Variational Autoencoders through Normalizing Flows and Correlation Analysis19 May 2023
- 2023Identifiability Results for Multimodal Contrastive Learning16 Mar 2023
- 2023Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data13 Feb 2023
- 2022Interpretability with full complexity by constraining feature information30 Nov 2022
- 2022Multimodal Generative Models for Bankruptcy Prediction Using Textual Data26 Oct 2022
- 2022Multi-View Independent Component Analysis with Shared and Individual Sources5 Oct 2022
- 2022A Graphical Model for Fusing Diverse Microbiome Data21 Aug 2022
- 2022A survey of multimodal deep generative models5 Jul 2022
- 2022Gacs-Korner Common Information Variational Autoencoder24 May 2022
- 2022Self-Supervised Speech Representation Learning: A Review21 May 2022
- 2022Towards Robust Unsupervised Disentanglement of Sequential Data -- A Case Study Using Music Audio12 May 2022
- 2022Trusted Multi-View Classification with Dynamic Evidential Fusion25 Apr 2022
- 2022Variational Interpretable Learning from Multi-view Data28 Feb 2022
- 2021Discriminative Multimodal Learning via Conditional Priors in Generative Models9 Oct 2021
- 2021Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspective14 Jun 2021
- 2021Disentangled Variational Information Bottleneck for Multiview Representation Learning17 May 2021
- 2021Deep Co-Attention Network for Multi-View Subspace Learning15 Feb 2021
- 2021Trusted Multi-View Classification3 Feb 2021
- 2021Multimodal Variational Autoencoders for Semi-Supervised Learning: In Defense of Product-of-Experts18 Jan 2021
- 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models8 Nov 2019
- 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 177
- 2021Multimodal Variational Autoencoders for Semi-Supervised Learning: In Defense of Product-of-Expertscited by 9
- 2023Learning multi-modal generative models with permutation-invariant encoders and tighter variational objectivescited by 4
- 2023Learning multi-modal generative models with permutation-invariant encoders and tighter variational objectives1 Sep 2023
- 2021Multimodal Variational Autoencoders for Semi-Supervised Learning: In Defense of Product-of-Experts18 Jan 2021
- 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models8 Nov 2019
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
- 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 167
- 2021Trusted Multi-View Classificationcited by 94
- 2023Identifiability Results for Multimodal Contrastive Learningcited by 58
- 2022A survey of multimodal deep generative modelscited by 47
- 2023Understanding Multimodal Contrastive Learning and Incorporating Unpaired Datacited by 43
- 2021Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspectivecited by 37
- 2021Deep Co-Attention Network for Multi-View Subspace Learningcited by 17
- 2022Gacs-Korner Common Information Variational Autoencodercited by 12
- 2024A Survey on Deep Clustering: From the Prior Perspectivecited by 9
- 2021Disentangled Variational Information Bottleneck for Multiview Representation Learningcited by 8
- 2022Interpretability with full complexity by constraining feature informationcited by 7
12 most cited of 39 All 39 (JSON)
- 2026Structured Latent Modeling for Supervised Multimodal Information Decomposition28 Sep 2026
- 2026TreeCCA: Canonical Correlation Analysis via Gradient-Boosted Trees29 Jul 2026
- 2026H"older++: Improving the Quality-Coherence Trade-off in Multimodal VAEs11 Jun 2026
- 2026Content-Style Identification via Differential Independence18 May 2026
- 2025Disentanglement of Variations with Multimodal Generative Modeling28 Sep 2025
- 2025No Data Wasted: A Semi-supervised Generative Model for Incomplete Multi-view Data Integration with Missing Labels15 Aug 2025
- 2025InfoDPCCA: Information-Theoretic Dynamic Probabilistic Canonical Correlation Analysis10 Jun 2025
- 2025Accurate Estimation of Mutual Information in High Dimensional Data31 May 2025
- 2025Aggregation of Dependent Expert Distributions in Multimodal Variational Autoencoders2 May 2025
- 2025Multi-view autoencoders for Fake News Detection10 Apr 2025
- 2024Content-Style Learning from Unaligned Domains: Identifiability under Unknown Latent Dimensions6 Nov 2024
- 2024Correlating Variational Autoencoders Natively For Multi-View Imputation5 Nov 2024
12 newest of 39 All 39 (JSON)