A Variational Information Bottleneck Approach to Multi-Omics Data Integration
Not on the map. Why?
Abstract (arXiv)
Integration of data from multiple omics techniques is becoming increasingly important in biomedical research. Due to non-uniformity and technical limitations in omics platforms, such integrative analyses on multiple omics, which we refer to as views, involve learning from incomplete observations with various view-missing patterns. This is challenging because i) complex interactions within and across observed views need to be properly addressed for optimal predictive power and ii) observations with various view-missing patterns need to be flexibly integrated. To address such challenges, we propose a deep variational information bottleneck (IB) approach for incomplete multi-view observations. Our method applies the IB framework on marginal and joint representations of the observed views to focus on intra-view and inter-view interactions that are relevant for the target. Most importantly, by modeling the joint representations as a product of marginal representations, we can efficiently learn from observed views with various view-missing patterns. Experiments on real-world datasets show that our method consistently achieves gain from data integration and outperforms state-of-the-art benchmarks.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 12 of its 35 references that are in the map. First posted on arXiv 5 Feb 2021.
Builds on
12 of 35 references.
References · 12
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Deep Variational Information Bottleneckcited by 915
- 2017Emergence of Invariance and Disentanglement in Deep Representationscited by 213
- 2018Multimodal Generative Models for Scalable Weakly-Supervised Learningcited by 200
- 2020Learning Robust Representations via Multi-View Information Bottleneckcited by 189
- 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 177
- 2018Learning Factorized Multimodal Representationscited by 171
- 2016On Deep Multi-View Representation Learning: Objectives and Optimizationcited by 162
- 2016A Survey of Multi-View Representation Learningcited by 107
- 2014Generalized Product of Experts for Automatic and Principled Fusion of Gaussian Process Predictionscited by 66
- 2015Structured Matrix Completion with Applications to Genomic Data Integrationcited by 17
- 2019Deep Multi-View Learning using Neuron-Wise Correlation-Maximizing Regularizerscited by 4
Built on by
Citing papers per year: 2021: 1; 2022: 6; 2023: 9; 2024: 9; 2025: 11; 2026: 4.
40 papers.
Sort:
By area:
- 2022Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representationscited by 48
- 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Predictioncited by 41
- 2021On the Limitations of Multimodal VAEscited by 37
- 2022Deep Multi-modal Fusion of Image and Non-image Data in Disease Diagnosis and Prognosis: A Reviewcited by 37
- 2024Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal Learningcited by 18
- 2023Calibrating Multimodal Learningcited by 17
- 2023Exploring and Exploiting Uncertainty for Incomplete Multi-View Classificationcited by 13
- 2023Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Lossescited by 6
- 2022Multi-view Information Bottleneck Without Variational Approximationcited by 5
- 2023Interpretable Deep Learning Methods for Multiview Learningcited by 5
- 2023Treatment Outcome Prediction for Intracerebral Hemorrhage via Generative Prognostic Model with Imaging and Tabular Datacited by 5
- 2024Evidential Deep Partial Multi-View Classification With Discount Fusioncited by 5
28 more
- 2023Learning multi-modal generative models with permutation-invariant encoders and tighter variational objectivescited by 4
- 2025Disentanglement of Variations with Multimodal Generative Modelingcited by 4
- 2026CyIN: Cyclic Informative Latent Space for Bridging Complete and Incomplete Multimodal Learningcited by 4
- 2022Encoding Domain Knowledge in Multi-view Latent Variable Models: A Bayesian Approach with Structured Sparsitycited by 3
- 2022Variational Distillation for Multi-View Learningcited by 3
- 2024Disentangling shared and private latent factors in multimodal Variational Autoencoderscited by 3
- 2024Discovering Common Information in Multi-view Datacited by 3
- 2025Robult: Leveraging Redundancy and Modality Specific Features for Robust Multimodal Learningcited by 3
- 2023CLCLSA: Cross-omics Linked embedding with Contrastive Learning and Self Attention for multi-omics integration with incomplete multi-omics datacited by 2
- 2024Meta-Learn Unimodal Signals with Weak Supervision for Multimodal Sentiment Analysiscited by 2
- 2025Interpretable Generative and Discriminative Learning for Multimodal and Incomplete Clinical Datacited by 2
- 2022Curriculum Learning Meets Weakly Supervised Modality Correlation Learningcited by 1
- 2024Integrate Any Omics: Towards genome-wide data integration for patient stratificationcited by 1
- 2024Towards Robust Uncertainty-Aware Incomplete Multi-View Classificationcited by 1
- 2025Multi-View Factorizing and Disentangling: A Novel Framework for Incomplete Multi-View Multi-Label Classificationcited by 1
- 2023Neuro-Inspired Hierarchical Multimodal Learningcited by 0
- 2023Self-supervised learning of multi-omics embeddings in the low-label, high-data regimecited by 0
- 2024Complementary Information Mutual Learning for Multimodality Medical Image Segmentationcited by 0
- 2025Reliable Multimodal Learning Via Multi-Level Adaptive DeConfusioncited by 0
- 2025Subset-Contrastive Multi-Omics Network Embeddingcited by 0
- 2025Are you SURE? Enhancing Multimodal Pretraining with Missing Modalities through Uncertainty Estimationcited by 0
- 2025Challenges and proposed solutions in modeling multimodal medical data: A systematic reviewcited by 0
- 2025Class Similarity-Based Multimodal Classification under Heterogeneous Category Setscited by 0
- 2025Consistency of Feature Attribution in Deep Learning Architectures for Multi-Omicscited by 0
- 2025No Data Wasted: A Semi-supervised Generative Model for Incomplete Multi-view Data Integration with Missing Labelscited by 0
- 2026Test-time Adaptive Hierarchical Co-enhanced Denoising Network for Reliable Multimodal Classificationcited by 0
- 2026Bayesian Integration of Nonlinear Incomplete Clinical Datacited by 0
- 2026Structured Latent Modeling for Supervised Multimodal Information Decompositioncited by 0
- 2026Structured Latent Modeling for Supervised Multimodal Information Decomposition28 Sep 2026
- 2026CyIN: Cyclic Informative Latent Space for Bridging Complete and Incomplete Multimodal Learning4 Feb 2026
- 2026Bayesian Integration of Nonlinear Incomplete Clinical Data2 Feb 2026
- 2026Test-time Adaptive Hierarchical Co-enhanced Denoising Network for Reliable Multimodal Classification12 Jan 2026
- 2025Interpretable Generative and Discriminative Learning for Multimodal and Incomplete Clinical Data10 Oct 2025
- 2025Disentanglement of Variations with Multimodal Generative Modeling28 Sep 2025
- 2025Robult: Leveraging Redundancy and Modality Specific Features for Robust Multimodal Learning3 Sep 2025
- 2025No Data Wasted: A Semi-supervised Generative Model for Incomplete Multi-view Data Integration with Missing Labels15 Aug 2025
- 2025Consistency of Feature Attribution in Deep Learning Architectures for Multi-Omics30 Jul 2025
- 2025Class Similarity-Based Multimodal Classification under Heterogeneous Category Sets11 Jun 2025
- 2025Challenges and proposed solutions in modeling multimodal medical data: A systematic review11 May 2025
- 2025Are you SURE? Enhancing Multimodal Pretraining with Missing Modalities through Uncertainty Estimation18 Apr 2025
28 more
- 2025Subset-Contrastive Multi-Omics Network Embedding15 Apr 2025
- 2025Reliable Multimodal Learning Via Multi-Level Adaptive DeConfusion27 Feb 2025
- 2025Multi-View Factorizing and Disentangling: A Novel Framework for Incomplete Multi-View Multi-Label Classification11 Jan 2025
- 2024Towards Robust Uncertainty-Aware Incomplete Multi-View Classification10 Sep 2024
- 2024Meta-Learn Unimodal Signals with Weak Supervision for Multimodal Sentiment Analysis28 Aug 2024
- 2024Evidential Deep Partial Multi-View Classification With Discount Fusion23 Aug 2024
- 2024Discovering Common Information in Multi-view Data21 Jun 2024
- 2024Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal Learning15 Apr 2024
- 2024Disentangling shared and private latent factors in multimodal Variational Autoencoders10 Mar 2024
- 2024Integrate Any Omics: Towards genome-wide data integration for patient stratification15 Jan 2024
- 2024Complementary Information Mutual Learning for Multimodality Medical Image Segmentation5 Jan 2024
- 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Prediction3 Jan 2024
- 2023Self-supervised learning of multi-omics embeddings in the low-label, high-data regime16 Nov 2023
- 2023Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses5 Oct 2023
- 2023Neuro-Inspired Hierarchical Multimodal Learning27 Sep 2023
- 2023Learning multi-modal generative models with permutation-invariant encoders and tighter variational objectives1 Sep 2023
- 2023Treatment Outcome Prediction for Intracerebral Hemorrhage via Generative Prognostic Model with Imaging and Tabular Data24 Jul 2023
- 2023Calibrating Multimodal Learning2 Jun 2023
- 2023CLCLSA: Cross-omics Linked embedding with Contrastive Learning and Self Attention for multi-omics integration with incomplete multi-omics data12 Apr 2023
- 2023Exploring and Exploiting Uncertainty for Incomplete Multi-View Classification11 Apr 2023
- 2023Interpretable Deep Learning Methods for Multiview Learning15 Feb 2023
- 2022Curriculum Learning Meets Weakly Supervised Modality Correlation Learning15 Dec 2022
- 2022Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations31 Oct 2022
- 2022Variational Distillation for Multi-View Learning20 Jun 2022
- 2022Multi-view Information Bottleneck Without Variational Approximation22 Apr 2022
- 2022Encoding Domain Knowledge in Multi-view Latent Variable Models: A Bayesian Approach with Structured Sparsity13 Apr 2022
- 2022Deep Multi-modal Fusion of Image and Non-image Data in Disease Diagnosis and Prognosis: A Review25 Mar 2022
- 2021On the Limitations of Multimodal VAEs8 Oct 2021
- 2022Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representationscited by 48
- 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Predictioncited by 41
- 2021On the Limitations of Multimodal VAEscited by 37
- 2022Deep Multi-modal Fusion of Image and Non-image Data in Disease Diagnosis and Prognosis: A Reviewcited by 37
- 2024Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal Learningcited by 18
- 2023Calibrating Multimodal Learningcited by 17
- 2023Exploring and Exploiting Uncertainty for Incomplete Multi-View Classificationcited by 13
- 2023Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Lossescited by 6
- 2022Multi-view Information Bottleneck Without Variational Approximationcited by 5
- 2023Interpretable Deep Learning Methods for Multiview Learningcited by 5
- 2023Treatment Outcome Prediction for Intracerebral Hemorrhage via Generative Prognostic Model with Imaging and Tabular Datacited by 5
- 2024Evidential Deep Partial Multi-View Classification With Discount Fusioncited by 5
12 most cited of 39 All 39 (JSON)
- 2026Structured Latent Modeling for Supervised Multimodal Information Decomposition28 Sep 2026
- 2026CyIN: Cyclic Informative Latent Space for Bridging Complete and Incomplete Multimodal Learning4 Feb 2026
- 2026Bayesian Integration of Nonlinear Incomplete Clinical Data2 Feb 2026
- 2026Test-time Adaptive Hierarchical Co-enhanced Denoising Network for Reliable Multimodal Classification12 Jan 2026
- 2025Interpretable Generative and Discriminative Learning for Multimodal and Incomplete Clinical Data10 Oct 2025
- 2025Disentanglement of Variations with Multimodal Generative Modeling28 Sep 2025
- 2025Robult: Leveraging Redundancy and Modality Specific Features for Robust Multimodal Learning3 Sep 2025
- 2025No Data Wasted: A Semi-supervised Generative Model for Incomplete Multi-view Data Integration with Missing Labels15 Aug 2025
- 2025Consistency of Feature Attribution in Deep Learning Architectures for Multi-Omics30 Jul 2025
- 2025Class Similarity-Based Multimodal Classification under Heterogeneous Category Sets11 Jun 2025
- 2025Challenges and proposed solutions in modeling multimodal medical data: A systematic review11 May 2025
- 2025Are you SURE? Enhancing Multimodal Pretraining with Missing Modalities through Uncertainty Estimation18 Apr 2025
12 newest of 39 All 39 (JSON)