mlsanityData to 7 Oct 2026

A Variational Information Bottleneck Approach to Multi-Omics Data Integration

arXiv 2102.03014 ↗First posted 5 Feb 2021cs.LGcited by 40

Not on the map. Why?

Abstract (arXiv)

Integration of data from multiple omics techniques is becoming increasingly important in biomedical research. Due to non-uniformity and technical limitations in omics platforms, such integrative analyses on multiple omics, which we refer to as views, involve learning from incomplete observations with various view-missing patterns. This is challenging because i) complex interactions within and across observed views need to be properly addressed for optimal predictive power and ii) observations with various view-missing patterns need to be flexibly integrated. To address such challenges, we propose a deep variational information bottleneck (IB) approach for incomplete multi-view observations. Our method applies the IB framework on marginal and joint representations of the observed views to focus on intra-view and inter-view interactions that are relevant for the target. Most importantly, by modeling the joint representations as a product of marginal representations, we can efficiently learn from observed views with various view-missing patterns. Experiments on real-world datasets show that our method consistently achieves gain from data integration and outperforms state-of-the-art benchmarks.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 12 of its 35 references that are in the map. First posted on arXiv 5 Feb 2021.

Builds on

12 of 35 references.

References · 12

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Deep Variational Information Bottleneckcited by 915
  3. 2017Emergence of Invariance and Disentanglement in Deep Representationscited by 213
  4. 2018Multimodal Generative Models for Scalable Weakly-Supervised Learningcited by 200
  5. 2020Learning Robust Representations via Multi-View Information Bottleneckcited by 189
  6. 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 177
  7. 2018Learning Factorized Multimodal Representationscited by 171
  8. 2016On Deep Multi-View Representation Learning: Objectives and Optimizationcited by 162
  9. 2016A Survey of Multi-View Representation Learningcited by 107
  10. 2014Generalized Product of Experts for Automatic and Principled Fusion of Gaussian Process Predictionscited by 66
  11. 2015Structured Matrix Completion with Applications to Genomic Data Integrationcited by 17
  12. 2019Deep Multi-View Learning using Neuron-Wise Correlation-Maximizing Regularizerscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 6; 2023: 9; 2024: 9; 2025: 11; 2026: 4.

40 papers.

Sort:

By area:

  1. 2022Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representationscited by 48
  2. 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Predictioncited by 41
  3. 2021On the Limitations of Multimodal VAEscited by 37
  4. 2022Deep Multi-modal Fusion of Image and Non-image Data in Disease Diagnosis and Prognosis: A Reviewcited by 37
  5. 2024Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal Learningcited by 18
  6. 2023Calibrating Multimodal Learningcited by 17
  7. 2023Exploring and Exploiting Uncertainty for Incomplete Multi-View Classificationcited by 13
  8. 2023Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Lossescited by 6
  9. 2022Multi-view Information Bottleneck Without Variational Approximationcited by 5
  10. 2023Interpretable Deep Learning Methods for Multiview Learningcited by 5
  11. 2023Treatment Outcome Prediction for Intracerebral Hemorrhage via Generative Prognostic Model with Imaging and Tabular Datacited by 5
  12. 2024Evidential Deep Partial Multi-View Classification With Discount Fusioncited by 5
28 more
  1. 2023Learning multi-modal generative models with permutation-invariant encoders and tighter variational objectivescited by 4
  2. 2025Disentanglement of Variations with Multimodal Generative Modelingcited by 4
  3. 2026CyIN: Cyclic Informative Latent Space for Bridging Complete and Incomplete Multimodal Learningcited by 4
  4. 2022Encoding Domain Knowledge in Multi-view Latent Variable Models: A Bayesian Approach with Structured Sparsitycited by 3
  5. 2022Variational Distillation for Multi-View Learningcited by 3
  6. 2024Disentangling shared and private latent factors in multimodal Variational Autoencoderscited by 3
  7. 2024Discovering Common Information in Multi-view Datacited by 3
  8. 2025Robult: Leveraging Redundancy and Modality Specific Features for Robust Multimodal Learningcited by 3
  9. 2023CLCLSA: Cross-omics Linked embedding with Contrastive Learning and Self Attention for multi-omics integration with incomplete multi-omics datacited by 2
  10. 2024Meta-Learn Unimodal Signals with Weak Supervision for Multimodal Sentiment Analysiscited by 2
  11. 2025Interpretable Generative and Discriminative Learning for Multimodal and Incomplete Clinical Datacited by 2
  12. 2022Curriculum Learning Meets Weakly Supervised Modality Correlation Learningcited by 1
  13. 2024Integrate Any Omics: Towards genome-wide data integration for patient stratificationcited by 1
  14. 2024Towards Robust Uncertainty-Aware Incomplete Multi-View Classificationcited by 1
  15. 2025Multi-View Factorizing and Disentangling: A Novel Framework for Incomplete Multi-View Multi-Label Classificationcited by 1
  16. 2023Neuro-Inspired Hierarchical Multimodal Learningcited by 0
  17. 2023Self-supervised learning of multi-omics embeddings in the low-label, high-data regimecited by 0
  18. 2024Complementary Information Mutual Learning for Multimodality Medical Image Segmentationcited by 0
  19. 2025Reliable Multimodal Learning Via Multi-Level Adaptive DeConfusioncited by 0
  20. 2025Subset-Contrastive Multi-Omics Network Embeddingcited by 0
  21. 2025Are you SURE? Enhancing Multimodal Pretraining with Missing Modalities through Uncertainty Estimationcited by 0
  22. 2025Challenges and proposed solutions in modeling multimodal medical data: A systematic reviewcited by 0
  23. 2025Class Similarity-Based Multimodal Classification under Heterogeneous Category Setscited by 0
  24. 2025Consistency of Feature Attribution in Deep Learning Architectures for Multi-Omicscited by 0
  25. 2025No Data Wasted: A Semi-supervised Generative Model for Incomplete Multi-view Data Integration with Missing Labelscited by 0
  26. 2026Test-time Adaptive Hierarchical Co-enhanced Denoising Network for Reliable Multimodal Classificationcited by 0
  27. 2026Bayesian Integration of Nonlinear Incomplete Clinical Datacited by 0
  28. 2026Structured Latent Modeling for Supervised Multimodal Information Decompositioncited by 0