A Contrastive Variational AutoEncoder for NSCLC Survival Prediction with Missing Modalities
Not on the map. Why?
Abstract (arXiv)
Predicting survival outcomes for non-small cell lung cancer (NSCLC) patients is challenging due to the different individual prognostic features. This task can benefit from the integration of whole-slide images, bulk transcriptomics, and DNA methylation, which offer complementary views of the patient's condition at diagnosis. However, real-world clinical datasets are often incomplete, with entire modalities missing for a significant fraction of patients. State-of-the-art models rely on available data to create patient-level representations or use generative models to infer missing modalities, but they lack robustness in cases of severe missingness. We propose a Multimodal Contrastive Variational AutoEncoder (MCVAE) to address this issue: modality-specific variational encoders capture the uncertainty in each data source, and a fusion bottleneck with learned gating mechanisms is introduced to normalize the contributions from present modalities. We propose a multi-task objective that combines survival loss and reconstruction loss to regularize patient representations, along with a cross-modal contrastive loss that enforces cross-modal alignment in the latent space. During training, we apply stochastic modality masking to improve the robustness to arbitrary missingness patterns. Extensive evaluations on the TCGA-LUAD (n=475) and TCGA-LUSC (n=446) datasets demonstrate the efficacy of our approach in predicting disease-specific survival (DSS) and its robustness to severe missingness scenarios compared to two state-of-the-art models. Finally, we bring some clarifications on multimodal integration by testing our model on all subsets of modalities, finding that integration is not always beneficial to the task.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 41 references that are in the map. First posted on arXiv 19 Feb 2026.
Builds on
13 of 41 references.
References · 13
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 243
- 2023Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Predictioncited by 92
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 89
- 2022M3Care: Learning with Missing Modalities in Multimodal Healthcare Datacited by 71
- 2024A Clinical Benchmark of Public Self-Supervised Pathology Foundation Modelscited by 64
- 2025Accelerating Data Processing and Benchmarking of AI Models for Pathologycited by 58
- 2025Vision Foundation Models for Computed Tomographycited by 44
- 2019EmbraceNet: A robust deep learning architecture for multimodal classificationcited by 30
- 2025A Closer Look at Multimodal Representation Collapsecited by 25
1 more
Built on by
Not cited yet.