mlsanityData to 14 Oct 2026

Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer

arXiv 2601.10386 ↗First posted 15 Jan 2026cs.CV cs.AI cs.MMcited by 1

Not on the map. Why?

Abstract (arXiv)

Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal Deep Learning (MDL) can improve precision prognosis, but small cohorts and missing modalities limit its clinical applicability, as conventional approaches enforce complete case filtering or imputation. We present a missing-aware multimodal survival framework that combines Computed Tomography (CT), Whole-Slide Histopathology Images (WSI), and structured clinical variables for overall survival modeling in unresectable stage II-III NSCLC. The framework uses Foundation Models (FMs) for modality-specific feature extraction and a missing-aware encoding strategy that enables intermediate multimodal fusion under naturally incomplete modality profiles. By design, the architecture processes all available data without dropping patients during training or inference. Intermediate fusion outperforms unimodal baselines and both early and late fusion strategies, with the trimodal configuration reaching a C-index of 74.42. Modality-importance analyses show that the fusion model adapts its reliance on each data stream according to representation informativeness, shaped by the alignment between FM pretraining objectives and the survival task. The learned risk scores produce clinically meaningful stratification of disease progression and metastatic risk, with statistically significant log-rank tests across all modality combinations, supporting the translational relevance of the proposed framework.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 51 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

18 of 51 references.

References · 18

  1. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  2. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
  3. 2019Neural Oblivious Decision Ensembles for Deep Learning on Tabular Datacited by 203
  4. 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 199
  5. 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
  6. 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
  7. 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 134
  8. 2024Merlin: A Computed Tomography Vision-Language Foundation Model and Datasetcited by 102
  9. 2022Integrated multimodal artificial intelligence framework for healthcare applicationscited by 71
  10. 2025Vision Foundation Models for Computed Tomographycited by 47
  11. 2023Artificial General Intelligence for Medical Imaging Analysiscited by 32
  12. 2022Multimodal Explainability via Latent Shift applied to COVID-19 stratificationcited by 16
6 more
  1. 2024Not Another Imputation Method: A Transformer-based Model for Missing Values in Tabular Datasetscited by 10
  2. 2023A Deep Learning Approach for Overall Survival Prediction in Lung Cancer with Missing Valuescited by 9
  3. 2025Benchmarking Foundation Models and Parameter-Efficient Fine-Tuning for Prognosis Prediction in Medical Imagingcited by 4
  4. 2023Conceptual Views on Tree Ensemble Classifierscited by 3
  5. 2022Multimodal Learning for Non-small Cell Lung Cancer Prognosiscited by 1
  6. 2025Comparison of the Cox proportional hazards model and Random Survival Forest algorithm for predicting patient-specific survival probabilities in clinical trial datacited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.