Bridging the gap between Performance and Interpretability: An Explainable Disentangled Multimodal Framework for Cancer Survival Prediction
Not on the map. Why?
Abstract (arXiv)
While multimodal survival prediction models are increasingly more accurate, their complexity often reduces interpretability, limiting insight into how different data sources influence predictions. To address this, we introduce DIMAFx, an explainable multimodal framework for cancer survival prediction that produces disentangled, interpretable modality-specific and modality-shared representations from histopathology whole-slide images and transcriptomics data. Across multiple cancer cohorts, DIMAFx achieves state-of-the-art performance and improved representation disentanglement. Leveraging its interpretable design and SHapley Additive exPlanations, DIMAFx systematically reveals key multimodal interactions and the biological information encoded in the disentangled representations. In breast cancer survival prediction, the most predictive features contain modality-shared information, including one capturing solid tumor morphology contextualized primarily by late estrogen response, where higher-grade morphology aligned with pathway upregulation and increased risk, consistent with known breast cancer biology. Key modality-specific features capture microenvironmental signals from interacting adipose and stromal morphologies. These results show that multimodal models can overcome the traditional trade-off between performance and explainability, supporting their application in precision medicine.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 78 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
19 of 78 references.
References · 19
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
- 2017Self-Normalizing Neural Networkscited by 591
- 2019Interpretable machine learning: definitions, methods, and applicationscited by 303
- 2018Towards a Definition of Disentangled Representationscited by 294
- 2020A Survey on Neural Network Interpretabilitycited by 291
- 2023Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Predictioncited by 92
- 2023Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Predictioncited by 86
7 more
- 2023Cross-Modal Translation and Alignment for Survival Analysiscited by 70
- 2024Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathologycited by 70
- 2024Multimodal Prototyping for cancer survival predictioncited by 47
- 2020Measuring the Biases and Effectiveness of Content-Style Disentanglementcited by 14
- 2025Multimodal Cancer Survival Analysis via Hypergraph Learning with Cross-Modality Rebalancecited by 11
- 2024DRIM: Learning Disentangled Representations from Incomplete Multimodal Healthcare Datacited by 10
- 2025Disentangled and Interpretable Multimodal Attention Fusion for Cancer Survival Predictioncited by 4
Built on by
Not cited yet.