Quantifying Cross-Modal Interactions in Multimodal Glioma Survival Prediction via InterSHAP: Evidence for Additive Signal Integration
Not on the map. Why?
Abstract (arXiv)
Multimodal deep learning for cancer prognosis is commonly assumed to benefit from synergistic cross-modal interactions, yet this assumption has not been directly tested in survival prediction settings. This work adapts InterSHAP, a Shapley interaction index-based metric, from classification to Cox proportional hazards models and applies it to quantify cross-modal interactions in glioma survival prediction. Using TCGA-GBM and TCGA-LGG data (n=575), we evaluate four fusion architectures combining whole-slide image (WSI) and RNA-seq features. Our central finding is an inverse relationship between predictive performance and measured interaction: architectures achieving superior discrimination (C-index 0.64→0.82) exhibit equivalent or lower cross-modal interaction (4.8%→3.0%). Variance decomposition reveals stable additive contributions across all architectures (WSI≈40%, RNA≈55%, Interaction≈4%), indicating that performance gains arise from complementary signal aggregation rather than learned synergy. These findings provide a practical model auditing tool for comparing fusion strategies, reframe the role of architectural complexity in multimodal fusion, and have implications for privacy-preserving federated deployment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 15 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
7 of 15 references.
References · 7
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
- 2016The Mythos of Model Interpretabilitycited by 716
- 2018Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challengecited by 508
- 2024Measuring Cross-Modal Interactions in Multimodal Modelscited by 16
Built on by
Not cited yet.