Prototype-Guided Cross-Modal Knowledge Enhancement for Adaptive Survival Prediction
Not on the map. Why?
Abstract (arXiv)
Histo-genomic multimodal survival prediction has garnered growing attention for its remarkable model performance and potential contributions to precision medicine. However, a significant challenge in clinical practice arises when only unimodal data is available, limiting the usability of these advanced multimodal methods. To address this issue, this study proposes a prototype-guided cross-modal knowledge enhancement (ProSurv) framework, which eliminates the dependency on paired data and enables robust learning and adaptive survival prediction. Specifically, we first introduce an intra-modal updating mechanism to construct modality-specific prototype banks that encapsulate the statistics of the whole training set and preserve the modality-specific risk-relevant features/prototypes across intervals. Subsequently, the proposed cross-modal translation module utilizes the learned prototypes to enhance knowledge representation for multimodal inputs and generate features for missing modalities, ensuring robust and adaptive survival prediction across diverse scenarios. Extensive experiments on four public datasets demonstrate the superiority of ProSurv over state-of-the-art methods using either unimodal or multimodal input, and the ablation study underscores its feasibility for broad applicability. Overall, this study addresses a critical practical challenge in computational pathology, offering substantial significance and potential impact in the field.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 13 of its 28 references that are in the map. First posted on arXiv 13 Mar 2025.
Builds on
13 of 28 references.
References · 13
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
- 2017Self-Normalizing Neural Networkscited by 598
- 2021Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attentioncited by 471
- 2023Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Predictioncited by 92
- 2024MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathologycited by 88
- 2023Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Predictioncited by 86
- 2023Cross-Modal Translation and Alignment for Survival Analysiscited by 70
- 2021Knowledge distillation from multi-modal to mono-modal segmentation networkscited by 68
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025PathFLIP: Fine-grained Language-Image Pretraining for Versatile Computational Pathologycited by 4
- 2026Prototype-driven fusion of pathology and spatial transcriptomics for interpretable survival predictioncited by 1
- 2026Hierarchical Prototype-based Domain Priors for Multiple Instance Learning in Multimodal Histopathology Analysiscited by 0
- 2026Hierarchical Prototype-based Domain Priors for Multiple Instance Learning in Multimodal Histopathology Analysis27 Apr 2026
- 2026Prototype-driven fusion of pathology and spatial transcriptomics for interpretable survival prediction12 Feb 2026
- 2025PathFLIP: Fine-grained Language-Image Pretraining for Versatile Computational Pathology19 Dec 2025