mlsanityData to 7 Oct 2026

Advancing Cancer Prognosis with Hierarchical Fusion of Genomic, Proteomic and Pathology Imaging Data from a Systems Biology Perspective

arXiv 2603.13787 ↗First posted 14 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

To enhance the precision of cancer prognosis, recent research has increasingly focused on multimodal survival methods by integrating genomic data and histology images. However, current approaches overlook the fact that the proteome serves as an intermediate layer bridging genomic alterations and histopathological features while providing complementary biological information essential for survival prediction. This biological reality exposes another architectural limitation: existing integrative analysis studies fuse these heterogeneous data sources in a flat manner that fails to capture their inherent biological hierarchy. To address these limitations, we propose HFGPI, a hierarchical fusion framework that models the biological progression from genes to proteins to histology images from a systems biology perspective. Specifically, we introduce Molecular Tokenizer, a molecular encoding strategy that integrates identity embeddings with expression profiles to construct biologically informed representations for genes and proteins. We then develop Gene-Regulated Protein Fusion (GRPF), which employs graph-aware cross-attention with structure-preserving alignment to explicitly model gene-protein regulatory relationships and generate gene-regulated protein representations. Additionally, we propose Protein-Guided Hypergraph Learning (PGHL), which establishes associations between proteins and image patches, leveraging hypergraph convolution to capture higher-order protein-morphology relationships. The final features are progressively fused across hierarchical layers to achieve precise survival outcome prediction. Extensive experiments on five benchmark datasets demonstrate the superiority of HFGPI over state-of-the-art methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 70 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

23 of 70 references.

References · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  5. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
  6. 2017Self-Normalizing Neural Networkscited by 591
  7. 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
  8. 2018Hypergraph Neural Networkscited by 482
  9. 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
  10. 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classificationcited by 254
  11. 2023Quilt-1M: One Million Image-Text Pairs for Histopathologycited by 192
  12. 2019Gromov-Wasserstein Learning for Graph Matching and Node Embeddingcited by 125
11 more
  1. 2023Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Predictioncited by 92
  2. 2023Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Predictioncited by 86
  3. 2023Cross-Modal Translation and Alignment for Survival Analysiscited by 70
  4. 2024Dynamic Graph Representation with Knowledge-aware Attention for Histopathology Whole Slide Image Analysiscited by 66
  5. 2024A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Modelcited by 59
  6. 2024Multimodal Prototyping for cancer survival predictioncited by 47
  7. 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Predictioncited by 41
  8. 2024MoME: Mixture of Multimodal Experts for Cancer Survival Predictioncited by 23
  9. 2025Robust Multimodal Survival Prediction with the Latent Differentiation Conditional Variational AutoEncodercited by 13
  10. 2025ICFNet: Integrated Cross-modal Fusion Network for Survival Predictioncited by 3
  11. 2025PS3: A Multimodal Transformer Integrating Pathology Reports with Histology Images and Biological Pathways for Cancer Survival Predictioncited by 3

Built on by

Not cited yet.