mlsanityData to 14 Oct 2026

Genomics-guided Representation Learning for Pathologic Pan-cancer Tumor Microenvironment Subtype Prediction

arXiv 2406.06517 ↗First posted 10 Jun 2024cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

The characterization of Tumor MicroEnvironment (TME) is challenging due to its complexity and heterogeneity. Relatively consistent TME characteristics embedded within highly specific tissue features, render them difficult to predict. The capability to accurately classify TME subtypes is of critical significance for clinical tumor diagnosis and precision medicine. Based on the observation that tumors with different origins share similar microenvironment patterns, we propose PathoTME, a genomics-guided Siamese representation learning framework employing Whole Slide Image (WSI) for pan-cancer TME subtypes prediction. Specifically, we utilize Siamese network to leverage genomic information as a regularization factor to assist WSI embeddings learning during the training phase. Additionally, we employ Domain Adversarial Neural Network (DANN) to mitigate the impact of tissue type variations. To eliminate domain bias, a dynamic WSI prompt is designed to further unleash the model's capabilities. Our model achieves better performance than other state-of-the-art methods across 23 cancer types on TCGA dataset. Our code is available at https://github.com/Mengflz/PathoTME.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 10 Jun 2024.

Builds on

18 of 36 references.

References · 18

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  3. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  4. 2020Supervised Contrastive Learningcited by 2,829
  5. 2022Visual Prompt Tuningcited by 1,681
  6. 2018Attention-based Deep Multiple Instance Learningcited by 1,095
  7. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
  8. 2017Self-Normalizing Neural Networkscited by 598
  9. 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 478
  10. 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
  11. 2023Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learningcited by 79
  12. 2023Cross-Modal Translation and Alignment for Survival Analysiscited by 70
6 more
  1. 2022Self-Supervised Vision Transformers Learn Visual Concepts in Histopathologycited by 50
  2. 2023Pathology-and-genomics Multimodal Transformer for Survival Outcome Predictioncited by 32
  3. 2022Survival Prediction of Brain Cancer with Incomplete Radiology, Pathology, Genomics, and Demographic Datacited by 25
  4. 2022Multi-modal learning for predicting the genotype of gliomacited by 15
  5. 2023Multi-task Learning of Histology and Molecular Markers for Classifying Diffuse Gliomacited by 12
  6. 2023Gene-induced Multimodal Pre-training for Image-omic Classificationcited by 9

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.