mlsanityData to 7 Oct 2026

MERGE: Multi-faceted Hierarchical Graph-based GNN for Gene Expression Prediction from Whole Slide Histopathology Images

arXiv 2412.02601 ↗First posted 3 Dec 2024cs.CVcited by 17

Not on the map. Why?

Abstract (arXiv)

Recent advances in Spatial Transcriptomics (ST) pair histology images with spatially resolved gene expression profiles, enabling predictions of gene expression across different tissue locations based on image patches. This opens up new possibilities for enhancing whole slide image (WSI) prediction tasks with localized gene expression. However, existing methods fail to fully leverage the interactions between different tissue locations, which are crucial for accurate joint prediction. To address this, we introduce MERGE (Multi-faceted hiErarchical gRaph for Gene Expressions), which combines a multi-faceted hierarchical graph construction strategy with graph neural networks (GNN) to improve gene expression predictions from WSIs. By clustering tissue image patches based on both spatial and morphological features, and incorporating intra- and inter-cluster edges, our approach fosters interactions between distant tissue locations during GNN learning. As an additional contribution, we evaluate different data smoothing techniques that are necessary to mitigate artifacts in ST data, often caused by technical imperfections. We advocate for adopting gene-aware smoothing methods that are more biologically justified. Experimental results on gene expression prediction show that our GNN method outperforms state-of-the-art techniques across multiple metrics.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 13 of its 44 references that are in the map. First posted on arXiv 3 Dec 2024.

Builds on

13 of 44 references.

References · 13

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2017Graph Attention Networkscited by 8,854
  5. 2016Densely Connected Convolutional Networkscited by 6,691
  6. 2017Inductive Representation Learning on Large Graphscited by 6,284
  7. 2016Layer Normalizationcited by 5,579
  8. 2022Patches Are All You Need?cited by 201
  9. 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 132
  10. 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 104
  11. 2023Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learningcited by 77
  12. 2024Accurate Spatial Gene Expression Prediction by integrating Multi-resolution featurescited by 52
1 more
  1. 2022Exemplar Guided Deep Neural Network for Spatial Transcriptomics Analysis of Gene Expression Predictioncited by 39

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 13.

17 papers.

Sort:

By area:

  1. 2026Cell-Type Prototype-Informed Neural Network for Gene Expression Estimation from Pathology Imagescited by 2
  2. 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression Generation from Histology Imagescited by 2
  3. 2025Gene-DML: Dual-Pathway Multi-Level Discrimination for Gene Expression Prediction from Histopathology Imagescited by 1
  4. 2025SIGMMA: Hierarchical Graph-Based Multi-Scale Multi-modal Contrastive Alignment of Histopathology Image and Spatial Transcriptomecited by 1
  5. 2026FEAST: Fully Connected Expressive Attention for Spatial Transcriptomicscited by 1
  6. 2025From Spots to Pixels: Dense Spatial Gene Expression Prediction from Histology Imagescited by 0
  7. 2025Learning from Gene Names, Expression Values and Images: Contrastive Masked Text-Image Pretraining for Spatial Transcriptomics Representation Learningcited by 0
  8. 2026DGA-Net: Enhancing SAM with Depth Prompting and Graph-Anchor Guidance for Camouflaged Object Detectioncited by 0
  9. 2026AINet: Anchor Instances Learning for Regional Heterogeneity in Whole Slide Imagecited by 0
  10. 2026Cross-Domain Molecular Relational Learning: Leveraging Chemical Structure-Activity Analysiscited by 0
  11. 2026FLAG: Foundation model representation with Latent diffusion Alignment via Graph for spatial gene expression predictioncited by 0
  12. 2026GC-MoE: Genomics-Guided Cell-Type-Specific Mixture of Experts for Histology-Based Single-Cell Spatial Transcriptomicscited by 0
5 more
  1. 2026Contrastive and Adaptive Multi-modal Masked Autoencoder for Spatial Transcriptomicscited by 0
  2. 2026HierarchicalDAEW: Domain-Aware Edge-Weighted Graph Convolution with Evidential Uncertainty for Multi-Section Spatial Gene Expression Prediction from H&E Histologycited by 0
  3. 2026Hyperbolic Contrastive Learning with Entailment for Spatial Transcriptomicscited by 0
  4. 2026Preserving DEG Rankings for Gene Discovery in Histology-Based Spatial Gene Expression Predictioncited by 0
  5. 2026GATE-ST: Gene-Aware Text-image Encoder for Spatial Transcriptomicscited by 0