mlsanityData to 7 Oct 2026

Cell-Type Prototype-Informed Neural Network for Gene Expression Estimation from Pathology Images

arXiv 2603.18461 ↗First posted 19 Mar 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Estimating slide- and patch-level gene expression profiles from pathology images enables rapid and low-cost molecular analysis with broad clinical impact. Despite strong results, existing approaches treat gene expression as a mere slide- or spot-level signal and do not incorporate the fact that the measured expression arises from the aggregation of underlying cell-level expression. To explicitly introduce this missing cell-resolved guidance, we propose a Cell-type Prototype-informed Neural Network (CPNN) that leverages publicly available single-cell RNA-sequencing datasets. Since single-cell measurements are noisy and not paired with histology images, we first estimate cell-type prototypes-mean expression profiles that reflect stable gene-gene co-variation patterns.CPNN then learns cell-type compositional weights directly from images and models the relationship between prototypes and observed bulk or spatial expression, providing a biologically grounded and structurally regularized prediction framework. We evaluate CPNN on three slide-level datasets and three patch-level spatial transcriptomics datasets. Across all settings, CPNN achieves the highest performance in terms of Spearman correlation. Moreover, by visualizing the inferred compositional weights, our framework provides interpretable insights into which cell types drive the predicted expression. Code is publicly available at https://github.com/naivete5656/CPNN.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 14 of its 50 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

14 of 50 references.

References · 14

  1. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  2. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  3. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
  4. 2016Revisiting Multiple Instance Neural Networkscited by 119
  5. 2024MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathologycited by 87
  6. 2023Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learningcited by 77
  7. 2024From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learningcited by 73
  8. 2024Accurate Spatial Gene Expression Prediction by integrating Multi-resolution featurescited by 52
  9. 2023Structured State Space Models for Multiple Instance Learning in Digital Pathologycited by 41
  10. 2022Exemplar Guided Deep Neural Network for Spatial Transcriptomics Analysis of Gene Expression Predictioncited by 39
  11. 20242DMamba: Efficient State Space Model for Image Representation with Applications on Giga-Pixel Whole Slide Image Classificationcited by 35
  12. 2024MERGE: Multi-faceted Hierarchical Graph-based GNN for Gene Expression Prediction from Whole Slide Histopathology Imagescited by 17
2 more
  1. 2022Learning to Predict RNA Sequence Expressions from Whole Slide Images with Applications for Search and Classificationcited by 14
  2. 2022Attention-based Interpretable Regression of Gene Expression in Histologycited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.