mlsanityData to 7 Oct 2026

Spatial Transcriptomics Analysis of Zero-shot Gene Expression Prediction

arXiv 2401.14772 ↗First posted 26 Jan 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Spatial transcriptomics (ST) captures gene expression within distinct regions (i.e., windows) of a tissue slide. Traditional supervised learning frameworks applied to model ST are constrained to predicting expression from slide image windows for gene types seen during training, failing to generalize to unseen gene types. To overcome this limitation, we propose a semantic guided network (SGN), a pioneering zero-shot framework for predicting gene expression from slide image windows. Considering a gene type can be described by functionality and phenotype, we dynamically embed a gene type to a vector per its functionality and phenotype, and employ this vector to project slide image windows to gene expression in feature space, unleashing zero-shot expression prediction for unseen gene types. The gene type functionality and phenotype are queried with a carefully designed prompt from a pre-trained large language model (LLM). On standard benchmark datasets, we demonstrate competitive zero-shot performance compared to past state-of-the-art supervised learning approaches.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 12 of its 19 references that are in the map. First posted on arXiv 26 Jan 2024.

Builds on

12 of 19 references.

References · 12

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2017Inductive Representation Learning on Large Graphscited by 6,284
  6. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  7. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
  8. 2023Zephyr: Direct Distillation of LM Alignmentcited by 498
  9. 2020A Review of Generalized Zero-Shot Learning Methodscited by 159
  10. 2022Exemplar Guided Deep Neural Network for Spatial Transcriptomics Analysis of Gene Expression Predictioncited by 39
  11. 2017A Unified approach for Conventional Zero-shot, Generalized Zero-shot and Few-shot Learningcited by 28
  12. 2023SEPAL: Spatial Gene Expression Prediction from Local Graphscited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 1.

6 papers.