Spatial Transcriptomics Analysis of Zero-shot Gene Expression Prediction
Not on the map. Why?
Abstract (arXiv)
Spatial transcriptomics (ST) captures gene expression within distinct regions (i.e., windows) of a tissue slide. Traditional supervised learning frameworks applied to model ST are constrained to predicting expression from slide image windows for gene types seen during training, failing to generalize to unseen gene types. To overcome this limitation, we propose a semantic guided network (SGN), a pioneering zero-shot framework for predicting gene expression from slide image windows. Considering a gene type can be described by functionality and phenotype, we dynamically embed a gene type to a vector per its functionality and phenotype, and employ this vector to project slide image windows to gene expression in feature space, unleashing zero-shot expression prediction for unseen gene types. The gene type functionality and phenotype are queried with a carefully designed prompt from a pre-trained large language model (LLM). On standard benchmark datasets, we demonstrate competitive zero-shot performance compared to past state-of-the-art supervised learning approaches.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 12 of its 19 references that are in the map. First posted on arXiv 26 Jan 2024.
Builds on
12 of 19 references.
References · 12
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
- 2023Zephyr: Direct Distillation of LM Alignmentcited by 498
- 2020A Review of Generalized Zero-Shot Learning Methodscited by 159
- 2022Exemplar Guided Deep Neural Network for Spatial Transcriptomics Analysis of Gene Expression Predictioncited by 39
- 2017A Unified approach for Conventional Zero-shot, Generalized Zero-shot and Few-shot Learningcited by 28
- 2023SEPAL: Spatial Gene Expression Prediction from Local Graphscited by 13
Built on by
Citing papers per year: 2025: 5; 2026: 1.
6 papers.
- 2025Enhancing Features in Long-tailed Data Using Large Vision Modelcited by 2
- 2025Dual-Path Knowledge-Augmented Contrastive Alignment Network for Spatially Resolved Transcriptomicscited by 2
- 2025CLIP-IT: CLIP-based Pairing for Histology Images Classificationcited by 1
- 2025Gene-DML: Dual-Pathway Multi-Level Discrimination for Gene Expression Prediction from Histopathology Imagescited by 1
- 2025From Spots to Pixels: Dense Spatial Gene Expression Prediction from Histology Imagescited by 0
- 2026GATE-ST: Gene-Aware Text-image Encoder for Spatial Transcriptomicscited by 0
- 2026GATE-ST: Gene-Aware Text-image Encoder for Spatial Transcriptomics30 Sep 2026
- 2025Dual-Path Knowledge-Augmented Contrastive Alignment Network for Spatially Resolved Transcriptomics21 Nov 2025
- 2025Gene-DML: Dual-Pathway Multi-Level Discrimination for Gene Expression Prediction from Histopathology Images19 Jul 2025
- 2025CLIP-IT: CLIP-based Pairing for Histology Images Classification22 Apr 2025
- 2025Enhancing Features in Long-tailed Data Using Large Vision Model15 Apr 2025
- 2025From Spots to Pixels: Dense Spatial Gene Expression Prediction from Histology Images3 Mar 2025