Breast Cancer Histopathology Image based Gene Expression Prediction using Spatial Transcriptomics data and Deep Learning
Not on the map. Why?
Abstract (arXiv)
Tumour heterogeneity in breast cancer poses challenges in predicting outcome and response to therapy. Spatial transcriptomics technologies may address these challenges, as they provide a wealth of information about gene expression at the cell level, but they are expensive, hindering their use in large-scale clinical oncology studies. Predicting gene expression from hematoxylin and eosin stained histology images provides a more affordable alternative for such studies. Here we present BrST-Net, a deep learning framework for predicting gene expression from histopathology images using spatial transcriptomics data. Using this framework, we trained and evaluated 10 state-of-the-art deep learning models without utilizing pretrained weights for the prediction of 250 genes. To enhance the generalisation performance of the main network, we introduce an auxiliary network into the framework. Our methodology outperforms previous studies, with 237 genes identified with positive correlation, including 24 genes with a median correlation coefficient greater than 0.50. This is a notable improvement over previous studies, which could predict only 102 genes with positive correlation, with the highest correlation values ranging from 0.29 to 0.34.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 11 of its 42 references that are in the map. First posted on arXiv 17 Mar 2023.
Builds on
11 of 42 references.
References · 11
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2014Going Deeper with Convolutionscited by 4,241
- 2021A Comprehensive Review of Computer-aided Whole-slide Image Analysis: from Datasets to Feature Extraction, Segmentation, Classification, and Detection Approachescited by 44
- 2020A Comprehensive Review for Breast Histopathology Image Analysis Using Classical and Deep Neural Networkscited by 25
- 2017The importance of stain normalization in colorectal tissue classification with convolutional networkscited by 20
- 2020SDCT-AuxNetθ: DCT Augmented Stain Deconvolutional CNN with Auxiliary Classifier for Cancer Diagnosiscited by 7
- 2020Boosted EfficientNet: Detection of Lymph Node Metastases in Breast Cancer Using Convolutional Neural Networkcited by 5
- 2021Contextual Classification Using Self-Supervised Auxiliary Models for Deep Neural Networkscited by 2
- 2018Prediction of a Gene Regulatory Network from Gene Expression Profiles With Linear Regression and Pearson Correlation Coefficientcited by 1
Built on by
Citing papers per year: 2024: 3; 2025: 2.
5 papers.
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
- 2024Transcriptomics-guided Slide Representation Learning in Computational Pathologycited by 51
- 2025Spatial Transcriptomics Expression Prediction from Histopathology Based on Cross-Modal Mask Reconstruction and Contrastive Learningcited by 3
- 2025GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flowcited by 2
- 2024What makes for good morphology representations for spatial omics?cited by 0
- 2025GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flow31 Oct 2025
- 2025Spatial Transcriptomics Expression Prediction from Histopathology Based on Cross-Modal Mask Reconstruction and Contrastive Learning10 Jun 2025
- 2024What makes for good morphology representations for spatial omics?30 Jul 2024
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysis23 Jun 2024
- 2024Transcriptomics-guided Slide Representation Learning in Computational Pathology19 May 2024