# Epithelium segmentation using deep learning in H&E-stained prostate specimens with immunohistochemistry as reference standard

arXiv: https://arxiv.org/abs/1808.05883 · HTML: https://mlsanity.com/paper/1808.05883/

## Key facts

- Cited by 25 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 17 Aug 2018.

## Built on by (most cited first, 25 of 25)

- [Artificial Intelligence for Digital and Computational Pathology](https://mlsanity.com/paper/2401.06148/) (2023)
- [Federated Learning for Medical Image Analysis: A Survey](https://mlsanity.com/paper/2306.05980/) (2023)
- [Comparison of Consecutive and Re-stained Sections for Image Registration in Histopathology](https://mlsanity.com/paper/2106.13150/) (2021)
- [Federated Stain Normalization for Computational Pathology](https://mlsanity.com/paper/2209.14849/) (2022)
- [Simultaneous Nuclear Instance and Layer Segmentation in Oral Epithelial Dysplasia](https://mlsanity.com/paper/2108.13904/) (2021)
- [Tissue Concepts: supervised foundation models in computational pathology](https://mlsanity.com/paper/2409.03519/) (2024)
- [Digital staining in optical microscopy using deep learning -- a review](https://mlsanity.com/paper/2303.08140/) (2023)
- [Jointly Exploring Client Drift and Catastrophic Forgetting in Dynamic Learning](https://mlsanity.com/paper/2309.00688/) (2023)
- [Spectral decoupling allows training transferable neural networks in medical imaging](https://mlsanity.com/paper/2103.17171/) (2021)
- [OctreeNCA: Single-Pass 184 MP Segmentation on Consumer Hardware](https://mlsanity.com/paper/2508.06993/) (2025)
- [A review of machine learning approaches, challenges and prospects for computational tumor pathology](https://mlsanity.com/paper/2206.01728/) (2022)
- [A Fully Automated and Explainable Algorithm for the Prediction of Malignant Transformation in Oral Epithelial Dysplasia](https://mlsanity.com/paper/2307.03757/) (2023)
- [A SSIM Guided cGAN Architecture For Clinically Driven Generative Image Synthesis of Multiplexed Spatial Proteomics Channels](https://mlsanity.com/paper/2205.10373/) (2022)
- [Deepfake histological images for enhancing digital pathology](https://mlsanity.com/paper/2206.08308/) (2022)
- [Learning Melanocytic Cell Masks from Adjacent Stained Tissue](https://mlsanity.com/paper/2211.00646/) (2022)
- [On the Value of PHH3 for Mitotic Figure Detection on H&E-stained Images](https://mlsanity.com/paper/2406.19899/) (2024)
- [Whole Slide Concepts: A Supervised Foundation Model For Pathological Images](https://mlsanity.com/paper/2507.05742/) (2025)
- [Atlas H&E-TME: Scalable AI-Based Tissue Profiling at Expert Pathologist-Level Accuracy](https://mlsanity.com/paper/2606.12346/) (2026)
- [A Pathologist-Informed Workflow for Classification of Prostate Glands in Histopathology](https://mlsanity.com/paper/2209.13408/) (2022)
- [Leveraging weak complementary labels to improve semantic segmentation of hepatocellular carcinoma and cholangiocarcinoma in H&E-stained slides](https://mlsanity.com/paper/2302.01813/) (2023)
- [Composite Biomarker Image for Advanced Visualization in Histopathology](https://mlsanity.com/paper/2304.12423/) (2023)
- [Automated Volume Corrected Mitotic Index Calculation Through Annotation-Free Deep Learning using Immunohistochemistry as Reference Standard](https://mlsanity.com/paper/2311.08949/) (2023)
- [Immunohistochemistry guided segmentation of benign epithelial cells, in situ lesions, and invasive epithelial cells in breast cancer slides](https://mlsanity.com/paper/2311.13261/) (2023)
- [Artificial Intelligence-Assisted Prostate Cancer Diagnosis for Reduced Use of Immunohistochemistry](https://mlsanity.com/paper/2504.00979/) (2025)
- [CoM3eT: A foundation model for medical image analysis through federated, multidimensional context integration](https://mlsanity.com/paper/2608.16268/) (2026)

## Abstract (arXiv)

Prostate cancer (PCa) is graded by pathologists by examining the architectural pattern of cancerous epithelial tissue on hematoxylin and eosin (H&E) stained slides. Given the importance of gland morphology, automatically differentiating between glandular epithelial tissue and other tissues is an important prerequisite for the development of automated methods for detecting PCa. We propose a new method, using deep learning, for automatically segmenting epithelial tissue in digitized prostatectomy slides. We employed immunohistochemistry (IHC) to render the ground truth less subjective and more precise compared to manual outlining on H&E slides, especially in areas with high-grade and poorly differentiated PCa. Our dataset consisted of 102 tissue blocks, including both low and high grade PCa. From each block a single new section was cut, stained with H&E, scanned, restained using P63 and CK8/18 to highlight the epithelial structure, and scanned again. The H&E slides were co-registered to the IHC slides. On a subset of the IHC slides we applied color deconvolution, corrected stain errors manually, and trained a U-Net to perform segmentation of epithelial structures. Whole-slide segmentation masks generated by the IHC U-Net were used to train a second U-Net on H&E. Our system makes precise cell-level segmentations and segments both intact glands as well as individual (tumor) epithelial cells. We achieved an F1-score of 0.895 on a hold-out test set and 0.827 on an external reference set from a different center. We envision this segmentation as being the first part of a fully automated prostate cancer detection and grading pipeline.