# A Generalized Deep Learning Framework for Whole-Slide Image Segmentation and Analysis

arXiv: https://arxiv.org/abs/2001.00258 · HTML: https://mlsanity.com/paper/2001.00258/

## Key facts

- Cited by 45 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Jan 2020.

## Built on by (most cited first, 30 of 45)

- [HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interaction](https://mlsanity.com/paper/2403.05396/) (2024)
- [Diagnose Like a Pathologist: Transformer-Enabled Hierarchical Attention-Guided Multiple Instance Learning for Whole Slide Image Classification](https://mlsanity.com/paper/2301.08125/) (2023)
- [Benchmarking common uncertainty estimation methods with histopathological images under domain shift and label noise](https://mlsanity.com/paper/2301.01054/) (2023)
- [Equipping Computational Pathology Systems with Artifact Processing Pipelines: A Showcase for Computation and Performance Trade-offs](https://mlsanity.com/paper/2403.07743/) (2024)
- [MulGT: Multi-task Graph-Transformer with Task-aware Knowledge Injection and Domain Knowledge-driven Pooling for Whole Slide Image Analysis](https://mlsanity.com/paper/2302.10574/) (2023)
- [Realistic Data Enrichment for Robust Image Segmentation in Histopathology](https://mlsanity.com/paper/2304.09534/) (2023)
- [Glo-In-One: Holistic Glomerular Detection, Segmentation, and Lesion Characterization with Large-scale Web Image Mining](https://mlsanity.com/paper/2206.00123/) (2022)
- [SEINE: Structure Encoding and Interaction Network for Nuclei Instance Segmentation](https://mlsanity.com/paper/2401.09773/) (2024)
- [Integrative Graph-Transformer Framework for Histopathology Whole Slide Image Representation and Classification](https://mlsanity.com/paper/2403.18134/) (2024)
- [Hybrid Supervision Learning for Pathology Whole Slide Image Classification](https://mlsanity.com/paper/2107.00934/) (2021)
- [Patient-specific, mechanistic models of tumor growth incorporating artificial intelligence and big data](https://mlsanity.com/paper/2308.14925/) (2023)
- [Boundary-aware Contrastive Learning for Semi-supervised Nuclei Instance Segmentation](https://mlsanity.com/paper/2402.04756/) (2024)
- [Brain Tumor Segmentation and Survival Prediction using Automatic Hard mining in 3D CNN Architecture](https://mlsanity.com/paper/2101.01546/) (2021)
- [Multi-domain stain normalization for digital pathology: A cycle-consistent adversarial network for whole slide images](https://mlsanity.com/paper/2301.09431/) (2023)
- [Dataset Distillation for Histopathology Image Classification](https://mlsanity.com/paper/2408.09709/) (2024)
- [The impact of tissue detection on diagnostic artificial intelligence algorithms in digital pathology](https://mlsanity.com/paper/2503.23021/) (2025)
- [OctreeNCA: Single-Pass 184 MP Segmentation on Consumer Hardware](https://mlsanity.com/paper/2508.06993/) (2025)
- [Variability Matters : Evaluating inter-rater variability in histopathology for robust cell detection](https://mlsanity.com/paper/2210.05175/) (2022)
- [MGPATH: Vision-Language Model with Multi-Granular Prompt Learning for Few-Shot WSI Classification](https://mlsanity.com/paper/2502.07409/) (2025)
- [Contrastive Integrated Gradients: A Feature Attribution-Based Method for Explaining Whole Slide Image Classification](https://mlsanity.com/paper/2511.08464/) (2025)
- [Colorectal Cancer Segmentation using Atrous Convolution and Residual Enhanced UNet](https://mlsanity.com/paper/2103.09289/) (2021)
- [Rapid Artefact Removal and H&E-Stained Tissue Segmentation](https://mlsanity.com/paper/2308.13304/) (2023)
- [EXAONE Path 2.5: Pathology Foundation Model with Multi-Omics Alignment](https://mlsanity.com/paper/2512.14019/) (2025)
- [Fast whole-slide cartography in colon cancer histology using superpixels and CNN classification](https://mlsanity.com/paper/2106.15893/) (2021)
- [Magnifying Networks for Images with Billions of Pixels](https://mlsanity.com/paper/2112.06121/) (2021)
- [When Medical Imaging Met Self-Attention: A Love Story That Didn't Quite Work Out](https://mlsanity.com/paper/2404.12295/) (2024)
- [Multi-Cohort Framework with Cohort-Aware Attention and Adversarial Mutual-Information Minimization for Whole Slide Image Classification](https://mlsanity.com/paper/2409.11119/) (2024)
- [A Novel Framework for the Automated Characterization of Gram-Stained Blood Culture Slides Using a Large-Scale Vision Transformer](https://mlsanity.com/paper/2409.15546/) (2024)
- [Vision Transformers with Autoencoders and Explainable AI for Cancer Patient Risk Stratification Using Whole Slide Imaging](https://mlsanity.com/paper/2504.04749/) (2025)
- [Set-based v.s. Distribution-based Representations of Epistemic Uncertainty: A Comparative Study](https://mlsanity.com/paper/2602.22747/) (2026)

## Abstract (arXiv)

Histopathology tissue analysis is considered the gold standard in cancer diagnosis and prognosis. Given the large size of these images and the increase in the number of potential cancer cases, an automated solution as an aid to histopathologists is highly desirable. In the recent past, deep learning-based techniques have provided state of the art results in a wide variety of image analysis tasks, including analysis of digitized slides. However, the size of images and variability in histopathology tasks makes it a challenge to develop an integrated framework for histopathology image analysis. We propose a deep learning-based framework for histopathology tissue analysis. We demonstrate the generalizability of our framework, including training and inference, on several open-source datasets, which include CAMELYON (breast cancer metastases), DigestPath (colon cancer), and PAIP (liver cancer) datasets. We discuss multiple types of uncertainties pertaining to data and model, namely aleatoric and epistemic, respectively. Simultaneously, we demonstrate our model generalization across different data distribution by evaluating some samples on TCGA data. On CAMELYON16 test data (n=139) for the task of lesion detection, the FROC score achieved was 0.86 and in the CAMELYON17 test-data (n=500) for the task of pN-staging the Cohen's kappa score achieved was 0.9090 (third in the open leaderboard). On DigestPath test data (n=212) for the task of tumor segmentation, a Dice score of 0.782 was achieved (fourth in the challenge). On PAIP test data (n=40) for the task of viable tumor segmentation, a Jaccard Index of 0.75 (third in the challenge) was achieved, and for viable tumor burden, a score of 0.633 was achieved (second in the challenge). Our entire framework and related documentation are freely available at GitHub and PyPi.
