PanNuke Dataset Extension, Insights and Baselines
Not on the map. Why?
Abstract (arXiv)
The emerging area of computational pathology (CPath) is ripe ground for the application of deep learning (DL) methods to healthcare due to the sheer volume of raw pixel data in whole-slide images (WSIs) of cancerous tissue slides. However, it is imperative for the DL algorithms relying on nuclei-level details to be able to cope with data from `the clinical wild', which tends to be quite challenging. We study, and extend recently released PanNuke dataset consisting of ~200,000 nuclei categorized into 5 clinically important classes for the challenging tasks of segmenting and classifying nuclei in WSIs. Previous pan-cancer datasets consisted of only up to 9 different tissues and up to 21,000 unlabeled nuclei and just over 24,000 labeled nuclei with segmentation masks. PanNuke consists of 19 different tissue types that have been semi-automatically annotated and quality controlled by clinical pathologists, leading to a dataset with statistics similar to the clinical wild and with minimal selection bias. We study the performance of segmentation and classification models when applied to the proposed dataset and demonstrate the application of models trained on PanNuke to whole-slide images. We provide comprehensive statistics about the dataset and outline recommendations and research directions to address the limitations of existing DL tools when applied to real-world CPath applications.
Key facts. Cited by 113 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 7; 2023: 19; 2024: 25; 2025: 23; 2026: 27.
113 papers.
Sort:
By area:
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 217
- 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 107
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 104
- 2024GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AIcited by 96
- 2021Lizard: A Large-Scale Dataset for Colonic Nuclear Instance Segmentation and Classificationcited by 89
- 2024MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicinecited by 79
- 2024Hibou: A Family of Foundational Vision Transformers for Pathologycited by 52
- 2021CryoNuSeg: A Dataset for Nuclei Instance Segmentation of Cryosectioned H&E-Stained Histological Imagescited by 50
- 2023Histopathology Whole Slide Image Analysis with Heterogeneous Graph Representation Learningcited by 47
- 2023ScribblePrompt: Fast and Flexible Interactive Segmentation for Any Biomedical Imagecited by 47
- 2021CoNIC: Colon Nuclei Identification and Counting Challenge 2022cited by 44
38 more
- 2022One Model is All You Need: Multi-Task Learning Enables Simultaneous Histology Image Segmentation and Classificationcited by 38
- 2021NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentationcited by 33
- 2023CoNIC Challenge: Pushing the Frontiers of Nuclear Detection, Segmentation, Classification and Countingcited by 33
- 2021CPP-Net: Context-aware Polygon Proposal Network for Nucleus Segmentationcited by 32
- 2023OCELOT: Overlapped Cell on Tissue Dataset for Histopathologycited by 29
- 2023Domain Generalization in Computational Pathology: Survey and Guidelinescited by 29
- 2024FedFMS: Exploring Federated Foundation Models for Medical Image Segmentationcited by 21
- 2021HistoCartography: A Toolkit for Graph Analytics in Digital Pathologycited by 20
- 2024Tyche: Stochastic In-Context Learning for Medical Image Segmentationcited by 20
- 2023Unleashing the Power of Prompt-driven Nucleus Instance Segmentationcited by 19
- 2023Rotation-Agnostic Image Representation Learning for Digital Pathologycited by 15
- 2023Structure Embedded Nucleus Classification for Histopathology Imagescited by 14
- 2026MedMO: Grounding and Understanding Multimodal Large Language Model for Medical Imagescited by 12
- 2024MultiverSeg: Scalable Interactive Segmentation of Biomedical Imaging Datasets with In-Context Guidancecited by 11
- 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretationcited by 10
- 2022Recent Progress in Transformer-based Medical Image Analysiscited by 9
- 2024Cell Graph Transformer for Nuclei Classificationcited by 9
- 2021Nuclei Grading of Clear Cell Renal Cell Carcinoma in Histopathological Image by Composite High-Resolution Networkcited by 8
- 2021Robust Interactive Semantic Segmentation of Pathology Images with Minimal User Inputcited by 8
- 2021Simultaneous Nuclear Instance and Layer Segmentation in Oral Epithelial Dysplasiacited by 8
- 2021PointNu-Net: Keypoint-assisted Convolutional Neural Network for Simultaneous Multi-tissue Histology Nuclei Segmentation and Classificationcited by 8
- 2022Recommendations on test datasets for evaluating AI solutions in pathologycited by 8
- 2024DAWN: Domain-Adaptive Weakly Supervised Nuclei Segmentation via Cross-Task Interactionscited by 8
- 2024Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Modelscited by 8
- 2024Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Modelcited by 8
- 2025PathOrchestra: A Comprehensive Foundation Model for Computational Pathology with Over 100 Diverse Clinical-Grade Taskscited by 8
- 2021Now You See It, Now You Dont: Adversarial Vulnerabilities in Computational Pathologycited by 7
- 2021All You Need is Color: Image based Spatial Gene Expression Prediction using Neural Stain Learningcited by 7
- 2022Mitosis Detection, Fast and Slow: Robust and Efficient Detection of Mitotic Figurescited by 6
- 2022SynCLay: Interactive Synthesis of Histology Images from Bespoke Cellular Layoutscited by 6
- 2023VOLTA: an Environment-Aware Contrastive Cell Representation Learning for Histopathologycited by 6
- 2024SEINE: Structure Encoding and Interaction Network for Nuclei Instance Segmentationcited by 6
- 2025Self-Paced Learning for Images of Antinuclear Antibodiescited by 6
- 2022Single-Stage Broad Multi-Instance Multi-Label Learning (BMIML) with Diverse Inter-Correlations and its application to medical image classificationcited by 5
- 2025Towards Effective and Efficient Context-aware Nucleus Detection in Histopathology Whole Slide Imagescited by 5
- 2022A Pragmatic Machine Learning Approach to Quantify Tumor Infiltrating Lymphocytes in Whole Slide Imagescited by 4
- 2023HoVer-UNet: Accelerating HoVerNet with UNet-based multi-class nuclei segmentation via knowledge distillationcited by 4
- 2024Histopathological Image Classification with Cell Morphology Aware Deep Neural Networkscited by 4
50 most cited of 113 All 113 (JSON)
- 2026HERO: Histology Encoder for Robust Representation in Oncology28 Sep 2026
- 2026See, Measure, and Reason: Learning Visually Grounded Reasoning in Pathology28 Sep 2026
- 2026Compositional Reward Models for Conditional Medical Image Generation4 Sep 2026
- 2026The Good, the Bad, and the Brittle: Benchmarking Robustness and Generalisation of Histopathology Foundation Models5 Jul 2026
- 2026HASSL: Hierarchy-Aware Self-Supervised Learning Framework for Single Cell Microscopy5 Jul 2026
- 2026CellDETR: A Detection-Guided Framework for Scalable Cell Representation Learning from Histopathology Images28 Jun 2026
- 2026SegTME-UNI2: A Foundation Model-Based Framework for Generalisable Multiclass Cell Segmentation and LLM-Driven Tumour Microenvironment Characterisation in Histopathology16 Jun 2026
- 2026Atlas H&E-TME: Scalable AI-Based Tissue Profiling at Expert Pathologist-Level Accuracy10 Jun 2026
- 2026Shift-Dependent Asymmetry: Orthogonal Inverse Low-Rank Adaptation for Federated Medical Segmentation7 Jun 2026
- 2026One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensembling6 Jun 2026
- 2026DualGate-Net: A Prior-Gated Dual-Encoder Framework for Histopathology Cell Detection5 Jun 2026
- 2026MedSIGHT: Towards Grounded Visual Comprehension in Medical Large Vision-Language Models4 Jun 2026
38 more
- 2026PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Images1 Jun 2026
- 2026Biological Spatial Priors Regularize Foundation Model Representations for Cross-Site MSI Generalization in Colorectal Cancer4 May 2026
- 2026Leveraging Spatial Transcriptomics as Alternative to Manual Annotations for Deep Learning-Based Nuclei Analysis26 Apr 2026
- 2026Cell Instance Segmentation via Multi-Task Image-to-Image Schr"odinger Bridge14 Apr 2026
- 2026OpenTME: An Open Dataset of AI-powered H&E Tumor Microenvironment Profiles from TCGA13 Apr 2026
- 2026Adapting SAM to Nuclei Instance Segmentation and Classification via Cooperative Fine-Grained Refinement30 Mar 2026
- 2026Central-to-Local Adaptive Generative Diffusion Framework for Improving Gene Expression Prediction in Data-Limited Spatial Transcriptomics27 Mar 2026
- 2026LEMON: a foundation model for nuclear morphology in Computational Pathology26 Mar 2026
- 2026Evaluating Vision Foundation Models for Pixel and Object Classification in Microscopy20 Mar 2026
- 2026Revisiting foundation models for cell instance segmentation18 Mar 2026
- 2026NuNext: Reframing Nucleus Detection as Next-Point Detection7 Mar 2026
- 2026Prompt Group-Aware Training for Robust Text-Guided Nuclei Segmentation6 Mar 2026
- 2026MedMO: Grounding and Understanding Multimodal Large Language Model for Medical Images6 Feb 2026
- 2026DSFedMed: Dual-Scale Federated Medical Image Segmentation via Mutual Distillation Between Foundation and Lightweight Models22 Jan 2026
- 2026LSP-DETR: Efficient and Scalable Nuclei Segmentation in Whole-Slide Images6 Jan 2026
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosis29 Dec 2025
- 2025Magnification-Aware Distillation (MAD): A Self-Supervised Framework for Unified Representation Learning in Gigapixel Whole-Slide Images16 Dec 2025
- 2025Pancakes: Consistent Multi-Protocol Image Segmentation Across Biomedical Domains15 Dec 2025
- 2025Interpretable Multimodal Cancer Prototyping with Whole Slide Images and Incompletely Paired Genomics26 Nov 2025
- 2025Self-Paced Learning for Images of Antinuclear Antibodies26 Nov 2025
- 2025Supervise Less, See More: Training-free Nuclear Instance Segmentation with Prototype-Guided Prompting25 Nov 2025
- 2025ITC-RWKV: Interactive Tissue-Cell Modeling with Recurrent Key-Value Aggregation for Histopathological Subtyping24 Oct 2025
- 2025Scalable and Loosely-Coupled Multimodal Deep Learning for Breast Cancer Subtyping3 Sep 2025
- 2025SAMPO-Path: Segmentation Intent-Aligned Preference Optimization for Pathology Foundation Model Segmentation4 Aug 2025
- 2025PhenoBench: A Comprehensive Benchmark for Cell Phenotyping4 Jul 2025
- 2025Cancer cytoplasm segmentation in hyperspectral cell image with data augmentation4 Jul 2025
- 2025The Four Color Theorem for Cell Instance Segmentation11 Jun 2025
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun 2025
- 2025Multi-Modal Explainable Medical AI Assistant for Trustworthy Human-AI Collaboration11 May 2025
- 2025Multimodal Integrated Knowledge Transfer to Large Language Models through Preference Optimization with Biomedical Applications9 May 2025
- 2025Histo-Miner: Deep learning based tissue features extraction pipeline from H&E whole slide images of cutaneous squamous cell carcinoma7 May 2025
- 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretation30 Apr 2025
- 2025APSeg: Auto-Prompt Model with Acquired and Injected Knowledge for Nuclear Instance Segmentation and Classification3 Apr 2025
- 2025CellVTA: Enhancing Vision Foundation Models for Accurate Cell Segmentation and Classification1 Apr 2025
- 2025PathOrchestra: A Comprehensive Foundation Model for Computational Pathology with Over 100 Diverse Clinical-Grade Tasks31 Mar 2025
- 2025Towards Effective and Efficient Context-aware Nucleus Detection in Histopathology Whole Slide Images4 Mar 2025
- 2025A Lightweight and Extensible Cell Segmentation and Classification Model for Whole Slide Images26 Feb 2025
- 2025Cell Nuclei Detection and Classification in Whole Slide Images with Transformers10 Feb 2025
50 newest of 113 All 113 (JSON)
- 2024GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AIcited by 96
- 2024MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicinecited by 79
- 2026MedMO: Grounding and Understanding Multimodal Large Language Model for Medical Imagescited by 12
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosiscited by 3
- 2024Efficient and Comprehensive Feature Extraction in Large Vision-Language Model for Pathology Analysiscited by 0
- 2026MedSIGHT: Towards Grounded Visual Comprehension in Medical Large Vision-Language Modelscited by 0
- 2026One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensemblingcited by 0
- 2026One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensembling6 Jun 2026
- 2026MedSIGHT: Towards Grounded Visual Comprehension in Medical Large Vision-Language Models4 Jun 2026
- 2026MedMO: Grounding and Understanding Multimodal Large Language Model for Medical Images6 Feb 2026
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosis29 Dec 2025
- 2024Efficient and Comprehensive Feature Extraction in Large Vision-Language Model for Pathology Analysis12 Dec 2024
- 2024GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI6 Aug 2024
- 2024MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicine6 Aug 2024
- 2024Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Modelscited by 8
- 2024Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Modelcited by 8
- 2023Semi-Supervised Semantic Segmentation of Cell Nuclei via Diffusion-based Large-Scale Pre-Training and Collaborative Learningcited by 2
- 2024Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Model19 Jul 2024
- 2024Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Models19 Jul 2024
- 2023Semi-Supervised Semantic Segmentation of Cell Nuclei via Diffusion-based Large-Scale Pre-Training and Collaborative Learning8 Aug 2023
- 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 107
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 104
- 2021Lizard: A Large-Scale Dataset for Colonic Nuclear Instance Segmentation and Classificationcited by 89
- 2024Hibou: A Family of Foundational Vision Transformers for Pathologycited by 52
- 2021CryoNuSeg: A Dataset for Nuclei Instance Segmentation of Cryosectioned H&E-Stained Histological Imagescited by 50
- 2023Histopathology Whole Slide Image Analysis with Heterogeneous Graph Representation Learningcited by 47
- 2023ScribblePrompt: Fast and Flexible Interactive Segmentation for Any Biomedical Imagecited by 47
- 2021CoNIC: Colon Nuclei Identification and Counting Challenge 2022cited by 44
- 2022One Model is All You Need: Multi-Task Learning Enables Simultaneous Histology Image Segmentation and Classificationcited by 38
- 2021NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentationcited by 33
- 2023CoNIC Challenge: Pushing the Frontiers of Nuclear Detection, Segmentation, Classification and Countingcited by 33
12 most cited of 99 All 99 (JSON)
- 2026HERO: Histology Encoder for Robust Representation in Oncology28 Sep 2026
- 2026The Good, the Bad, and the Brittle: Benchmarking Robustness and Generalisation of Histopathology Foundation Models5 Jul 2026
- 2026HASSL: Hierarchy-Aware Self-Supervised Learning Framework for Single Cell Microscopy5 Jul 2026
- 2026CellDETR: A Detection-Guided Framework for Scalable Cell Representation Learning from Histopathology Images28 Jun 2026
- 2026SegTME-UNI2: A Foundation Model-Based Framework for Generalisable Multiclass Cell Segmentation and LLM-Driven Tumour Microenvironment Characterisation in Histopathology16 Jun 2026
- 2026Atlas H&E-TME: Scalable AI-Based Tissue Profiling at Expert Pathologist-Level Accuracy10 Jun 2026
- 2026Shift-Dependent Asymmetry: Orthogonal Inverse Low-Rank Adaptation for Federated Medical Segmentation7 Jun 2026
- 2026DualGate-Net: A Prior-Gated Dual-Encoder Framework for Histopathology Cell Detection5 Jun 2026
- 2026PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Images1 Jun 2026
- 2026Biological Spatial Priors Regularize Foundation Model Representations for Cross-Site MSI Generalization in Colorectal Cancer4 May 2026
- 2026Leveraging Spatial Transcriptomics as Alternative to Manual Annotations for Deep Learning-Based Nuclei Analysis26 Apr 2026
- 2026Cell Instance Segmentation via Multi-Task Image-to-Image Schr"odinger Bridge14 Apr 2026
12 newest of 99 All 99 (JSON)