HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Images
Not on the map. Why?
Abstract (arXiv)
Nuclear segmentation and classification within Haematoxylin & Eosin stained histology images is a fundamental prerequisite in the digital pathology work-flow. The development of automated methods for nuclear segmentation and classification enables the quantitative analysis of tens of thousands of nuclei within a whole-slide pathology image, opening up possibilities of further analysis of large-scale nuclear morphometry. However, automated nuclear segmentation and classification is faced with a major challenge in that there are several different types of nuclei, some of them exhibiting large intra-class variability such as the tumour cells. Additionally, some of the nuclei are often clustered together. To address these challenges, we present a novel convolutional neural network for simultaneous nuclear segmentation and classification that leverages the instance-rich information encoded within the vertical and horizontal distances of nuclear pixels to their centres of mass. These distances are then utilised to separate clustered nuclei, resulting in an accurate segmentation, particularly in areas with overlapping instances. Then for each segmented instance, the network predicts the type of nucleus via a devoted up-sampling branch. We demonstrate state-of-the-art performance compared to other methods on multiple independent multi-tissue histology image datasets. As part of this work, we introduce a new dataset of Haematoxylin & Eosin stained colorectal adenocarcinoma image tiles, containing 24,319 exhaustively annotated nuclei with associated class labels.
Key facts. Cited by 388 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 60; 2023: 86; 2024: 66; 2025: 86; 2026: 56.
388 papers.
Sort:
By area:
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
- 2022Benchmarking Self-Supervised Learning on Diverse Pathology Datasetscited by 150
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 111
- 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
- 2023Artificial Intelligence for Digital and Computational Pathologycited by 108
- 2023UniverSeg: Universal Medical Image Segmentationcited by 91
- 2023Virchow: A Million-Slide Digital Pathology Foundation Modelcited by 90
- 2021Lizard: A Large-Scale Dataset for Colonic Nuclear Instance Segmentation and Classificationcited by 89
- 2022Mitosis domain generalization in histopathology images -- The MIDOG challengecited by 67
- 2021Hierarchical Graph Representations in Digital Pathologycited by 59
- 2023Towards a Visual-Language Foundation Model for Computational Pathologycited by 52
- 2021CryoNuSeg: A Dataset for Nuclei Instance Segmentation of Cryosectioned H&E-Stained Histological Imagescited by 51
38 more
- 2023Histopathology Whole Slide Image Analysis with Heterogeneous Graph Representation Learningcited by 47
- 2021CoNIC: Colon Nuclei Identification and Counting Challenge 2022cited by 45
- 2021Multi-Layer Pseudo-Supervision for Histopathology Tissue Semantic Segmentation using Patch-level Classification Labelscited by 43
- 2021A Survey on Graph-Based Deep Learning for Computational Histopathologycited by 41
- 2023The Multi-modality Cell Segmentation Challenge: Towards Universal Solutionscited by 39
- 2022One Model is All You Need: Multi-Task Learning Enables Simultaneous Histology Image Segmentation and Classificationcited by 38
- 2022WSSS4LUAD: Grand Challenge on Weakly-supervised Tissue Semantic Segmentation for Lung Adenocarcinomacited by 36
- 2021NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentationcited by 34
- 2023CoNIC Challenge: Pushing the Frontiers of Nuclear Detection, Segmentation, Classification and Countingcited by 33
- 2021CPP-Net: Context-aware Polygon Proposal Network for Nucleus Segmentationcited by 32
- 2022Handcrafted Histological Transformer (H2T): Unsupervised Representation of Whole Slide Imagescited by 32
- 2021SlideGraph+: Whole Slide Image Level Graphs to Predict HER2Status in Breast Cancercited by 31
- 2022Nuclei instance segmentation and classification in histopathology images with StarDistcited by 31
- 2023Diffusion-based Data Augmentation for Nuclei Image Segmentationcited by 31
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2023OCELOT: Overlapped Cell on Tissue Dataset for Histopathologycited by 29
- 2023NuInsSeg: A Fully Annotated Dataset for Nuclei Instance Segmentation in H&E-Stained Histological Imagescited by 29
- 2023DiffMix: Diffusion Model-based Data Synthesis for Nuclei Segmentation and Classification in Imbalanced Pathology Image Datasetscited by 28
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathologycited by 27
- 2023ConSlide: Asynchronous Hierarchical Interaction Transformer with Breakup-Reorganize Rehearsal for Continual Whole Slide Image Analysiscited by 25
- 2023Domain generalization across tumor types, laboratories, and species -- insights from the 2022 edition of the Mitosis Domain Generalization Challengecited by 25
- 2023HEALNet: Multimodal Fusion for Heterogeneous Biomedical Datacited by 25
- 2023SI-MIL: Taming Deep MIL for Self-Interpretability in Gigapixel Histopathologycited by 25
- 2021Multi-Class Cell Detection Using Spatial Context Representationcited by 24
- 2023Deep learning for unsupervised domain adaptation in medical imaging: Recent advancements and future perspectivescited by 24
- 2024Segment Any Cell: A SAM-based Auto-prompting Fine-tuning Framework for Nuclei Segmentationcited by 24
- 2023A Recent Survey of Vision Transformers for Medical Image Segmentationcited by 23
- 2024Towards Large-Scale Training of Pathology Foundation Modelscited by 23
- 2021Instance-based Vision Transformer for Subtyping of Papillary Renal Cell Carcinoma in Histopathological Imagecited by 22
- 2024UN-SAM: Universal Prompt-Free Segmentation for Generalized Nuclei Imagescited by 22
- 2023A Foundational Multimodal Vision Language AI Assistant for Human Pathologycited by 21
- 2025Training state-of-the-art pathology foundation models with orders of magnitude less datacited by 21
- 2021HistoCartography: A Toolkit for Graph Analytics in Digital Pathologycited by 20
- 2024Tyche: Stochastic In-Context Learning for Medical Image Segmentationcited by 20
- 2022InsMix: Towards Realistic Generative Data Augmentation for Nuclei Instance Segmentationcited by 19
- 2023Unleashing the Power of Prompt-driven Nucleus Instance Segmentationcited by 19
- 2023NASDM: Nuclei-Aware Semantic Histopathology Image Generation Using Diffusion Modelscited by 18
- 2023DeGPR: Deep Guided Posterior Regularization for Multi-Class Cell Detection and Countingcited by 18
50 most cited of 388 All 388 (JSON)
- 2026GDBA-Net: A Gated Dual-Branch Adaptation of SAM2 for Robust Cross-Domain Nuclei Segmentation14 Oct 2026
- 2026HERO: Histology Encoder for Robust Representation in Oncology28 Sep 2026
- 2026From UNI2-h to ConvNeXt-T: Lightweight Nuclei Instance Segmentation via Knowledge Distillation28 Sep 2026
- 2026See, Measure, and Reason: Learning Visually Grounded Reasoning in Pathology28 Sep 2026
- 2026End-to-End Cell Detection via Instance-aware Graph Modeling14 Sep 2026
- 2026Sharing standardized image-derived data in computational pathology using DICOM13 Sep 2026
- 2026MARC: Morphology-Aware Regression of Consensus for Cell Segmentation in Subcellular Spatial Transcriptomics12 Sep 2026
- 2026Semantic-Guided Multimodal Preprocessing for Vision Transformer-Based Clear Cell Renal Cell Carcinoma Grading1 Sep 2026
- 2026Explainable Artificial Intelligence (XAI) in Computational Pathology: Definitions, Taxonomy, and Recommendations28 Aug 2026
- 2026VIPER: An Expert-Curated Benchmark for Vision-Language Models in Veterinary Pathology26 Aug 2026
- 2026DistillPath: An Efficient 22M Distilled Pathology Encoder Approaching Large Foundation Model Performance18 Aug 2026
- 2026Lymphocyte Mimicry Correction via Region-Level Tissue Reasoning and Unbalanced Optimal Transport17 Aug 2026
38 more
- 2026CytoFormer: A Molecularly Supervised Cell Foundation Model for Histopathology Cell Classification17 Aug 2026
- 2026Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation4 Aug 2026
- 2026Morphology-Aware Implicit Super-Resolution Network for Pathological Images4 Aug 2026
- 2026SAFViT: Spatial Attention Fusion Gating for Vision Transformer-Based Nucleus Segmentation and Classification30 Jul 2026
- 2026Slide-Level Active Learning Reduces Annotation Burden in H&E images10 Jul 2026
- 2026HistoSeg++: Delving deeper with attention and multiscale feature fusion for biomarker segmentation2 Jul 2026
- 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms29 Jun 2026
- 2026CellDETR: A Detection-Guided Framework for Scalable Cell Representation Learning from Histopathology Images28 Jun 2026
- 2026Controllable Histopathology Image Synthesis with Training-free Structural Initialization and Textural Modulation26 Jun 2026
- 2026Rethinking the Adaptation of Vision Foundation Models for Efficient Cell Segmentation20 Jun 2026
- 2026SegTME-UNI2: A Foundation Model-Based Framework for Generalisable Multiclass Cell Segmentation and LLM-Driven Tumour Microenvironment Characterisation in Histopathology16 Jun 2026
- 2026Atlas H&E-TME: Scalable AI-Based Tissue Profiling at Expert Pathologist-Level Accuracy10 Jun 2026
- 2026Maximum Matching Accuracy: An Instance Segmentation Evaluation Metric Utilizing Globally Optimal Matching8 Jun 2026
- 2026DualGate-Net: A Prior-Gated Dual-Encoder Framework for Histopathology Cell Detection5 Jun 2026
- 2026AMN: An Adaptive Multi-Scale Fusion Network with Boundary and Uncertainty Modeling for Nuclei Segmentation31 May 2026
- 2026One Click per Cell Type Suffices: Training-free Group Interaction for Cell Instance Segmentation28 May 2026
- 2026Diffusion Attention Expert Model for Predicting and Semi-automatic Localizing STAS in Lung Cancer Histopathological Images15 May 2026
- 2026NucEval: A Robust Evaluation Framework for Nuclear Instance Segmentation4 May 2026
- 2026Leveraging Spatial Transcriptomics as Alternative to Manual Annotations for Deep Learning-Based Nuclei Analysis26 Apr 2026
- 2026Learning Class Difficulty via Dynamic Focal Attention for Histopathology Segmentation15 Apr 2026
- 2026Cell Instance Segmentation via Multi-Task Image-to-Image Schr"odinger Bridge14 Apr 2026
- 2026OpenTME: An Open Dataset of AI-powered H&E Tumor Microenvironment Profiles from TCGA13 Apr 2026
- 2026Cluster-First Labelling: An Automated Pipeline for Segmentation and Morphological Clustering in Histology Whole Slide Images10 Apr 2026
- 2026Identity-Aware U-Net: Fine-grained Cell Segmentation via Identity-Aware Representation Learning7 Apr 2026
- 2026Adapting SAM to Nuclei Instance Segmentation and Classification via Cooperative Fine-Grained Refinement30 Mar 2026
- 2026Central-to-Local Adaptive Generative Diffusion Framework for Improving Gene Expression Prediction in Data-Limited Spatial Transcriptomics27 Mar 2026
- 2026LEMON: a foundation model for nuclear morphology in Computational Pathology26 Mar 2026
- 2026MLLM-HWSI: A Multimodal Large Language Model for Hierarchical Whole Slide Image Understanding24 Mar 2026
- 2026Bayesian Scattering: A Principled Baseline for Uncertainty on Image Data21 Mar 2026
- 2026Revisiting foundation models for cell instance segmentation18 Mar 2026
- 2026BiTro: Bidirectional Transfer Learning Enhances Bulk and Spatial Transcriptomics Prediction in Cancer Pathological Images16 Mar 2026
- 2026NuNext: Reframing Nucleus Detection as Next-Point Detection7 Mar 2026
- 2026Prompt Group-Aware Training for Robust Text-Guided Nuclei Segmentation6 Mar 2026
- 2026Structure-Guided Histopathology Synthesis via Dual-LoRA Diffusion4 Mar 2026
- 2026DeNuC: Decoupling Nuclei Detection and Classification in Histopathology4 Mar 2026
- 2026PathMoE: Interpretable Multimodal Interaction Experts for Pediatric Brain Tumor Classification2 Mar 2026
- 2026Artefact-Aware Fungal Detection in Dermatophytosis: A Real-Time Transformer-Based Approach for KOH Microscopy22 Feb 2026
- 2026Context-aware Skin Cancer Epithelial Cell Classification with Scalable Graph Transformers17 Feb 2026
50 newest of 388 All 388 (JSON)
- 2023Diffusion-based Data Augmentation for Nuclei Image Segmentationcited by 31
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2023DiffMix: Diffusion Model-based Data Synthesis for Nuclei Segmentation and Classification in Imbalanced Pathology Image Datasetscited by 28
- 2023NASDM: Nuclei-Aware Semantic Histopathology Image Generation Using Diffusion Modelscited by 18
- 2024TopoCellGen: Generating Histopathology Cell Topology with a Diffusion Modelcited by 16
- 2025PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditionscited by 9
- 2024Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Modelscited by 8
- 2024Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Modelcited by 8
- 2023Semi-Supervised Semantic Segmentation of Cell Nuclei via Diffusion-based Large-Scale Pre-Training and Collaborative Learningcited by 2
- 2025HistoSmith: Single-Stage Histology Image-Label Generation via Conditional Latent Diffusion for Enhanced Cell Segmentation and Classificationcited by 0
- 2026Structure-Guided Histopathology Synthesis via Dual-LoRA Diffusioncited by 0
- 2026Controllable Histopathology Image Synthesis with Training-free Structural Initialization and Textural Modulationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation4 Aug 2026
- 2026Controllable Histopathology Image Synthesis with Training-free Structural Initialization and Textural Modulation26 Jun 2026
- 2026Structure-Guided Histopathology Synthesis via Dual-LoRA Diffusion4 Mar 2026
- 2025PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditions30 Jun 2025
- 2025HistoSmith: Single-Stage Histology Image-Label Generation via Conditional Latent Diffusion for Enhanced Cell Segmentation and Classification12 Feb 2025
- 2024TopoCellGen: Generating Histopathology Cell Topology with a Diffusion Model8 Dec 2024
- 2024Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Model19 Jul 2024
- 2024Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Models19 Jul 2024
- 2024A Survey on Data Augmentation in Large Model Era27 Jan 2024
- 2023Diffusion-based Data Augmentation for Nuclei Image Segmentation22 Oct 2023
- 2023Semi-Supervised Semantic Segmentation of Cell Nuclei via Diffusion-based Large-Scale Pre-Training and Collaborative Learning8 Aug 2023
- 2023DiffMix: Diffusion Model-based Data Synthesis for Nuclei Segmentation and Classification in Imbalanced Pathology Image Datasets25 Jun 2023
12 newest of 13 All 13 (JSON)
- 2023MoMA: Momentum Contrastive Learning with Multi-head Attention-based Knowledge Distillation for Histopathology Image Analysiscited by 6
- 2025Pathryoshka: Compressing Pathology Foundation Models via Multi-Teacher Knowledge Distillation with Nested Embeddingscited by 6
- 2023HoVer-UNet: Accelerating HoVerNet with UNet-based multi-class nuclei segmentation via knowledge distillationcited by 4
- 2025MUSE: Multi-Scale Dense Self-Distillation for Nucleus Detection and Classificationcited by 2
- 2023More From Less: Self-Supervised Knowledge Distillation for Routine Histopathology Datacited by 1
- 2023Bayesian Optimization Meets Self-Distillationcited by 0
- 2026From UNI2-h to ConvNeXt-T: Lightweight Nuclei Instance Segmentation via Knowledge Distillationcited by 0
- 2026From UNI2-h to ConvNeXt-T: Lightweight Nuclei Instance Segmentation via Knowledge Distillation28 Sep 2026
- 2025Pathryoshka: Compressing Pathology Foundation Models via Multi-Teacher Knowledge Distillation with Nested Embeddings28 Nov 2025
- 2025MUSE: Multi-Scale Dense Self-Distillation for Nucleus Detection and Classification7 Nov 2025
- 2023HoVer-UNet: Accelerating HoVerNet with UNet-based multi-class nuclei segmentation via knowledge distillation21 Nov 2023
- 2023MoMA: Momentum Contrastive Learning with Multi-head Attention-based Knowledge Distillation for Histopathology Image Analysis31 Aug 2023
- 2023Bayesian Optimization Meets Self-Distillation25 Apr 2023
- 2023More From Less: Self-Supervised Knowledge Distillation for Routine Histopathology Data19 Mar 2023
- 2024A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Modelscited by 9
- 2025Multi-Resolution Pathology-Language Pre-training Model with Text-Guided Visual Representationcited by 6
- 2025Visual Textualization for Image Prompted Object Detectioncited by 6
- 2026MLLM-HWSI: A Multimodal Large Language Model for Hierarchical Whole Slide Image Understandingcited by 3
- 2025A Tool Bottleneck Framework for Clinically-Informed and Interpretable Medical Image Understandingcited by 0
- 2026MLLM-HWSI: A Multimodal Large Language Model for Hierarchical Whole Slide Image Understanding24 Mar 2026
- 2025A Tool Bottleneck Framework for Clinically-Informed and Interpretable Medical Image Understanding24 Dec 2025
- 2025Visual Textualization for Image Prompted Object Detection30 Jun 2025
- 2025Multi-Resolution Pathology-Language Pre-training Model with Text-Guided Visual Representation26 Apr 2025
- 2024A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Models23 Aug 2024
- 2024Combining Graph Neural Network and Mamba to Capture Local and Global Tissue Spatial Relationships in Whole Slide Imagescited by 7
- 2025MambaVesselNet++: A Hybrid CNN-Mamba Architecture for Medical Image Segmentationcited by 5
- 2025Category Prompt Mamba Network for Nuclei Segmentation and Classificationcited by 3
- 2025CellMamba: Adaptive Mamba for Accurate and Efficient Cell Detectioncited by 1
- 2026PanopMamba: Vision State Space Modeling for Nuclei Panoptic Segmentationcited by 0
- 2026PanopMamba: Vision State Space Modeling for Nuclei Panoptic Segmentation23 Jan 2026
- 2025CellMamba: Adaptive Mamba for Accurate and Efficient Cell Detection25 Dec 2025
- 2025MambaVesselNet++: A Hybrid CNN-Mamba Architecture for Medical Image Segmentation26 Jul 2025
- 2025Category Prompt Mamba Network for Nuclei Segmentation and Classification13 Mar 2025
- 2024Combining Graph Neural Network and Mamba to Capture Local and Global Tissue Spatial Relationships in Whole Slide Images5 Jun 2024
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
- 2022Benchmarking Self-Supervised Learning on Diverse Pathology Datasetscited by 150
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 111
- 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
- 2023Artificial Intelligence for Digital and Computational Pathologycited by 108
- 2023UniverSeg: Universal Medical Image Segmentationcited by 91
- 2023Virchow: A Million-Slide Digital Pathology Foundation Modelcited by 90
- 2021Lizard: A Large-Scale Dataset for Colonic Nuclear Instance Segmentation and Classificationcited by 89
- 2022Mitosis domain generalization in histopathology images -- The MIDOG challengecited by 67
- 2021Hierarchical Graph Representations in Digital Pathologycited by 59
- 2023Towards a Visual-Language Foundation Model for Computational Pathologycited by 52
- 2021CryoNuSeg: A Dataset for Nuclei Instance Segmentation of Cryosectioned H&E-Stained Histological Imagescited by 51
12 most cited of 355 All 355 (JSON)
- 2026GDBA-Net: A Gated Dual-Branch Adaptation of SAM2 for Robust Cross-Domain Nuclei Segmentation14 Oct 2026
- 2026HERO: Histology Encoder for Robust Representation in Oncology28 Sep 2026
- 2026End-to-End Cell Detection via Instance-aware Graph Modeling14 Sep 2026
- 2026Sharing standardized image-derived data in computational pathology using DICOM13 Sep 2026
- 2026MARC: Morphology-Aware Regression of Consensus for Cell Segmentation in Subcellular Spatial Transcriptomics12 Sep 2026
- 2026Semantic-Guided Multimodal Preprocessing for Vision Transformer-Based Clear Cell Renal Cell Carcinoma Grading1 Sep 2026
- 2026Explainable Artificial Intelligence (XAI) in Computational Pathology: Definitions, Taxonomy, and Recommendations28 Aug 2026
- 2026VIPER: An Expert-Curated Benchmark for Vision-Language Models in Veterinary Pathology26 Aug 2026
- 2026DistillPath: An Efficient 22M Distilled Pathology Encoder Approaching Large Foundation Model Performance18 Aug 2026
- 2026CytoFormer: A Molecularly Supervised Cell Foundation Model for Histopathology Cell Classification17 Aug 2026
- 2026Morphology-Aware Implicit Super-Resolution Network for Pathological Images4 Aug 2026
- 2026SAFViT: Spatial Attention Fusion Gating for Vision Transformer-Based Nucleus Segmentation and Classification30 Jul 2026
12 newest of 355 All 355 (JSON)