# Multi-scale Cell Instance Segmentation with Keypoint Graph based Bounding Boxes

arXiv: https://arxiv.org/abs/1907.09140 · HTML: https://mlsanity.com/paper/1907.09140/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Jul 2019.

## Built on by (most cited first, 17 of 17)

- [CPP-Net: Context-aware Polygon Proposal Network for Nucleus Segmentation](https://mlsanity.com/paper/2102.06867/) (2021)
- [PolarMask++: Enhanced Polar Representation for Single-Shot Instance Segmentation and Beyond](https://mlsanity.com/paper/2105.02184/) (2021)
- [Transformer based multiple instance learning for weakly supervised histopathology image segmentation](https://mlsanity.com/paper/2205.08878/) (2022)
- [Region Proposal Rectification Towards Robust Instance Segmentation of Biological Images](https://mlsanity.com/paper/2203.02846/) (2022)
- [Zero-shot Nuclei Detection via Visual-Language Pre-trained Models](https://mlsanity.com/paper/2306.17659/) (2023)
- [Effective Pseudo-Labeling based on Heatmap for Unsupervised Domain Adaptation in Cell Detection](https://mlsanity.com/paper/2303.05269/) (2023)
- [Keypoint-Augmented Self-Supervised Learning for Medical Image Segmentation with Limited Annotation](https://mlsanity.com/paper/2310.01680/) (2023)
- [Cyclic Learning: Bridging Image-level Labels and Nuclei Instance Segmentation](https://mlsanity.com/paper/2306.02691/) (2023)
- [Object-Guided Instance Segmentation With Auxiliary Feature Refinement for Biological Images](https://mlsanity.com/paper/2106.07159/) (2021)
- [Cell Detection from Imperfect Annotation by Pseudo Label Selection Using P-classification](https://mlsanity.com/paper/2107.09289/) (2021)
- [AttriPrompter: Auto-Prompting with Attribute Semantics for Zero-shot Nuclei Detection via Visual-Language Pre-trained Models](https://mlsanity.com/paper/2410.16820/) (2024)
- [Cell Detection in Domain Shift Problem Using Pseudo-Cell-Position Heatmap](https://mlsanity.com/paper/2107.08653/) (2021)
- [Disco: Densely-overlapping Cell Instance Segmentation via Adjacency-aware Collaborative Coloring](https://mlsanity.com/paper/2602.05420/) (2026)
- [Look in Different Views: Multi-Scheme Regression Guided Cell Instance Segmentation](https://mlsanity.com/paper/2208.08078/) (2022)
- [A Segmentation Method for fluorescence images without a machine learning approach](https://mlsanity.com/paper/2212.13945/) (2022)
- [K-Stain: Keypoint-Driven Correspondence for H&E-to-IHC Virtual Staining](https://mlsanity.com/paper/2511.06709/) (2025)
- [Data Augmentation for High-Fidelity Generation of CAR-T/NK Immunological Synapse Images](https://mlsanity.com/paper/2602.00949/) (2026)

## Abstract (arXiv)

Most existing methods handle cell instance segmentation problems directly without relying on additional detection boxes. These methods generally fails to separate touching cells due to the lack of global understanding of the objects. In contrast, box-based instance segmentation solves this problem by combining object detection with segmentation. However, existing methods typically utilize anchor box-based detectors, which would lead to inferior instance segmentation performance due to the class imbalance issue. In this paper, we propose a new box-based cell instance segmentation method. In particular, we first detect the five pre-defined points of a cell via keypoints detection. Then we group these points according to a keypoint graph and subsequently extract the bounding box for each cell. Finally, cell segmentation is performed on feature maps within the bounding boxes. We validate our method on two cell datasets with distinct object shapes, and empirically demonstrate the superiority of our method compared to other instance segmentation techniques. Code is available at: https://github.com/yijingru/KG_Instance_Segmentation.
