# Seamless Iterative Semi-Supervised Correction of Imperfect Labels in Microscopy Images

arXiv: https://arxiv.org/abs/2208.03327 · HTML: https://mlsanity.com/paper/2208.03327/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 11 of its 20 references that are in the map.
- First posted on arXiv 5 Aug 2022.

## Builds on (most cited first, 11 of 11)

- [Microsoft COCO: Common Objects in Context](https://mlsanity.com/paper/1405.0312/) (2014)
- [Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks](https://mlsanity.com/paper/1506.01497/) (2015)
- [Early-Learning Regularization Prevents Memorization of Noisy Labels](https://mlsanity.com/paper/2007.00151/) (2020)
- [Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks](https://mlsanity.com/paper/1807.07356/) (2018)
- [Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation](https://mlsanity.com/paper/1908.10454/) (2019)
- [Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels](https://mlsanity.com/paper/2203.03884/) (2022)
- [Adaptive Early-Learning Correction for Segmentation from Noisy Annotations](https://mlsanity.com/paper/2110.03740/) (2021)
- [NOTE-RCNN: NOise Tolerant Ensemble RCNN for Semi-Supervised Object Detection](https://mlsanity.com/paper/1812.00124/) (2018)
- [Solving Missing-Annotation Object Detection with Background Recalibration Loss](https://mlsanity.com/paper/2002.05274/) (2020)
- [Training Constrained Deconvolutional Networks for Road Scene Semantic Segmentation](https://mlsanity.com/paper/1604.01545/) (2016)
- [SIOD: Single Instance Annotated Per Category Per Image for Object Detection](https://mlsanity.com/paper/2203.15353/) (2022)

## Built on by (most cited first, 3 of 3)

- [A Systematic Review of Generalization Research in Medical Image Classification](https://mlsanity.com/paper/2403.12167/) (2024)
- [FD-SOS: Vision-Language Open-Set Detectors for Bone Fenestration and Dehiscence Detection from Intraoral Images](https://mlsanity.com/paper/2407.09088/) (2024)
- [Parallel Watershed Partitioning: GPU-Based Hierarchical Image Segmentation](https://mlsanity.com/paper/2410.08946/) (2024)

## Abstract (arXiv)

In-vitro tests are an alternative to animal testing for the toxicity of medical devices. Detecting cells as a first step, a cell expert evaluates the growth of cells according to cytotoxicity grade under the microscope. Thus, human fatigue plays a role in error making, making the use of deep learning appealing. Due to the high cost of training data annotation, an approach without manual annotation is needed. We propose Seamless Iterative Semi-Supervised correction of Imperfect labels (SISSI), a new method for training object detection models with noisy and missing annotations in a semi-supervised fashion. Our network learns from noisy labels generated with simple image processing algorithms, which are iteratively corrected during self-training. Due to the nature of missing bounding boxes in the pseudo labels, which would negatively affect the training, we propose to train on dynamically generated synthetic-like images using seamless cloning. Our method successfully provides an adaptive early learning correction technique for object detection. The combination of early learning correction that has been applied in classification and semantic segmentation before and synthetic-like image generation proves to be more effective than the usual semi-supervised approach by > 15% AP and > 20% AR across three different readers. Our code is available at https://github.com/marwankefah/SISSI.
