# Weakly Supervised Medical Image Segmentation With Soft Labels and Noise Robust Loss

arXiv: https://arxiv.org/abs/2209.08172 · HTML: https://mlsanity.com/paper/2209.08172/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 25 of its 40 references that are in the map.
- First posted on arXiv 16 Sep 2022.

## Builds on (most cited first, 25 of 25)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Mask R-CNN](https://mlsanity.com/paper/1703.06870/) (2017)
- [Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics](https://mlsanity.com/paper/1705.07115/) (2017)
- [When Does Label Smoothing Help?](https://mlsanity.com/paper/1906.02629/) (2019)
- [Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approach](https://mlsanity.com/paper/1609.03683/) (2016)
- [Learning from Noisy Labels with Deep Neural Networks: A Survey](https://mlsanity.com/paper/2007.08199/) (2020)
- [Symmetric Cross Entropy for Robust Learning with Noisy Labels](https://mlsanity.com/paper/1908.06112/) (2019)
- [Robust Loss Functions under Label Noise for Deep Neural Networks](https://mlsanity.com/paper/1712.09482/) (2017)
- [Normalized Loss Functions for Deep Learning with Noisy Labels](https://mlsanity.com/paper/2006.13554/) (2020)
- [Using Trusted Data to Train Deep Networks on Labels Corrupted by Severe Noise](https://mlsanity.com/paper/1802.05300/) (2018)
- [Does label smoothing mitigate label noise?](https://mlsanity.com/paper/2003.02819/) (2020)
- [Deep learning with noisy labels: exploring techniques and remedies in medical image analysis](https://mlsanity.com/paper/1912.02911/) (2019)
- [Robust Training under Label Noise by Over-parameterization](https://mlsanity.com/paper/2202.14026/) (2022)
- [FINE Samples for Learning with Noisy Labels](https://mlsanity.com/paper/2102.11628/) (2021)
- [Semi-Supervised Semantic Image Segmentation with Self-correcting Networks](https://mlsanity.com/paper/1811.07073/) (2018)
- [Spatially Varying Label Smoothing: Capturing Uncertainty from Expert Annotations](https://mlsanity.com/paper/2104.05788/) (2021)
- [SoftSeg: Advantages of soft versus binary training for image segmentation](https://mlsanity.com/paper/2011.09041/) (2020)
- [Using Soft Labels to Model Uncertainty in Medical Image Segmentation](https://mlsanity.com/paper/2109.12622/) (2021)
- [Learning from Pixel-Level Label Noise: A New Perspective for Semi-Supervised Semantic Segmentation](https://mlsanity.com/paper/2103.14242/) (2021)
- [Soft labeling by Distilling Anatomical knowledge for Improved MS Lesion Segmentation](https://mlsanity.com/paper/1901.09263/) (2019)
- [Optimization with soft Dice can lead to a volumetric bias](https://mlsanity.com/paper/1911.02278/) (2019)
- [A Soft STAPLE Algorithm Combined with Anatomical Knowledge](https://mlsanity.com/paper/1910.12077/) (2019)
- [Superpixel-Guided Label Softening for Medical Image Segmentation](https://mlsanity.com/paper/2007.08897/) (2020)
- [Improved-Mask R-CNN: Towards an Accurate Generic MSK MRI instance segmentation platform (Data from the Osteoarthritis Initiative)](https://mlsanity.com/paper/2107.12889/) (2021)
- [Sample Efficient Learning of Image-Based Diagnostic Classifiers Using Probabilistic Labels](https://mlsanity.com/paper/2102.06164/) (2021)

## Built on by (most cited first, 2 of 2)

- [Application Of Vision-Language Models For Assessing Osteoarthritis Disease Severity](https://mlsanity.com/paper/2401.06331/) (2024)
- [Advancing Medical Image Segmentation: Morphology-Driven Learning with Diffusion Transformer](https://mlsanity.com/paper/2408.00347/) (2024)

## Abstract (arXiv)

Recent advances in deep learning algorithms have led to significant benefits for solving many medical image analysis problems. Training deep learning models commonly requires large datasets with expert-labeled annotations. However, acquiring expert-labeled annotation is not only expensive but also is subjective, error-prone, and inter-/intra- observer variability introduces noise to labels. This is particularly a problem when using deep learning models for segmenting medical images due to the ambiguous anatomical boundaries. Image-based medical diagnosis tools using deep learning models trained with incorrect segmentation labels can lead to false diagnoses and treatment suggestions. Multi-rater annotations might be better suited to train deep learning models with small training sets compared to single-rater annotations. The aim of this paper was to develop and evaluate a method to generate probabilistic labels based on multi-rater annotations and anatomical knowledge of the lesion features in MRI and a method to train segmentation models using probabilistic labels using normalized active-passive loss as a "noise-tolerant loss" function. The model was evaluated by comparing it to binary ground truth for 17 knees MRI scans for clinical segmentation and detection of bone marrow lesions (BML). The proposed method successfully improved precision 14, recall 22, and Dice score 8 percent compared to a binary cross-entropy loss function. Overall, the results of this work suggest that the proposed normalized active-passive loss using soft labels successfully mitigated the effects of noisy labels.
