Informed Deep Abstaining Classifier: Investigating noise-robust training for diagnostic decision support systems
Not on the map. Why?
Abstract (arXiv)
Image-based diagnostic decision support systems (DDSS) utilizing deep learning have the potential to optimize clinical workflows. However, developing DDSS requires extensive datasets with expert annotations and is therefore costly. Leveraging report contents from radiological data bases with Natural Language Processing to annotate the corresponding image data promises to replace labor-intensive manual annotation. As mining "real world" databases can introduce label noise, noise-robust training losses are of great interest. However, current noise-robust losses do not consider noise estimations that can for example be derived based on the performance of the automatic label generator used. In this study, we expand the noise-robust Deep Abstaining Classifier (DAC) loss to an Informed Deep Abstaining Classifier (IDAC) loss by incorporating noise level estimations during training. Our findings demonstrate that IDAC enhances the noise robustness compared to DAC and several state-of-the-art loss functions. The results are obtained on various simulated noise levels using a public chest X-ray data set. These findings are reproduced on an in-house noisy data set, where labels were extracted from the clinical systems of the University Hospital Bonn by a text-based transformer. The IDAC can therefore be a valuable tool for researchers, companies or clinics aiming to develop accurate and reliable DDSS from routine clinical data.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 39 references that are in the map. First posted on arXiv 28 Oct 2024.
Builds on
21 of 39 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
- 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 691
- 2018Learning to Reweight Examples for Robust Deep Learningcited by 670
- 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 499
- 2017Robust Loss Functions under Label Noise for Deep Neural Networkscited by 441
- 2020Early-Learning Regularization Prevents Memorization of Noisy Labelscited by 414
- 2020Normalized Loss Functions for Deep Learning with Noisy Labelscited by 257
- 2019SELF: Learning to Filter Noisy Labels with Self-Ensemblingcited by 164
- 2019Learning From Noisy Labels By Regularized Estimation Of Annotator Confusioncited by 126
9 more
- 2015Learning with Symmetric Label Noise: The Importance of Being Unhingedcited by 120
- 2018Masking: A New Perspective of Noisy Supervisioncited by 93
- 2019Curriculum Loss: Robust Learning and Generalization against Label Corruptioncited by 87
- 2019Combating Label Noise in Deep Learning Using Abstentioncited by 86
- 2021VisualCheXbert: Addressing the Discrepancy Between Radiology Report Labels and Image Labelscited by 27
- 2021Understanding the Interaction of Adversarial Training with Noisy Labelscited by 19
- 2022Scalable Penalized Regression for Noise Detection in Learning with Noisy Labelscited by 15
- 2021Explainable Artificial Intelligence for Human Decision-Support System in Medical Domaincited by 12
- 2024Tackling Noisy Labels with Network Parameter Additive Decompositioncited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.