# Quantifying and Leveraging Predictive Uncertainty for Medical Image Assessment

arXiv: https://arxiv.org/abs/2007.04258 · HTML: https://mlsanity.com/paper/2007.04258/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 8 Jul 2020.

## Built on by (most cited first, 26 of 26)

- [Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysis](https://mlsanity.com/paper/2210.03736/) (2022)
- [A Review of Uncertainty Estimation and its Application in Medical Imaging](https://mlsanity.com/paper/2302.08119/) (2023)
- [A review of uncertainty quantification in medical image analysis: probabilistic and non-probabilistic methods](https://mlsanity.com/paper/2310.06873/) (2023)
- [A comprehensive survey on deep active learning in medical image analysis](https://mlsanity.com/paper/2310.14230/) (2023)
- [Self-supervised Learning from 100 Million Medical Images](https://mlsanity.com/paper/2201.01283/) (2022)
- [RadFlag: A Black-Box Hallucination Detection Method for Medical Vision Language Models](https://mlsanity.com/paper/2411.00299/) (2024)
- [Lymphoma segmentation from 3D PET-CT images using a deep evidential network](https://mlsanity.com/paper/2201.13078/) (2022)
- [MERIT: Multi-view evidential learning for reliable and interpretable liver fibrosis staging](https://mlsanity.com/paper/2405.02918/) (2024)
- [Empirical Validation of Conformal Prediction for Trustworthy Skin Lesions Classification](https://mlsanity.com/paper/2312.07460/) (2023)
- [Segmentation Ability Map: Interpret deep features for medical image segmentation](https://mlsanity.com/paper/2212.09206/) (2022)
- [Consistency-Based Semi-supervised Evidential Active Learning for Diagnostic Radiograph Classification](https://mlsanity.com/paper/2209.01858/) (2022)
- [Robust Classification from Noisy Labels: Integrating Additional Knowledge for Chest Radiography Abnormality Assessment](https://mlsanity.com/paper/2104.05261/) (2021)
- [U-Netmer: U-Net meets Transformer for medical image segmentation](https://mlsanity.com/paper/2304.01401/) (2023)
- [Application of belief functions to medical image segmentation: A review](https://mlsanity.com/paper/2205.01733/) (2022)
- [Uncertainty in a Single Pass: A Closed-Form Identity for One-Step Flow Matching](https://mlsanity.com/paper/2605.00941/) (2026)
- [Deep Evidential Learning for Radiotherapy Dose Prediction](https://mlsanity.com/paper/2404.17126/) (2024)
- [Automated cross-sectional view selection in CT angiography of aortic dissections with uncertainty awareness and retrospective clinical annotations](https://mlsanity.com/paper/2111.11269/) (2021)
- [From Uncertainty to Clarity: Uncertainty-Guided Class-Incremental Learning for Limited Biomedical Samples via Semantic Expansion](https://mlsanity.com/paper/2409.07757/) (2024)
- [Distribution-Based Masked Medical Vision-Language Model Using Structured Reports](https://mlsanity.com/paper/2507.21794/) (2025)
- [Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classification](https://mlsanity.com/paper/2307.00479/) (2023)
- [Relation U-Net](https://mlsanity.com/paper/2501.09101/) (2025)
- [A method for classification of data with uncertainty using hypothesis testing](https://mlsanity.com/paper/2502.08582/) (2025)
- [UGPL: Uncertainty-Guided Progressive Learning for Evidence-Based Classification in Computed Tomography](https://mlsanity.com/paper/2507.14102/) (2025)
- [Prototype-Enhanced Confidence Modeling for Cross-Modal Medical Image-Report Retrieval](https://mlsanity.com/paper/2508.03494/) (2025)
- [MEGAN: Mixture of Experts for Robust Uncertainty Estimation in Endoscopy Videos](https://mlsanity.com/paper/2509.12772/) (2025)
- [Uncertainty-Aware Wildfire Smoke Density Classification from Satellite Imagery via CBAM-Augmented EfficientNet with Evidential Deep Learning](https://mlsanity.com/paper/2605.15894/) (2026)

## Abstract (arXiv)

The interpretation of medical images is a challenging task, often complicated by the presence of artifacts, occlusions, limited contrast and more. Most notable is the case of chest radiography, where there is a high inter-rater variability in the detection and classification of abnormalities. This is largely due to inconclusive evidence in the data or subjective definitions of disease appearance. An additional example is the classification of anatomical views based on 2D Ultrasound images. Often, the anatomical context captured in a frame is not sufficient to recognize the underlying anatomy. Current machine learning solutions for these problems are typically limited to providing probabilistic predictions, relying on the capacity of underlying models to adapt to limited information and the high degree of label noise. In practice, however, this leads to overconfident systems with poor generalization on unseen data. To account for this, we propose a system that learns not only the probabilistic estimate for classification, but also an explicit uncertainty measure which captures the confidence of the system in the predicted output. We argue that this approach is essential to account for the inherent ambiguity characteristic of medical images from different radiologic exams including computed radiography, ultrasonography and magnetic resonance imaging. In our experiments we demonstrate that sample rejection based on the predicted uncertainty can significantly improve the ROC-AUC for various tasks, e.g., by 8% to 0.91 with an expected rejection rate of under 25% for the classification of different abnormalities in chest radiographs. In addition, we show that using uncertainty-driven bootstrapping to filter the training data, one can achieve a significant increase in robustness and accuracy.
