Supervised Uncertainty Quantification for Segmentation with Multiple Annotations
Not on the map. Why?
Abstract (arXiv)
The accurate estimation of predictive uncertainty carries importance in medical scenarios such as lung node segmentation. Unfortunately, most existing works on predictive uncertainty do not return calibrated uncertainty estimates, which could be used in practice. In this work we exploit multi-grader annotation variability as a source of 'groundtruth' aleatoric uncertainty, which can be treated as a target in a supervised learning problem. We combine this groundtruth uncertainty with a Probabilistic U-Net and test on the LIDC-IDRI lung nodule CT dataset and MICCAI2012 prostate MRI dataset. We find that we are able to improve predictive uncertainty estimates. We also find that we can improve sample accuracy and sample diversity. In real-world applications, our method could inform doctors about the confidence of the segmentation results.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 9; 2023: 9; 2024: 6; 2025: 1; 2026: 3.
42 papers.
Sort:
By area:
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectivescited by 98
- 2022Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysiscited by 62
- 2023A Review of Uncertainty Estimation and its Application in Medical Imagingcited by 59
- 2023A review of uncertainty quantification in medical image analysis: probabilistic and non-probabilistic methodscited by 39
- 2023Stochastic Segmentation with Conditional Categorical Diffusion Modelscited by 38
- 2024ValUES: A Framework for Systematic Validation of Uncertainty Estimation in Semantic Segmentationcited by 25
- 2022ACT: Semi-supervised Domain-adaptive Medical Image Segmentation with Asymmetric Co-trainingcited by 20
- 2021Generative Self-training for Cross-domain Unsupervised Tagged-to-Cine MRI Synthesiscited by 19
- 2021Using Soft Labels to Model Uncertainty in Medical Image Segmentationcited by 18
- 2021Robustness via Uncertainty-aware Cycle Consistencycited by 16
- 2022Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Expertscited by 13
30 more
- 2021Modeling Annotator Preference and Stochastic Annotation Error for Medical Image Segmentationcited by 12
- 2022Generalized Probabilistic U-Net for medical image segementationcited by 10
- 2023Effect of latent space distribution on the segmentation of images with multiple annotationscited by 7
- 2021Uncertainty-Guided Lung Nodule Segmentation with Feature-Aware Attentioncited by 6
- 2023Transmission-Guided Bayesian Generative Model for Smoke Segmentationcited by 6
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentationcited by 6
- 2021Deep Quantile Regression for Uncertainty Estimation in Unsupervised and Supervised Lesion Detectioncited by 4
- 2021Anatomical and Diagnostic Bayesian Segmentation in Prostate MRI -Should Different Clinical Objectives Mandate Different Loss Functions?cited by 4
- 2022Variational Inference for Quantifying Inter-observer Variability in Segmentation of Anatomical Structurescited by 4
- 2023Probabilistic 3D segmentation for aleatoric uncertainty quantification in full 3D medical datacited by 4
- 2023Confidence Contours: Uncertainty-Aware Annotation for Medical Semantic Segmentationcited by 4
- 2021Uncertainty-aware Generalized Adaptive CycleGANcited by 3
- 2021A Decoupled Uncertainty Model for MRI Segmentation Quality Estimationcited by 3
- 2023Lung Nodule Segmentation and Uncertain Region Prediction with an Uncertainty-Aware Attention Mechanismcited by 3
- 2021Uncertainty Quantification in Medical Image Segmentation with Multi-decoder U-Netcited by 2
- 2022Looking at the posterior: accuracy and uncertainty of neural-network predictionscited by 2
- 2023Attentive Continuous Generative Self-training for Unsupervised Domain Adaptive Medical Image Translationcited by 2
- 2021An Uncertainty-aware Hierarchical Probabilistic Network for Early Prediction, Quantification and Segmentation of Pulmonary Tumour Growthcited by 1
- 2021Medical Matting: A New Perspective on Medical Segmentation with Uncertaintycited by 1
- 2021Automatic quality control framework for more reliable integration of machine learning-based image segmentation into medical workflowscited by 1
- 2022Distributional Gaussian Processes Layers for Out-of-Distribution Detectioncited by 1
- 2024Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentationcited by 1
- 2026Beyond Boundary Noise: Aggregated Aleatoric Uncertainty Fails to Capture Presence Ambiguity in 3D Lung Nodule Segmentationcited by 1
- 2022Bayesian approaches for Quantifying Clinicians' Variability in Medical Image Quantificationcited by 0
- 2024Multi-scale gridded Gabor attention for cirrus segmentationcited by 0
- 2024Uncertainty quantification for White Matter Hyperintensity segmentation detects silent failures and improves automated Fazekas quantificationcited by 0
- 2024Osteoporosis Prediction from Hand X-ray Images Using Segmentation-for-Classification and Self-Supervised Learningcited by 0
- 2025UGPL: Uncertainty-Guided Progressive Learning for Evidence-Based Classification in Computed Tomographycited by 0
- 2026Pareto-Guided Optimization for Uncertainty-Aware Medical Image Segmentationcited by 0
- 2026Interpretable Probabilistic Medical Image Segmentation via Gaussian Process with Explicit Modelling of Annotation Bias and Variabilitycited by 0
- 2026Beyond Boundary Noise: Aggregated Aleatoric Uncertainty Fails to Capture Presence Ambiguity in 3D Lung Nodule Segmentation14 Aug 2026
- 2026Interpretable Probabilistic Medical Image Segmentation via Gaussian Process with Explicit Modelling of Annotation Bias and Variability22 Jun 2026
- 2026Pareto-Guided Optimization for Uncertainty-Aware Medical Image Segmentation27 Jan 2026
- 2025UGPL: Uncertainty-Guided Progressive Learning for Evidence-Based Classification in Computed Tomography18 Jul 2025
- 2024Osteoporosis Prediction from Hand X-ray Images Using Segmentation-for-Classification and Self-Supervised Learning6 Dec 2024
- 2024Uncertainty quantification for White Matter Hyperintensity segmentation detects silent failures and improves automated Fazekas quantification26 Nov 2024
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation25 Nov 2024
- 2024Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentation5 Sep 2024
- 2024Multi-scale gridded Gabor attention for cirrus segmentation11 Jul 2024
- 2024ValUES: A Framework for Systematic Validation of Uncertainty Estimation in Semantic Segmentation16 Jan 2024
- 2023A review of uncertainty quantification in medical image analysis: probabilistic and non-probabilistic methods9 Oct 2023
- 2023Confidence Contours: Uncertainty-Aware Annotation for Medical Semantic Segmentation15 Aug 2023
30 more
- 2023Attentive Continuous Generative Self-training for Unsupervised Domain Adaptive Medical Image Translation23 May 2023
- 2023Probabilistic 3D segmentation for aleatoric uncertainty quantification in full 3D medical data1 May 2023
- 2023Effect of latent space distribution on the segmentation of images with multiple annotations26 Apr 2023
- 2023Stochastic Segmentation with Conditional Categorical Diffusion Models15 Mar 2023
- 2023Lung Nodule Segmentation and Uncertain Region Prediction with an Uncertainty-Aware Attention Mechanism15 Mar 2023
- 2023Transmission-Guided Bayesian Generative Model for Smoke Segmentation2 Mar 2023
- 2023A Review of Uncertainty Estimation and its Application in Medical Imaging16 Feb 2023
- 2022Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Experts14 Dec 2022
- 2022Looking at the posterior: accuracy and uncertainty of neural-network predictions26 Nov 2022
- 2022Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysis5 Oct 2022
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectives15 Aug 2022
- 2022Generalized Probabilistic U-Net for medical image segementation26 Jul 2022
- 2022Bayesian approaches for Quantifying Clinicians' Variability in Medical Image Quantification5 Jul 2022
- 2022Distributional Gaussian Processes Layers for Out-of-Distribution Detection27 Jun 2022
- 2022ACT: Semi-supervised Domain-adaptive Medical Image Segmentation with Asymmetric Co-training5 Jun 2022
- 2022Variational Inference for Quantifying Inter-observer Variability in Segmentation of Anatomical Structures18 Jan 2022
- 2021Automatic quality control framework for more reliable integration of machine learning-based image segmentation into medical workflows6 Dec 2021
- 2021Modeling Annotator Preference and Stochastic Annotation Error for Medical Image Segmentation26 Nov 2021
- 2021Anatomical and Diagnostic Bayesian Segmentation in Prostate MRI -Should Different Clinical Objectives Mandate Different Loss Functions?25 Oct 2021
- 2021Robustness via Uncertainty-aware Cycle Consistency24 Oct 2021
- 2021Uncertainty-Guided Lung Nodule Segmentation with Feature-Aware Attention24 Oct 2021
- 2021Using Soft Labels to Model Uncertainty in Medical Image Segmentation26 Sep 2021
- 2021Deep Quantile Regression for Uncertainty Estimation in Unsupervised and Supervised Lesion Detection20 Sep 2021
- 2021Uncertainty Quantification in Medical Image Segmentation with Multi-decoder U-Net15 Sep 2021
- 2021A Decoupled Uncertainty Model for MRI Segmentation Quality Estimation6 Sep 2021
- 2021A Survey of Uncertainty in Deep Neural Networks7 Jul 2021
- 2021Generative Self-training for Cross-domain Unsupervised Tagged-to-Cine MRI Synthesis23 Jun 2021
- 2021Medical Matting: A New Perspective on Medical Segmentation with Uncertainty18 Jun 2021
- 2021An Uncertainty-aware Hierarchical Probabilistic Network for Early Prediction, Quantification and Segmentation of Pulmonary Tumour Growth18 Apr 2021
- 2021Uncertainty-aware Generalized Adaptive CycleGAN23 Feb 2021
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectivescited by 98
- 2022Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysiscited by 62
- 2023A Review of Uncertainty Estimation and its Application in Medical Imagingcited by 59
- 2023A review of uncertainty quantification in medical image analysis: probabilistic and non-probabilistic methodscited by 39
- 2024ValUES: A Framework for Systematic Validation of Uncertainty Estimation in Semantic Segmentationcited by 25
- 2022ACT: Semi-supervised Domain-adaptive Medical Image Segmentation with Asymmetric Co-trainingcited by 20
- 2021Generative Self-training for Cross-domain Unsupervised Tagged-to-Cine MRI Synthesiscited by 19
- 2021Using Soft Labels to Model Uncertainty in Medical Image Segmentationcited by 18
- 2021Robustness via Uncertainty-aware Cycle Consistencycited by 16
- 2022Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Expertscited by 13
- 2021Modeling Annotator Preference and Stochastic Annotation Error for Medical Image Segmentationcited by 12
12 most cited of 41 All 41 (JSON)
- 2026Beyond Boundary Noise: Aggregated Aleatoric Uncertainty Fails to Capture Presence Ambiguity in 3D Lung Nodule Segmentation14 Aug 2026
- 2026Interpretable Probabilistic Medical Image Segmentation via Gaussian Process with Explicit Modelling of Annotation Bias and Variability22 Jun 2026
- 2026Pareto-Guided Optimization for Uncertainty-Aware Medical Image Segmentation27 Jan 2026
- 2025UGPL: Uncertainty-Guided Progressive Learning for Evidence-Based Classification in Computed Tomography18 Jul 2025
- 2024Osteoporosis Prediction from Hand X-ray Images Using Segmentation-for-Classification and Self-Supervised Learning6 Dec 2024
- 2024Uncertainty quantification for White Matter Hyperintensity segmentation detects silent failures and improves automated Fazekas quantification26 Nov 2024
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation25 Nov 2024
- 2024Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentation5 Sep 2024
- 2024Multi-scale gridded Gabor attention for cirrus segmentation11 Jul 2024
- 2024ValUES: A Framework for Systematic Validation of Uncertainty Estimation in Semantic Segmentation16 Jan 2024
- 2023A review of uncertainty quantification in medical image analysis: probabilistic and non-probabilistic methods9 Oct 2023
- 2023Confidence Contours: Uncertainty-Aware Annotation for Medical Semantic Segmentation15 Aug 2023
12 newest of 41 All 41 (JSON)