Anatomically-aware Uncertainty for Semi-supervised Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Semi-supervised learning relaxes the need of large pixel-wise labeled datasets for image segmentation by leveraging unlabeled data. A prominent way to exploit unlabeled data is to regularize model predictions. Since the predictions of unlabeled data can be unreliable, uncertainty-aware schemes are typically employed to gradually learn from meaningful and reliable predictions. Uncertainty estimation methods, however, rely on multiple inferences from the model predictions that must be computed for each training step, which is computationally expensive. Moreover, these uncertainty maps capture pixel-wise disparities and do not consider global information. This work proposes a novel method to estimate segmentation uncertainty by leveraging global information from the segmentation masks. More precisely, an anatomically-aware representation is first learnt to model the available segmentation masks. The learnt representation thereupon maps the prediction of a new segmentation into an anatomically-plausible segmentation. The deviation from the plausible segmentation aids in estimating the underlying pixel-level uncertainty in order to further guide the segmentation network. The proposed method consequently estimates the uncertainty using a single inference from our representation, thereby reducing the total computation. We evaluate our method on two publicly available segmentation datasets of left atria in cardiac MRIs and of multiple organs in abdominal CTs. Our anatomically-aware method improves the segmentation accuracy over the state-of-the-art semi-supervised methods in terms of two commonly used evaluation metrics.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 37 of its 57 references that are in the map. First posted on arXiv 24 Oct 2023.
Builds on
37 of 57 references.
References · 37
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2016Improved Techniques for Training GANscited by 2,938
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
- 2019Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentationcited by 378
- 2018A Probabilistic U-Net for Segmentation of Ambiguous Imagescited by 281
- 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
25 more
- 2020Semi-supervised Medical Image Segmentation through Dual-task Consistencycited by 215
- 2018Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysiscited by 178
- 2020Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Imagescited by 152
- 2019Transformation Consistent Self-ensembling Model for Semi-supervised Medical Image Segmentationcited by 138
- 2019PHiSeg: Capturing Uncertainty in Medical Image Segmentationcited by 128
- 2017Anatomically Constrained Neural Networks (ACNN): Application to Cardiac Image Enhancement and Segmentationcited by 109
- 2021Mutual Consistency Learning for Semi-supervised Medical Image Segmentationcited by 107
- 2020Test-Time Adaptable Neural Networks for Robust Medical Image Segmentationcited by 102
- 2020Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertaintycited by 100
- 2022Learning with Limited Annotations: A Survey on Deep Semi-Supervised Learning for Medical Image Segmentationcited by 74
- 2019Semi-Supervised Medical Image Segmentation via Learning Consistency under Transformationscited by 71
- 2019Deep Co-Training for Semi-Supervised Image Segmentationcited by 58
- 20183D Semi-Supervised Learning with Uncertainty-Aware Multi-View Co-Trainingcited by 57
- 2019Semi-Supervised Brain Lesion Segmentation with an Adapted Mean Teacher Modelcited by 53
- 2020Double-Uncertainty Weighted Method for Semi-supervised Learningcited by 44
- 2020Cardiac Segmentation with Strong Anatomical Guaranteescited by 43
- 2019Semi-Supervised and Task-Driven Data Augmentationcited by 40
- 2019Anatomical Priors in Convolutional Networks for Unsupervised Biomedical Segmentationcited by 40
- 2020Post-DAE: Anatomically Plausible Segmentation via Post-Processing with Denoising Autoencoderscited by 38
- 2021Uncertainty guided semi-supervised segmentation of retinal layers in OCT imagescited by 29
- 2021QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Resultscited by 28
- 2022CRISP - Reliable Uncertainty Estimation for Medical Image Segmentationcited by 10
- 2021A Quantitative Comparison of Epistemic Uncertainty Maps Applied to Multi-Class Segmentationcited by 9
- 2022Leveraging Labeling Representations in Uncertainty-based Semi-supervised Segmentationcited by 5
- 2022On the pitfalls of entropy-based uncertainty for multi-class semi-supervised segmentationcited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 5; 2026: 7.
13 papers.
Sort:
By area:
- 2025DAM-Seg: Anatomically accurate cardiac segmentation using Dense Associative Networkscited by 3
- 2024MambaEviScrib: Mamba and Evidence-Guided Consistency Enhance CNN Robustness for Scribble-Based Weakly Supervised Ultrasound Image Segmentationcited by 1
- 2025ERANet: Edge Replacement Augmentation for Semi-Supervised Meniscus Segmentation with Prototype Consistency Alignment and Conditional Self-Trainingcited by 1
- 2025Leveraging Labelled Data Knowledge: A Cooperative Rectification Learning Network for Semi-supervised 3D Medical Image Segmentationcited by 1
- 2025DuetMatch: Harmonizing Semi-Supervised Brain MRI Segmentation via Decoupled Branch Optimizationcited by 1
- 2026Scale-aware Adaptive Supervised Network with Limited Medical Annotationscited by 1
- 2026Fully Differentiable Bidirectional Dual-Task Synergistic Learning for Semi-Supervised 3D Medical Image Segmentationcited by 1
- 2025Self-Validated Learning for Particle Separation: A Correctness-Based Self-Training Framework Without Human Labelscited by 0
- 2026A Semi-Supervised Framework for Breast Ultrasound Segmentation with Training-Free Pseudo-Label Generation and Label Refinementcited by 0
- 2026Contour-Guided Query-Based Feature Fusion for Boundary-Aware and Generalizable Cardiac Ultrasound Segmentationcited by 0
- 2026Are We Overconfident in Models and Results for Semi-Supervised 3D Medical Image Segmentation?cited by 0
- 2026Learning a Sampling-Free Variational DNN Plugin from Tiny Training Sets to Refine OOD Segmentation With Uncertainty Estimationcited by 0
- 2026OPERA: Offline Policy-guided Expert Routing and Adaptation for Universal Biomedical Image Analysis27 Jul 2026
- 2026Learning a Sampling-Free Variational DNN Plugin from Tiny Training Sets to Refine OOD Segmentation With Uncertainty Estimation14 Jun 2026
- 2026Are We Overconfident in Models and Results for Semi-Supervised 3D Medical Image Segmentation?25 May 2026
- 2026Contour-Guided Query-Based Feature Fusion for Boundary-Aware and Generalizable Cardiac Ultrasound Segmentation30 Mar 2026
- 2026A Semi-Supervised Framework for Breast Ultrasound Segmentation with Training-Free Pseudo-Label Generation and Label Refinement6 Mar 2026
- 2026Fully Differentiable Bidirectional Dual-Task Synergistic Learning for Semi-Supervised 3D Medical Image Segmentation10 Feb 2026
- 2026Scale-aware Adaptive Supervised Network with Limited Medical Annotations2 Jan 2026
- 2025DuetMatch: Harmonizing Semi-Supervised Brain MRI Segmentation via Decoupled Branch Optimization17 Oct 2025
- 2025Self-Validated Learning for Particle Separation: A Correctness-Based Self-Training Framework Without Human Labels22 Aug 2025
- 2025DAM-Seg: Anatomically accurate cardiac segmentation using Dense Associative Networks21 Feb 2025
- 2025Leveraging Labelled Data Knowledge: A Cooperative Rectification Learning Network for Semi-supervised 3D Medical Image Segmentation17 Feb 2025
- 2025ERANet: Edge Replacement Augmentation for Semi-Supervised Meniscus Segmentation with Prototype Consistency Alignment and Conditional Self-Training11 Feb 2025
- 2025DAM-Seg: Anatomically accurate cardiac segmentation using Dense Associative Networkscited by 3
- 2025ERANet: Edge Replacement Augmentation for Semi-Supervised Meniscus Segmentation with Prototype Consistency Alignment and Conditional Self-Trainingcited by 1
- 2025Leveraging Labelled Data Knowledge: A Cooperative Rectification Learning Network for Semi-supervised 3D Medical Image Segmentationcited by 1
- 2025DuetMatch: Harmonizing Semi-Supervised Brain MRI Segmentation via Decoupled Branch Optimizationcited by 1
- 2026Scale-aware Adaptive Supervised Network with Limited Medical Annotationscited by 1
- 2026Fully Differentiable Bidirectional Dual-Task Synergistic Learning for Semi-Supervised 3D Medical Image Segmentationcited by 1
- 2025Self-Validated Learning for Particle Separation: A Correctness-Based Self-Training Framework Without Human Labelscited by 0
- 2026A Semi-Supervised Framework for Breast Ultrasound Segmentation with Training-Free Pseudo-Label Generation and Label Refinementcited by 0
- 2026Contour-Guided Query-Based Feature Fusion for Boundary-Aware and Generalizable Cardiac Ultrasound Segmentationcited by 0
- 2026Are We Overconfident in Models and Results for Semi-Supervised 3D Medical Image Segmentation?cited by 0
- 2026Learning a Sampling-Free Variational DNN Plugin from Tiny Training Sets to Refine OOD Segmentation With Uncertainty Estimationcited by 0
- 2026Learning a Sampling-Free Variational DNN Plugin from Tiny Training Sets to Refine OOD Segmentation With Uncertainty Estimation14 Jun 2026
- 2026Are We Overconfident in Models and Results for Semi-Supervised 3D Medical Image Segmentation?25 May 2026
- 2026Contour-Guided Query-Based Feature Fusion for Boundary-Aware and Generalizable Cardiac Ultrasound Segmentation30 Mar 2026
- 2026A Semi-Supervised Framework for Breast Ultrasound Segmentation with Training-Free Pseudo-Label Generation and Label Refinement6 Mar 2026
- 2026Fully Differentiable Bidirectional Dual-Task Synergistic Learning for Semi-Supervised 3D Medical Image Segmentation10 Feb 2026
- 2026Scale-aware Adaptive Supervised Network with Limited Medical Annotations2 Jan 2026
- 2025DuetMatch: Harmonizing Semi-Supervised Brain MRI Segmentation via Decoupled Branch Optimization17 Oct 2025
- 2025Self-Validated Learning for Particle Separation: A Correctness-Based Self-Training Framework Without Human Labels22 Aug 2025
- 2025DAM-Seg: Anatomically accurate cardiac segmentation using Dense Associative Networks21 Feb 2025
- 2025Leveraging Labelled Data Knowledge: A Cooperative Rectification Learning Network for Semi-supervised 3D Medical Image Segmentation17 Feb 2025
- 2025ERANet: Edge Replacement Augmentation for Semi-Supervised Meniscus Segmentation with Prototype Consistency Alignment and Conditional Self-Training11 Feb 2025