PHiSeg: Capturing Uncertainty in Medical Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Segmentation of anatomical structures and pathologies is inherently ambiguous. For instance, structure borders may not be clearly visible or different experts may have different styles of annotating. The majority of current state-of-the-art methods do not account for such ambiguities but rather learn a single mapping from image to segmentation. In this work, we propose a novel method to model the conditional probability distribution of the segmentations given an input image. We derive a hierarchical probabilistic model, in which separate latent variables are responsible for modelling the segmentation at different resolutions. Inference in this model can be efficiently performed using the variational autoencoder framework. We show that our proposed method can be used to generate significantly more realistic and diverse segmentation samples compared to recent related work, both, when trained with annotations from a single or multiple annotators.
Key facts. Cited by 128 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 21; 2023: 26; 2024: 17; 2025: 25; 2026: 18.
128 papers.
Sort:
By area:
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2023Ambiguous Medical Image Segmentation using Diffusion Modelscited by 92
- 2022Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysiscited by 62
- 2023A Review of Uncertainty Estimation and its Application in Medical Imagingcited by 59
- 2021Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Predictioncited by 57
- 2022Uncertainty Inspired Underwater Image Enhancementcited by 53
- 2023A review of uncertainty quantification in medical image analysis: probabilistic and non-probabilistic methodscited by 39
- 2021Spatial Uncertainty-Aware Semi-Supervised Crowd Countingcited by 38
- 2023Stochastic Segmentation with Conditional Categorical Diffusion Modelscited by 38
- 2023Topology-Aware Uncertainty for Image Segmentationcited by 32
- 2021Spatially Varying Label Smoothing: Capturing Uncertainty from Expert Annotationscited by 31
- 2021QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Resultscited by 28
38 more
- 2023BerDiff: Conditional Bernoulli Diffusion Model for Medical Image Segmentationcited by 27
- 2025Position: Uncertainty Quantification Needs Reassessment for Large-language Model Agentscited by 27
- 2023The Treasure Beneath Multiple Annotations: An Uncertainty-aware Edge Detectorcited by 25
- 2024ValUES: A Framework for Systematic Validation of Uncertainty Estimation in Semantic Segmentationcited by 25
- 2024FlowSDF: Flow Matching for Medical Image Segmentation Using Distance Transformscited by 25
- 2023Calibrating Uncertainty for Semi-Supervised Crowd Countingcited by 22
- 2021Modality specific U-Net variants for biomedical image segmentation: A surveycited by 20
- 2024Tyche: Stochastic In-Context Learning for Medical Image Segmentationcited by 20
- 2022Efficient Bayesian Uncertainty Estimation for nnU-Netcited by 19
- 2021Generative Transformer for Accurate and Reliable Salient Object Detectioncited by 18
- 2021Towards Lower-Dose PET using Physics-Based Uncertainty-Aware Multimodal Learning with Robustness to Out-of-Distribution Datacited by 18
- 2021Using Soft Labels to Model Uncertainty in Medical Image Segmentationcited by 18
- 2021Challenges for machine learning in clinical translation of big data imaging studiescited by 15
- 2021Improving Aleatoric Uncertainty Quantification in Multi-Annotated Medical Image Segmentation with Normalizing Flowscited by 13
- 2022Uncertainty-aware Multi-modal Learning via Cross-modal Random Network Predictioncited by 13
- 2022Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Expertscited by 13
- 2023That Label's Got Style: Handling Label Style Bias for Uncertain Image Segmentationcited by 13
- 2023Anatomically-aware Uncertainty for Semi-supervised Image Segmentationcited by 13
- 2021Modeling Annotator Preference and Stochastic Annotation Error for Medical Image Segmentationcited by 12
- 2024QUBIQ: Uncertainty Quantification for Biomedical Image Segmentation Challengecited by 12
- 2021Exploring Feature Representation Learning for Semi-supervised Medical Image Segmentationcited by 11
- 2021On the relationship between calibrated predictors and unbiased volume estimationcited by 11
- 2022Generalized Probabilistic U-Net for medical image segementationcited by 10
- 2023Uncertainty Estimation and Propagation in Accelerated MRI Reconstructioncited by 10
- 2023Laplacian Segmentation Networks Improve Epistemic Uncertainty Quantificationcited by 9
- 2024Diversified and Personalized Multi-rater Medical Image Segmentationcited by 9
- 2021CT Image Synthesis Using Weakly Supervised Segmentation and Geometric Inter-Label Relations For COVID Image Analysiscited by 8
- 2022Camera-Conditioned Stable Feature Generation for Isolated Camera Supervised Person Re-IDentificationcited by 8
- 2024Conformal Performance Range Prediction for Segmentation Output Quality Controlcited by 8
- 2022Uncertainty-Driven Action Quality Assessmentcited by 7
- 2023Effect of latent space distribution on the segmentation of images with multiple annotationscited by 7
- 2023Building Extraction from Remote Sensing Images via an Uncertainty-Aware Networkcited by 7
- 2022Theoretical analysis and experimental validation of volume bias of soft Dice optimized segmentation maps in the context of inherent uncertaintycited by 6
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentationcited by 6
- 2021Learning of Inter-Label Geometric Relationships Using Self-Supervised Learning: Application To Gleason Grade Segmentationcited by 5
- 2022Improved post-hoc probability calibration for out-of-domain MRI segmentationcited by 5
- 2024MedUHIP: Towards Human-In-the-Loop Medical Segmentationcited by 5
- 2025Aleatoric Uncertainty Medical Image Segmentation Estimation via Flow Matchingcited by 5
50 most cited of 128 All 128 (JSON)
- 2026Latent-to-Latent Flow for Volumetric Stochastic Segmentation7 Sep 2026
- 2026CARD: Calibration via Agreement in Reverse Diffusion for Out-of-Domain MRI Segmentation26 Aug 2026
- 2026KANResDiff: Learning Local Residual Diffusion via Kolmogorov-Arnold Network for Ambiguous Medical Image Segmentation12 Aug 2026
- 2026VIDS-Seg: Towards Reliable Uncertainty Quantification in Pediatric Cardiac Ultrasound Segmentation11 Aug 2026
- 2026Variational Inference for Bird's Eye View Segmentation in Autonomous Driving16 Jul 2026
- 2026SARFA: Segment Anything with Radiomic Feature Alignment14 Jul 2026
- 2026HPR-SAM: Hierarchical Probabilistic Representation Learning for Prompt-free SAM-based Medical Image Segmentation8 Jul 2026
- 2026Interpretable Probabilistic Medical Image Segmentation via Gaussian Process with Explicit Modelling of Annotation Bias and Variability22 Jun 2026
- 2026Neural Architecture Distributions: A New Paradigm for Stochastic Segmentation19 Jun 2026
- 2026Attention-Based Prototype Calibration for Multi-Rater Few-Shot Medical Image Segmentation15 Jun 2026
- 2026Learning a Sampling-Free Variational DNN Plugin from Tiny Training Sets to Refine OOD Segmentation With Uncertainty Estimation14 Jun 2026
- 2026Principle-Guided Supervision for Interpretable Uncertainty in Medical Image Segmentation9 May 2026
38 more
- 2026Harmonized Feature Conditioning and Frequency-Prompt Personalization for Multi-Rater Medical Segmentation6 May 2026
- 2026UnGAP: Uncertainty-Guided Affine Prompting for Real-Time Crack Segmentation4 May 2026
- 2026Budget-Aware Uncertainty for Radiotherapy Segmentation QA Using nnU-Net13 Apr 2026
- 2026Volumetric Directional Diffusion: Anchoring Uncertainty Quantification in Anatomical Consensus for Ambiguous Medical Image Segmentation4 Mar 2026
- 2026Pareto-Guided Optimization for Uncertainty-Aware Medical Image Segmentation27 Jan 2026
- 2026Towards Agnostic and Holistic Universal Image Segmentation with Bit Diffusion6 Jan 2026
- 2025Pancakes: Consistent Multi-Protocol Image Segmentation Across Biomedical Domains15 Dec 2025
- 2025CheXmask-U: Quantifying uncertainty in landmark-based anatomical segmentation for X-ray images11 Dec 2025
- 2025LatentFM: A Latent Flow Matching Approach for Generative Medical Image Segmentation4 Dec 2025
- 2025ProSona: Prompt-Guided Personalization for Multi-Expert Medical Image Segmentation11 Nov 2025
- 2025Ambiguous Medical Image Segmentation Using Diffusion Schr"odinger Bridge21 Sep 2025
- 2025FIVA: Federated Inverse Variance Averaging for Universal CT Segmentation with Uncertainty Estimation8 Aug 2025
- 2025Prototype-Enhanced Confidence Modeling for Cross-Modal Medical Image-Report Retrieval5 Aug 2025
- 2025Aleatoric Uncertainty Medical Image Segmentation Estimation via Flow Matching30 Jul 2025
- 2025Distribution-Based Masked Medical Vision-Language Model Using Structured Reports29 Jul 2025
- 2025Flow Stochastic Segmentation Networks24 Jul 2025
- 2025DiffOSeg: Omni Medical Image Segmentation via Multi-Expert Collaboration Diffusion Model17 Jul 2025
- 2025HyperSORT: Self-Organising Robust Training with hyper-networks26 Jun 2025
- 2025Average Calibration Losses for Reliable Uncertainty in Medical Image Segmentation4 Jun 2025
- 2025UNSURF: Uncertainty Quantification for Cortical Surface Reconstruction of Clinical Brain MRIs31 May 2025
- 2025Position: Uncertainty Quantification Needs Reassessment for Large-language Model Agents28 May 2025
- 2025CONSIGN: Conformal Segmentation Informed by Spatial Groupings via Decomposition20 May 2025
- 2025UPMAD-Net: A Brain Tumor Segmentation Network with Uncertainty Guidance and Adaptive Multimodal Feature Fusion6 May 2025
- 2025Diffusion Based Ambiguous Image Segmentation8 Apr 2025
- 2025Explaining Uncertainty in Multiple Sclerosis Cortical Lesion Segmentation Beyond Prediction Errors7 Apr 2025
- 2025SeqSAM: Autoregressive Multiple Hypothesis Prediction for Medical Image Segmentation using SAM12 Mar 2025
- 2025L-FUSION: Laplacian Fetal Ultrasound Segmentation & Uncertainty Estimation7 Mar 2025
- 2025ConfIC-RCA: Statistically Grounded Efficient Estimation of Segmentation Quality6 Mar 2025
- 2025Uncertainty Propagation for Echocardiography Clinical Metric Estimation via Contour Sampling18 Feb 2025
- 2025GAUDA: Generative Adaptive Uncertainty-guided Diffusion-based Augmentation for Surgical Segmentation18 Jan 2025
- 2025Evidential Calibrated Uncertainty-Guided Interactive Segmentation paradigm for Ultrasound Images2 Jan 2025
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation25 Nov 2024
- 2024SPA: Efficient User-Preference Alignment against Uncertainty in Medical Image Segmentation23 Nov 2024
- 2024GASA-UNet: Global Axial Self-Attention U-Net for 3D Medical Image Segmentation20 Sep 2024
- 2024MedUHIP: Towards Human-In-the-Loop Medical Segmentation3 Aug 2024
- 2024Navigating Uncertainty in Medical Image Segmentation23 Jul 2024
- 2024Conformal Performance Range Prediction for Segmentation Output Quality Control18 Jul 2024
- 2024PULPo: Probabilistic Unsupervised Laplacian Pyramid Registration15 Jul 2024
50 newest of 128 All 128 (JSON)
- 2023Ambiguous Medical Image Segmentation using Diffusion Modelscited by 92
- 2023Stochastic Segmentation with Conditional Categorical Diffusion Modelscited by 38
- 2023BerDiff: Conditional Bernoulli Diffusion Model for Medical Image Segmentationcited by 27
- 2024FlowSDF: Flow Matching for Medical Image Segmentation Using Distance Transformscited by 25
- 2025Aleatoric Uncertainty Medical Image Segmentation Estimation via Flow Matchingcited by 5
- 2025DiffOSeg: Omni Medical Image Segmentation via Multi-Expert Collaboration Diffusion Modelcited by 2
- 2025GAUDA: Generative Adaptive Uncertainty-guided Diffusion-based Augmentation for Surgical Segmentationcited by 1
- 2025LatentFM: A Latent Flow Matching Approach for Generative Medical Image Segmentationcited by 1
- 2025LatentFM: A Latent Flow Matching Approach for Generative Medical Image Segmentation4 Dec 2025
- 2025Aleatoric Uncertainty Medical Image Segmentation Estimation via Flow Matching30 Jul 2025
- 2025DiffOSeg: Omni Medical Image Segmentation via Multi-Expert Collaboration Diffusion Model17 Jul 2025
- 2025GAUDA: Generative Adaptive Uncertainty-guided Diffusion-based Augmentation for Surgical Segmentation18 Jan 2025
- 2024FlowSDF: Flow Matching for Medical Image Segmentation Using Distance Transforms28 May 2024
- 2023Ambiguous Medical Image Segmentation using Diffusion Models10 Apr 2023
- 2023BerDiff: Conditional Bernoulli Diffusion Model for Medical Image Segmentation10 Apr 2023
- 2023Stochastic Segmentation with Conditional Categorical Diffusion Models15 Mar 2023
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2022Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysiscited by 62
- 2023A Review of Uncertainty Estimation and its Application in Medical Imagingcited by 59
- 2021Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Predictioncited by 57
- 2022Uncertainty Inspired Underwater Image Enhancementcited by 53
- 2023A review of uncertainty quantification in medical image analysis: probabilistic and non-probabilistic methodscited by 39
- 2021Spatial Uncertainty-Aware Semi-Supervised Crowd Countingcited by 38
- 2023Topology-Aware Uncertainty for Image Segmentationcited by 32
- 2021Spatially Varying Label Smoothing: Capturing Uncertainty from Expert Annotationscited by 31
- 2021QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Resultscited by 28
- 2023The Treasure Beneath Multiple Annotations: An Uncertainty-aware Edge Detectorcited by 25
- 2024ValUES: A Framework for Systematic Validation of Uncertainty Estimation in Semantic Segmentationcited by 25
12 most cited of 118 All 118 (JSON)
- 2026Latent-to-Latent Flow for Volumetric Stochastic Segmentation7 Sep 2026
- 2026CARD: Calibration via Agreement in Reverse Diffusion for Out-of-Domain MRI Segmentation26 Aug 2026
- 2026KANResDiff: Learning Local Residual Diffusion via Kolmogorov-Arnold Network for Ambiguous Medical Image Segmentation12 Aug 2026
- 2026VIDS-Seg: Towards Reliable Uncertainty Quantification in Pediatric Cardiac Ultrasound Segmentation11 Aug 2026
- 2026Variational Inference for Bird's Eye View Segmentation in Autonomous Driving16 Jul 2026
- 2026SARFA: Segment Anything with Radiomic Feature Alignment14 Jul 2026
- 2026HPR-SAM: Hierarchical Probabilistic Representation Learning for Prompt-free SAM-based Medical Image Segmentation8 Jul 2026
- 2026Interpretable Probabilistic Medical Image Segmentation via Gaussian Process with Explicit Modelling of Annotation Bias and Variability22 Jun 2026
- 2026Neural Architecture Distributions: A New Paradigm for Stochastic Segmentation19 Jun 2026
- 2026Attention-Based Prototype Calibration for Multi-Rater Few-Shot Medical Image Segmentation15 Jun 2026
- 2026Learning a Sampling-Free Variational DNN Plugin from Tiny Training Sets to Refine OOD Segmentation With Uncertainty Estimation14 Jun 2026
- 2026Principle-Guided Supervision for Interpretable Uncertainty in Medical Image Segmentation9 May 2026
12 newest of 118 All 118 (JSON)