Quantifying the unknown impact of segmentation uncertainty on image-based simulations
Not on the map. Why?
Abstract (arXiv)
Image-based simulation, the use of 3D images to calculate physical quantities, fundamentally relies on image segmentation to create the computational geometry. However, this process introduces image segmentation uncertainty because there is a variety of different segmentation tools (both manual and machine-learning-based) that will each produce a unique and valid segmentation. First, we demonstrate that these variations propagate into the physics simulations, compromising the resulting physics quantities. Second, we propose a general framework for rapidly quantifying segmentation uncertainty. Through the creation and sampling of segmentation uncertainty probability maps, we systematically and objectively create uncertainty distributions of the physics quantities. We show that physics quantity uncertainty distributions can follow a Normal distribution, but, in more complicated physics simulations, the resulting uncertainty distribution can be both nonintuitive and surprisingly nontrivial. We also establish that simply bounding the uncertainty can fail in situations that are sensitive to image segmentation. While our work does not eliminate segmentation uncertainty, it makes visible the previously unrecognized range of uncertainty currently plaguing image-based simulation, enabling more credible simulations.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 5; 2024: 2; 2025: 0; 2026: 1.
11 papers.
- 2023A Review of Uncertainty Estimation and its Application in Medical Imagingcited by 59
- 2023A review of uncertainty quantification in medical image analysis: probabilistic and non-probabilistic methodscited by 39
- 2024Conformal Semantic Image Segmentation: Post-hoc Quantification of Predictive Uncertaintycited by 20
- 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capturecited by 11
- 2022PatchRefineNet: Improving Binary Segmentation by Incorporating Signals from Optimal Patch-wise Binarizationcited by 6
- 2021Incorporating Boundary Uncertainty into loss functions for biomedical image segmentationcited by 3
- 2022Combined Data and Deep Learning Model Uncertainties: An Application to the Measurement of Solid Fuel Regression Ratecited by 2
- 2023PULASki: Learning inter-rater variability using statistical distances to improve probabilistic segmentationcited by 1
- 2023Efficient Segmentation with Texture in Ore Images Based on Box-supervised Approachcited by 0
- 2024Deep Probability Segmentation: Are segmentation models probability estimators?cited by 0
- 2026Uncertainty-Guided Conservative Propagation for Structured Inference in Vessel Segmentationcited by 0
- 2026Uncertainty-Guided Conservative Propagation for Structured Inference in Vessel Segmentation19 May 2026
- 2024Deep Probability Segmentation: Are segmentation models probability estimators?19 Sep 2024
- 2024Conformal Semantic Image Segmentation: Post-hoc Quantification of Predictive Uncertainty16 Apr 2024
- 2023PULASki: Learning inter-rater variability using statistical distances to improve probabilistic segmentation25 Dec 2023
- 2023Efficient Segmentation with Texture in Ore Images Based on Box-supervised Approach10 Nov 2023
- 2023A review of uncertainty quantification in medical image analysis: probabilistic and non-probabilistic methods9 Oct 2023
- 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capture25 May 2023
- 2023A Review of Uncertainty Estimation and its Application in Medical Imaging16 Feb 2023
- 2022PatchRefineNet: Improving Binary Segmentation by Incorporating Signals from Optimal Patch-wise Binarization12 Nov 2022
- 2022Combined Data and Deep Learning Model Uncertainties: An Application to the Measurement of Solid Fuel Regression Rate25 Oct 2022
- 2021Incorporating Boundary Uncertainty into loss functions for biomedical image segmentation31 Oct 2021