Beyond Uncertainty: Generalizable Failure Monitoring for Surgical Segmentation under Acquisition Degradation
Not on the map. Why?
Abstract (arXiv)
Surgical segmentation networks can fail silently under acquisition degradation: predicted masks may be wrong even when model confidence remains high. Existing deployment-time monitors rely primarily on uncertainty estimates and can therefore miss confident failures. We present TCSR-Monitor (Temporal Conformal Surgical Risk Monitor), a post-hoc failure-monitoring framework that combines confidence with observable shape, temporal-consistency, and image-quality cues. TCSR-Monitor wraps a frozen segmentation model, requires no model internals, and operates without ground truth at deployment. We also introduce a validation protocol to assess whether alarms remain credible under distribution shift. On EndoVis 2017, leave-one-corruption-out evaluation shows that TCSR-Monitor generalizes to unseen acquisition degradations and substantially outperforms confidence-based baselines. A circularity control confirms that it predicts segmentation failure rather than simply detecting corrupted images. Mondrian conformal calibration balances miss-rates across degradation severities, but a single global threshold still produces false alarms on up to 40% of correctly segmented frames at moderate corruption. Zero-shot transfer to SAM2 demonstrates feature portability, although entropy outperforms the transferred monitor at both evaluated thresholds. Overall, reliable monitoring under acquisition degradation benefits from complementary observable signals beyond confidence alone, but substantial false-alarm and transfer limitations remain.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 33 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
30 of 33 references.
References · 30
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2023Segment Anythingcited by 8,158
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2017Selective Classification for Deep Neural Networkscited by 799
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
18 more
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
- 2022Conformal Risk Controlcited by 290
- 2019Addressing Failure Prediction by Learning Model Confidencecited by 183
- 20192017 Robotic Instrument Segmentation Challengecited by 166
- 2019Confidence Calibration and Predictive Uncertainty Estimation for Deep Medical Image Segmentationcited by 162
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
- 2022Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in Imagingcited by 107
- 2020CholecSeg8k: A Semantic Segmentation Dataset for Laparoscopic Cholecystectomy Based on Cholec80cited by 104
- 2021Continual Semantic Segmentation via Repulsion-Attraction of Sparse and Disentangled Latent Representationscited by 96
- 2018Automatic Instrument Segmentation in Robot-Assisted Surgery Using Deep Learningcited by 81
- 2019Assessing Reliability and Challenges of Uncertainty Estimations for Medical Image Segmentationcited by 75
- 2018Prediction Error Meta Classification in Semantic Segmentation: Detection via Aggregated Dispersion Measures of Softmax Probabilitiescited by 54
- 2021DOCTOR: A Simple Method for Detecting Misclassification Errorscited by 52
- 2024Surgical SAM 2: Real-time Segment Anything in Surgical Video by Efficient Frame Pruningcited by 46
- 2022Improving Trustworthiness of AI Disease Severity Rating in Medical Imaging with Ordinal Conformal Prediction Setscited by 38
- 2018Comparative evaluation of instrument segmentation and tracking methods in minimally invasive surgerycited by 36
- 2021FSNet: A Failure Detection Framework for Semantic Segmentationcited by 9
- 2024SegSTRONG-C: Segmenting Surgical Tools Robustly On Non-adversarial Generated Corruptions -- An EndoVis'24 Challengecited by 7
Built on by
Not cited yet.