UnGAP: Uncertainty-Guided Affine Prompting for Real-Time Crack Segmentation
Not on the map. Why?
Abstract (arXiv)
Real-time crack segmentation is vital for structural health monitoring but is plagued by aleatoric uncertainties arising from varying lighting, blur, and texture ambiguity. Current uncertainty-aware approaches typically treat uncertainty estimation as a passive endpoint for post-hoc analysis, failing to close the loop by feeding this information back to refine feature representations. We contend that independent pixel-wise heteroscedastic modeling is uniquely suited for crack segmentation, as cracks are defined by fine-grained local gradients rather than the global semantic coherence relied upon in general object segmentation. However, this approach suffers from a structural optimization pathology: high predicted variance attenuates loss gradients, effectively causing the model to ignore difficult samples and under-fit complex boundaries. To address these challenges, we propose UnGAP, a novel framework that establishes a closed-loop mechanism between uncertainty estimation and feature learning. Central to our approach is the Uncertainty-Prompted Feature Modulator (UPFM), which treats aleatoric uncertainty as an active visual prompt rather than a mere output. UPFM dynamically calibrates feature distributions through pixel-wise affine transformations. Crucially, this mechanism mitigates the heteroscedastic pathology by transforming high variance, which would otherwise indicate gradient suppression, into a constructive signal for stronger feature rectification in ambiguous regions. Additionally, a boundary-aware detection head is introduced to further constrain prediction precision. Extensive experiments demonstrate that UnGAP balances superior segmentation accuracy with real-time inference speed, effectively validating the benefit of transforming uncertainty from a passive metric into an active calibration tool.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 45 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
23 of 45 references.
References · 23
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 620
- 2018A Probabilistic U-Net for Segmentation of Ambiguous Imagescited by 283
- 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
- 2019Topology-Preserving Deep Image Segmentationcited by 198
- 2019PHiSeg: Capturing Uncertainty in Medical Image Segmentationcited by 128
11 more
- 2022On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural Networkscited by 120
- 2019Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detectioncited by 80
- 2019'In-Between' Uncertainty in Bayesian Neural Networkscited by 80
- 2023Stochastic Segmentation with Conditional Categorical Diffusion Modelscited by 38
- 2020Detecting Out-of-distribution Samples via Variational Auto-encoder with Reliable Uncertainty Estimationcited by 24
- 2020Uncertainty quantification in medical image segmentation with normalizing flowscited by 23
- 2022CrackSeg9k: A Collection and Benchmark for Crack Segmentation Datasets and Frameworkscited by 22
- 2023Understanding Pathologies of Deep Heteroskedastic Regressioncited by 10
- 2023Real-time High-Resolution Neural Network with Semantic Guidance for Crack Segmentationcited by 10
- 2024Hybrid-Segmentor: A Hybrid Approach to Automated Fine-Grained Crack Segmentation in Civil Infrastructurecited by 7
- 2023B-BACN: Bayesian Boundary-Aware Convolutional Network for Crack Characterizationcited by 3
Built on by
Not cited yet.