mlsanityData to 14 Oct 2026

An End-to-End Automated Pipeline for Controllable Crack Data Synthesis

arXiv 2609.12431 ↗First posted 11 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision-based crack inspection depends on segmentation networks whose reliability depends on the quantity, diversity and label quality of their training data. Pixel-level annotations are costly, and crack images of specific structures are scarce. Generative augmentation can supply additional data, but existing methods address isolated steps. They reuse annotated masks, offer limited control over crack geometry, and adopt the conditioning mask as the label without checking it. This paper presents an end-to-end pipeline that produces labelled crack data without manual annotation and assesses the reliability of these data and of the detectors trained on them. Procedurally sampled B'ezier skeletons with guaranteed geometric properties are converted into crack masks by a generative adversarial network (GAN). A dual-ControlNet Stable Diffusion model renders the masks as crack images, either on text-described surfaces or on user-provided backgrounds. An ensemble of segmentation networks trained on real images combines its agreement with the inherited label and its internal disagreement into a pixel-wise label confidence. This confidence weights the training loss instead of removing samples with a threshold. The trained detectors are evaluated with image-space probability of detection (POD) and calibration analyses. On CRACK500 and CrackTree200, the pipeline improves five segmentation networks over conventional, diffusion-based and flow-matching-based augmentation, and on CRACK500 confidence weighting yields a higher accuracy than threshold filtering at every tested threshold. On CRACK500, the crack width that U-Net detects with 90% probability at 95% confidence decreases from 8.0 to 4.3 pixels, and the expected calibration error decreases from 14.2% to 9.6%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 85 references that are in the map. First posted on arXiv 11 Sep 2026.

Builds on

35 of 85 references.

References · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2017On Calibration of Modern Neural Networkscited by 4,960
  10. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  11. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
  12. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
23 more
  1. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  2. 2016Pyramid Scene Parsing Networkcited by 2,479
  3. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  4. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
  5. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  6. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
  7. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  8. 2021Segmenter: Transformer for Semantic Segmentationcited by 855
  9. 2020A Survey on Visual Transformercited by 654
  10. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  11. 2017Generative Adversarial Networks: An Overviewcited by 590
  12. 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
  13. 2019Confident Learning: Estimating Uncertainty in Dataset Labelscited by 413
  14. 2017Understanding Convolution for Semantic Segmentationcited by 168
  15. 2019Confidence Calibration and Predictive Uncertainty Estimation for Deep Medical Image Segmentationcited by 163
  16. 2023DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Modelscited by 162
  17. 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 123
  18. 2019Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detectioncited by 80
  19. 2023FreeMask: Synthetic Images with Dense Annotations Make Stronger Segmentation Modelscited by 61
  20. 2022CrackSeg9k: A Collection and Benchmark for Crack Segmentation Datasets and Frameworkscited by 22
  21. 2022NHA12D: A New Pavement Crack Dataset and a Comparison Study Of Crack Detection Algorithmscited by 8
  22. 2024Hybrid-Segmentor: A Hybrid Approach to Automated Fine-Grained Crack Segmentation in Civil Infrastructurecited by 7
  23. 2026Evaluation of AI-based Visual Crack Detection in Steel Bridges Using Probability of Detectioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CrackSegFlow: Controllable Flow Matching Synthesis for Generalizable Crack Segmentation with a 50K Image-Mask Benchmark
  2. 2024Controllable Image Synthesis of Industrial Data Using Stable Diffusion
  3. 2026Rethinking Efficient Crack Segmentation with Task-Aligned Structural-Directional Modeling
  4. 2025SCSegamba: Lightweight Structure-Aware Vision Mamba for Crack Segmentation in Structures
  5. 2024Vision Mamba-based autonomous crack segmentation on concrete, asphalt, and masonry surfaces
  6. 2026MixerCSeg: An Efficient Mixer Architecture for Crack Segmentation via Decoupled Mamba Attention
  7. 2024Mamba meets crack segmentation
  8. 2026Cracks in the Foundation: A Civil Infrastructure Dataset to Challenge Vision Foundation Models