Multi-Conditioned Diffusion Synthesis of Sand Boils for Low-Resource Earthen-Levee Inspection
Not on the map. Why?
Abstract (arXiv)
Sand boils on earthen levees are safety-critical defects, but pixel-level detection is limited by scarce annotations. We present a diffusion-based synthesis pipeline for low-resource sand-boil imagery. Using Stable Diffusion XL fine-tuned with DreamBooth and conditioned by a multi-branch ControlNet stack, the pipeline generates synthetic inspection images from a small curated reference set. A soft-mask inpainting protocol preserves the real defect pixels while re-rendering the surrounding scene, avoiding seams and color shifts from prior seamless-cloning compositing. A mask-conditioned ControlNet can also generate a new boil inside a chosen mask, making the mask the segmentation label by construction; however, because large-scale label certification remains unresolved with the available real-trained gate, we release the soft-mask preset as the default. Text conditioning is supplied by a taxonomy-driven Prompt Atlas that expands one domain specification into a stratified, CLIP-validated prompt bank and transfers to new defect classes without code changes. From the real training images, the pipeline produces 1,020 synthetic candidates, of which 815 pass a CLIP admissibility filter. We evaluate image quality using distributional and fidelity-diversity measures against the real reference set and a Poisson baseline, and audit for out-of-distribution drift and memorization. No single preset dominates; each trades off fidelity, diversity, and label reliability. We therefore release the label-reliable preset as the default and treat a curated mixture as the natural augmentation set. Our claims are limited to image quality, label provenance, and diversity; downstream segmentation is left for future work. Code and an artifact manifest are released for reproducibility.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 41 of its 62 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
41 of 62 references.
References · 41
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2023Segment Anythingcited by 8,158
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
29 more
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2018Demystifying MMD GANscited by 1,268
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
- 2015Holistically-Nested Edge Detectioncited by 590
- 2018Albumentations: fast and flexible image augmentationscited by 558
- 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
- 20218-bit Optimizers via Block-wise Quantizationcited by 395
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 326
- 2023Effective Data Augmentation With Diffusion Modelscited by 282
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
- 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
- 2019The VIA Annotation Software for Images, Audio and Videocited by 166
- 2019Effectively Unbiased FID and Inception Score and where to find themcited by 161
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
- 2023Few-Shot Defect Image Generation via Defect-Aware Feature Manipulationcited by 66
- 2024Imbalance-Aware Culvert-Sewer Defect Segmentation Using an Enhanced Feature Pyramid Networkcited by 7
- 2023Deep Learning Approaches in Pavement Distress Identification: A Reviewcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Synthesizing realistic sand assemblies with denoising diffusion in latent space
- 2024FLAME Diffuser: Wildfire Image Synthesis using Mask Guided Diffusion
- 2026CrackSegFlow: Controllable Flow Matching Synthesis for Generalizable Crack Segmentation with a 50K Image-Mask Benchmark
- 2026Deep Learning for Remote Sensing to Improve Flood Inundation Mapping
- 2026When Earth Foundation Models Meet Diffusion: An Application to Land Surface Temperature Super-Resolution
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation
- 2024DefFiller: Mask-Conditioned Diffusion for Salient Steel Surface Defect Generation
- 2026SIMPLER: Efficient Foundation Model Adaptation via Similarity-Guided Layer Pruning for Earth Observation