mlsanityData to 7 Oct 2026

Multi-Conditioned Diffusion Synthesis of Sand Boils for Low-Resource Earthen-Levee Inspection

arXiv 2607.08794 ↗First posted 8 Jul 2026cs.GR cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Sand boils on earthen levees are safety-critical defects, but pixel-level detection is limited by scarce annotations. We present a diffusion-based synthesis pipeline for low-resource sand-boil imagery. Using Stable Diffusion XL fine-tuned with DreamBooth and conditioned by a multi-branch ControlNet stack, the pipeline generates synthetic inspection images from a small curated reference set. A soft-mask inpainting protocol preserves the real defect pixels while re-rendering the surrounding scene, avoiding seams and color shifts from prior seamless-cloning compositing. A mask-conditioned ControlNet can also generate a new boil inside a chosen mask, making the mask the segmentation label by construction; however, because large-scale label certification remains unresolved with the available real-trained gate, we release the soft-mask preset as the default. Text conditioning is supplied by a taxonomy-driven Prompt Atlas that expands one domain specification into a stratified, CLIP-validated prompt bank and transfers to new defect classes without code changes. From the real training images, the pipeline produces 1,020 synthetic candidates, of which 815 pass a CLIP admissibility filter. We evaluate image quality using distributional and fidelity-diversity measures against the real reference set and a Poisson baseline, and audit for out-of-distribution drift and memorization. No single preset dominates; each trades off fidelity, diversity, and label reliability. We therefore release the label-reliable preset as the default and treat a curated mixture as the natural augmentation set. Our claims are limited to image quality, label provenance, and diversity; downstream segmentation is left for future work. Code and an artifact manifest are released for reproducibility.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 41 of its 62 references that are in the map. First posted on arXiv 8 Jul 2026.

Builds on

41 of 62 references.

References · 41

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2023Segment Anythingcited by 8,158
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  10. 2024Qwen2.5 Technical Reportcited by 4,713
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
29 more
  1. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  4. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  5. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  6. 2021Vision Transformers for Dense Predictioncited by 1,789
  7. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  8. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  9. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  10. 2018Demystifying MMD GANscited by 1,268
  11. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  12. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  13. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  14. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  15. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  16. 2015Holistically-Nested Edge Detectioncited by 590
  17. 2018Albumentations: fast and flexible image augmentationscited by 558
  18. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
  19. 20218-bit Optimizers via Block-wise Quantizationcited by 395
  20. 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 326
  21. 2023Effective Data Augmentation With Diffusion Modelscited by 282
  22. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
  23. 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
  24. 2019The VIA Annotation Software for Images, Audio and Videocited by 166
  25. 2019Effectively Unbiased FID and Inception Score and where to find themcited by 161
  26. 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
  27. 2023Few-Shot Defect Image Generation via Defect-Aware Feature Manipulationcited by 66
  28. 2024Imbalance-Aware Culvert-Sewer Defect Segmentation Using an Enhanced Feature Pyramid Networkcited by 7
  29. 2023Deep Learning Approaches in Pavement Distress Identification: A Reviewcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023Synthesizing realistic sand assemblies with denoising diffusion in latent space
  2. 2024FLAME Diffuser: Wildfire Image Synthesis using Mask Guided Diffusion
  3. 2026CrackSegFlow: Controllable Flow Matching Synthesis for Generalizable Crack Segmentation with a 50K Image-Mask Benchmark
  4. 2026Deep Learning for Remote Sensing to Improve Flood Inundation Mapping
  5. 2026When Earth Foundation Models Meet Diffusion: An Application to Land Surface Temperature Super-Resolution
  6. 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation
  7. 2024DefFiller: Mask-Conditioned Diffusion for Salient Steel Surface Defect Generation
  8. 2026SIMPLER: Efficient Foundation Model Adaptation via Similarity-Guided Layer Pruning for Earth Observation