Hybrid Diffusion Model for Breast Ultrasound Image Augmentation
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
We propose a hybrid diffusion-based augmentation framework to overcome the critical challenge of ultrasound data augmentation in breast ultrasound (BUS) datasets. Unlike conventional diffusion-based augmentations, our approach improves visual fidelity and preserves ultrasound texture by combining text-to-image generation with image-to-image (img2img) refinement, as well as fine-tuning with low-rank adaptation (LoRA) and textual inversion (TI). Our method generated realistic, class-consistent images on an open-source Kaggle breast ultrasound image dataset (BUSI). Compared to the Stable Diffusion v1.5 baseline, incorporating TI and img2img refinement reduced the Frechet Inception Distance (FID) from 45.97 to 33.29, demonstrating a substantial gain in fidelity while maintaining comparable downstream classification performance. Overall, the proposed framework effectively mitigates the low-fidelity limitations of synthetic ultrasound images and enhances the quality of augmentation for robust diagnostic modeling.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 6 of its 13 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
6 of 13 references.
Closest ancestors · 1
Same direction, newest first
Other references · 5
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Feature-Space Guided Diffusion for Realistic Ultrasound Image Synthesis
- 2025Enhancing Fetal Plane Classification Accuracy with Data Augmentation Using Diffusion Models
- 2024Diffusion as Sound Propagation: Physics-inspired Model for Ultrasound Image Generation
- 2025Generative augmentations for improved cardiac ultrasound segmentation using diffusion models
- 2024MEDDAP: Medical Dataset Enhancement via Diversified Augmentation Pipeline
- 2025ADAptation: Reconstruction-based Unsupervised Active Learning for Breast Ultrasound Diagnosis
- 2024CSG: A Context-Semantic Guided Diffusion Approach in De Novo Musculoskeletal Ultrasound Image Generation
- 2025A Dual-Mode ViT-Conditioned Diffusion Framework with an Adaptive Conditioning Bridge for Breast Cancer Segmentation