mlsanityData to 14 Oct 2026

CSG: A Context-Semantic Guided Diffusion Approach in De Novo Musculoskeletal Ultrasound Image Generation

arXiv 2412.05833 ↗First posted 8 Dec 2024cs.CV eess.IVcited by 2

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

The use of synthetic images in medical imaging Artificial Intelligence (AI) solutions has been shown to be beneficial in addressing the limited availability of diverse, unbiased, and representative data. Despite the extensive use of synthetic image generation methods, controlling the semantics variability and context details remains challenging, limiting their effectiveness in producing diverse and representative medical image datasets. In this work, we introduce a scalable semantic and context-conditioned generative model, coined CSG (Context-Semantic Guidance). This dual conditioning approach allows for comprehensive control over both structure and appearance, advancing the synthesis of realistic and diverse ultrasound images. We demonstrate the ability of CSG to generate findings (pathological anomalies) in musculoskeletal (MSK) ultrasound images. Moreover, we test the quality of the synthetic images using a three-fold validation protocol. The results show that the synthetic images generated by CSG improve the performance of semantic segmentation models, exhibit enhanced similarity to real images compared to the baseline methods, and are undistinguishable from real images according to a Turing test. Furthermore, we demonstrate an extension of the CSG that allows enhancing the variability space of images by synthetically generating augmentations of anatomical geometries and textures.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 29 of its 52 references that are in the map. First posted on arXiv 8 Dec 2024.

Builds on

29 of 52 references.

References · 29

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  8. 2015Fast R-CNNcited by 2,933
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  10. 2014Conditional Generative Adversarial Netscited by 2,162
  11. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  12. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
17 more
  1. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  2. 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
  3. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  4. 2015A Neural Algorithm of Artistic Stylecited by 483
  5. 2018Generative Adversarial Network in Medical Imaging: A Reviewcited by 257
  6. 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
  7. 2018MedGAN: Medical Image Translation using GANscited by 152
  8. 2022Sketch guided and progressive growing GAN for realistic and editable ultrasound image synthesiscited by 42
  9. 2017Synthetic Medical Images from Dual Generative Adversarial Networkscited by 32
  10. 2020Self-Supervised Ultrasound to MRI Fetal Brain Image Synthesiscited by 19
  11. 2021Machine learning approach for biopsy-based identification of eosinophilic esophagitis reveals importance of global featurescited by 10
  12. 2022Harnessing Artificial Intelligence to Infer Novel Spatial Biomarkers for the Diagnosis of Eosinophilic Esophagitiscited by 6
  13. 2021Realistic Ultrasound Image Synthesis for Improved Classification of Liver Diseasecited by 5
  14. 2023Between Generating Noise and Generating Images: Noise in the Correct Frequency Improves the Quality of Synthetic Histopathology Images for Digital Pathologycited by 5
  15. 2023DEPAS: De-novo Pathology Semantic Masks using a Generative Modelcited by 2
  16. 2024Semantic Segmentation Refiner for Ultrasound Applications with Zero-Shot Foundation Modelscited by 2
  17. 2024PriorPath: Coarse-To-Fine Approach for Controlled De-Novo Pathology Semantic Masks Generationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Ultrasound Image Generation using Latent Diffusion Models
  2. 2026Feature-Space Guided Diffusion for Realistic Ultrasound Image Synthesis
  3. 2024Vision-Language Synthetic Data Enhances Echocardiography Downstream Tasks
  4. 2024Diffusion as Sound Propagation: Physics-inspired Model for Ultrasound Image Generation
  5. 2023Echo from noise: synthetic ultrasound image generation using diffusion models for real image segmentation
  6. 2023DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Model
  7. 2024Efficient Semantic Diffusion Architectures for Model Training on Synthetic Echocardiograms
  8. 2026Hybrid Diffusion Model for Breast Ultrasound Image Augmentation