mlsanityData to 7 Oct 2026

Knowledge-driven AI-generated data for accurate and interpretable breast ultrasound diagnoses

arXiv 2407.16634 ↗First posted 23 Jul 2024eess.IV cs.AI cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Data-driven deep learning models have shown great capabilities to assist radiologists in breast ultrasound (US) diagnoses. However, their effectiveness is limited by the long-tail distribution of training data, which leads to inaccuracies in rare cases. In this study, we address a long-standing challenge of improving the diagnostic model performance on rare cases using long-tailed data. Specifically, we introduce a pipeline, TAILOR, that builds a knowledge-driven generative model to produce tailored synthetic data. The generative model, using 3,749 lesions as source data, can generate millions of breast-US images, especially for error-prone rare cases. The generated data can be further used to build a diagnostic model for accurate and interpretable diagnoses. In the prospective external evaluation, our diagnostic model outperforms the average performance of nine radiologists by 33.5% in specificity with the same sensitivity, improving their performance by providing predictions with an interpretable decision-making process. Moreover, on ductal carcinoma in situ (DCIS), our diagnostic model outperforms all radiologists by a large margin, with only 34 DCIS lesions in the source data. We believe that TAILOR can potentially be extended to various diseases and imaging modalities.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 68 references that are in the map. First posted on arXiv 23 Jul 2024.

Builds on

24 of 68 references.

References · 24

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  9. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  10. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  11. 2021Deep Long-Tailed Learning: A Surveycited by 416
  12. 2017Data Augmentation Generative Adversarial Networkscited by 278
12 more
  1. 2018GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classificationcited by 242
  2. 2018BAGAN: Data Augmentation with Balancing GANcited by 90
  3. 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
  4. 2022Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domainscited by 85
  5. 2023Generative AI for Medical Imaging: extending the MONAI Frameworkcited by 68
  6. 2023Label-Free Liver Tumor Segmentationcited by 56
  7. 2021Selective Synthetic Augmentation with HistoGAN for Improved Histopathology Image Classificationcited by 35
  8. 2019DermGAN: Synthetic Generation of Clinical Skin Images with Pathologycited by 33
  9. 2022A New Dataset and A Baseline Model for Breast Lesion Detection in Ultrasound Videoscited by 32
  10. 2023Augmenting medical image classifiers with synthetic data from latent diffusion modelscited by 21
  11. 2023Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedbackcited by 14
  12. 2019Generative Image Translation for Data Augmentation of Bone Lesion Pathologycited by 7

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.