Knowledge-driven AI-generated data for accurate and interpretable breast ultrasound diagnoses
Not on the map. Why?
Abstract (arXiv)
Data-driven deep learning models have shown great capabilities to assist radiologists in breast ultrasound (US) diagnoses. However, their effectiveness is limited by the long-tail distribution of training data, which leads to inaccuracies in rare cases. In this study, we address a long-standing challenge of improving the diagnostic model performance on rare cases using long-tailed data. Specifically, we introduce a pipeline, TAILOR, that builds a knowledge-driven generative model to produce tailored synthetic data. The generative model, using 3,749 lesions as source data, can generate millions of breast-US images, especially for error-prone rare cases. The generated data can be further used to build a diagnostic model for accurate and interpretable diagnoses. In the prospective external evaluation, our diagnostic model outperforms the average performance of nine radiologists by 33.5% in specificity with the same sensitivity, improving their performance by providing predictions with an interpretable decision-making process. Moreover, on ductal carcinoma in situ (DCIS), our diagnostic model outperforms all radiologists by a large margin, with only 34 DCIS lesions in the source data. We believe that TAILOR can potentially be extended to various diseases and imaging modalities.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 68 references that are in the map. First posted on arXiv 23 Jul 2024.
Builds on
24 of 68 references.
References · 24
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2021Deep Long-Tailed Learning: A Surveycited by 416
- 2017Data Augmentation Generative Adversarial Networkscited by 278
12 more
- 2018GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classificationcited by 242
- 2018BAGAN: Data Augmentation with Balancing GANcited by 90
- 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
- 2022Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domainscited by 85
- 2023Generative AI for Medical Imaging: extending the MONAI Frameworkcited by 68
- 2023Label-Free Liver Tumor Segmentationcited by 56
- 2021Selective Synthetic Augmentation with HistoGAN for Improved Histopathology Image Classificationcited by 35
- 2019DermGAN: Synthetic Generation of Clinical Skin Images with Pathologycited by 33
- 2022A New Dataset and A Baseline Model for Breast Lesion Detection in Ultrasound Videoscited by 32
- 2023Augmenting medical image classifiers with synthetic data from latent diffusion modelscited by 21
- 2023Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedbackcited by 14
- 2019Generative Image Translation for Data Augmentation of Bone Lesion Pathologycited by 7
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.