Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification
Not on the map. Why?
Abstract (arXiv)
Accurate dermatological diagnosis naturally necessitates equitable performance across diverse populations, yet a systematic lack of expertly annotated images, especially for underrepresented skin tones and rare diseases, impedes progress toward measurably fair methods. We introduce cgDDI (Controllable Generation of Diverse Dermatological Imagery), a hybrid framework that (1) synthesizes realistic healthy skin samples without disturbing other input properties, (2) maps single-sample rare lesions onto novel skin-tones and locations non-parametrically, and (3) allows for efficient parametric generation with as few as 10 training samples. The framework supports both human and automated segmentation masking, enabling scalability to datasets without pre-made lesion masks. We grow a 656-image dataset by more than 400x and validate across two datasets: biopsy-confirmed Diverse Dermatology Images (DDI) and expert-verified Fitzpatrick17k (F17k). On the DDI benchmark, we achieve malignancy classification accuracy of 86.4% under synthetic-only training and 90.9% state-of-the-art performance with real data fine-tuning, alongside leading fairness metrics. Cross-dataset experiments show +13.9% accuracy improvements on unseen F17k data despite minimal disease overlap. We openly release 266k+ synthetic images, code, and generative models to further support fairness research at https://github.com/hectorcarrion/ControllableGenDDI.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 27 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
20 of 27 references.
References · 20
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2018Demystifying MMD GANscited by 1,268
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2021Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Datasetcited by 184
- 2021Disparities in Dermatology AI: Assessments Using Diverse Clinical Imagescited by 132
- 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusioncited by 114
- 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
8 more
- 2023Diffusion-based Data Augmentation for Skin Disease Classification: Impact Across Original Medical Datasets to Fully Synthetic Imagescited by 45
- 2022Improving dermatology classifiers across populations using images generated by large diffusion modelscited by 25
- 2022FairDisCo: Fairer AI in Dermatology via Disentanglement Contrastive Learningcited by 22
- 2023Augmenting medical image classifiers with synthetic data from latent diffusion modelscited by 21
- 2024From Majority to Minority: A Diffusion-based Augmentation for Underrepresented Groups in Skin Lesion Analysiscited by 9
- 2024PatchAlign:Fair and Accurate Skin Disease Image Classification by Alignment with Clinical Labelscited by 5
- 2023FEDD -- Fair, Efficient, and Diverse Diffusion-based Lesion Segmentation and Malignancy Classificationcited by 4
- 2024An Improved Method for Personalizing Diffusion Modelscited by 2
Built on by
Not cited yet.