A deep learning system for differential diagnosis of skin diseases
Not on the map. Why?
Abstract (arXiv)
Skin conditions affect an estimated 1.9 billion people worldwide. A shortage of dermatologists causes long wait times and leads patients to seek dermatologic care from general practitioners. However, the diagnostic accuracy of general practitioners has been reported to be only 0.24-0.70 (compared to 0.77-0.96 for dermatologists), resulting in referral errors, delays in care, and errors in diagnosis and treatment. In this paper, we developed a deep learning system (DLS) to provide a differential diagnosis of skin conditions for clinical cases (skin photographs and associated medical histories). The DLS distinguishes between 26 skin conditions that represent roughly 80% of the volume of skin conditions seen in primary care. The DLS was developed and validated using de-identified cases from a teledermatology practice serving 17 clinical sites via a temporal split: the first 14,021 cases for development and the last 3,756 cases for validation. On the validation set, where a panel of three board-certified dermatologists defined the reference standard for every case, the DLS achieved 0.71 and 0.93 top-1 and top-3 accuracies respectively. For a random subset of the validation set (n=963 cases), 18 clinicians reviewed the cases for comparison. On this subset, the DLS achieved a 0.67 top-1 accuracy, non-inferior to board-certified dermatologists (0.63, p<0.001), and higher than primary care physicians (PCPs, 0.45) and nurse practitioners (NPs, 0.41). The top-3 accuracy showed a similar trend: 0.90 DLS, 0.75 dermatologists, 0.60 PCPs, and 0.55 NPs. These results highlight the potential of the DLS to augment general practitioners to accurately diagnose skin conditions by suggesting differential diagnoses that may not have been considered. Future work will be needed to prospectively assess the clinical impact of using this tool in actual clinical workflows.
Key facts. Cited by 118 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 23; 2023: 29; 2024: 19; 2025: 16; 2026: 12.
118 papers.
Sort:
By area:
- 2021Big Self-Supervised Models Advance Medical Image Classificationcited by 320
- 2021Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Datasetcited by 184
- 2021Disparities in Dermatology AI: Assessments Using Diverse Clinical Imagescited by 132
- 2023Towards Accurate Differential Diagnosis with Large Language Modelscited by 115
- 2021Learning Optimal Conformal Classifierscited by 108
- 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
- 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
- 2022Integrated multimodal artificial intelligence framework for healthcare applicationscited by 69
- 2021Does Your Dermatology Classifier Know What It Doesn't Know? Detecting the Long-Tail of Unseen Conditionscited by 68
- 2022Detecting Shortcut Learning for Fair Medical AI using Shortcut Testingcited by 52
- 2022Diagnosing failures of fairness transfer across distribution shift in real-world medical settingscited by 45
- 2022Long-Tailed Classification of Thorax Diseases on Chest X-Ray: A New Benchmark Studycited by 45
38 more
- 2026MedGemma 1.5 Technical Reportcited by 43
- 2022Robust and Efficient Medical Imaging with Self-Supervisioncited by 40
- 2021Supervised Transfer Learning at Scale for Medical Imagingcited by 38
- 2022Towards Transparency in Dermatology Image Datasets with Skin Tone Annotations by Experts, Crowds, and an Algorithmcited by 35
- 2023Conformal prediction under ambiguous ground truthcited by 31
- 2025Derm1M: A Million-scale Vision-Language Dataset Aligned with Clinical Ontology Knowledge for Dermatologycited by 28
- 2023Coherent Concept-based Explanations in Medical Image and Its Application to Skin Lesion Diagnosiscited by 26
- 2022Improving dermatology classifiers across populations using images generated by large diffusion modelscited by 25
- 2021Single Model Deep Learning on Imbalanced Small Datasets for Skin Lesion Classificationcited by 23
- 2025MEDDxAgent: A Unified Modular Agent Framework for Explainable Automatic Differential Diagnosiscited by 23
- 2023Augmenting medical image classifiers with synthetic data from latent diffusion modelscited by 21
- 2024Conformalized Credal Regions for Classification with Ambiguous Ground Truthcited by 19
- 2023SkinGPT-4: An Interactive Dermatology Diagnostic System with Visual Large Language Modelcited by 18
- 2022CIRCLe: Color Invariant Representation Learning for Unbiased Classification of Skin Lesionscited by 17
- 2021Exponentiated Gradient Reweighting for Robust Training Under Label Noise and Beyondcited by 16
- 2022Distributed Contrastive Learning for Medical Image Segmentationcited by 16
- 2023Devil is in the Queries: Advancing Mask Transformers for Real-world Medical Image Segmentation and Out-of-Distribution Localizationcited by 16
- 2023CancerUniT: Towards a Single Unified Model for Effective Detection, Segmentation, and Diagnosis of Eight Major Cancers Using a Large Collection of CT Scanscited by 15
- 2025MAKE: Multi-Aspect Knowledge-Enhanced Vision-Language Pretraining for Zero-shot Dermatological Assessmentcited by 12
- 2021Annotation-efficient cancer detection with report-guided lesion annotation for deep learning-based prostate cancer detection in bpMRIcited by 11
- 2023Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directionscited by 10
- 2022A Reduction to Binary Approach for Debiasing Multiclass Datasetscited by 9
- 2023Achieving Reliable and Fair Skin Lesion Diagnosis via Unsupervised Domain Adaptationcited by 9
- 2024From Majority to Minority: A Diffusion-based Augmentation for Underrepresented Groups in Skin Lesion Analysiscited by 9
- 2025Doctor Approved: Generating Medically Accurate Skin Disease Images through AI-Expert Feedbackcited by 9
- 2021Can self-training identify suspicious ugly duckling lesions?cited by 7
- 2022An Accurate and Explainable Deep Learning System Improves Interobserver Agreement in the Interpretation of Chest Radiographcited by 7
- 2023Evaluating AI systems under uncertain ground truth: a case study in dermatologycited by 7
- 2024Investigating the Quality of DermaMNIST and Fitzpatrick17k Dermatological Image Datasetscited by 7
- 2024Tissue Concepts: supervised foundation models in computational pathologycited by 7
- 2023A Novel Multi-Task Model Imitating Dermatologists for Accurate Differential Diagnosis of Skin Diseases in Clinical Imagescited by 6
- 2021On the Robustness of Pretraining and Self-Supervision for a Deep Learning-based Analysis of Diabetic Retinopathycited by 5
- 2022AFFIRM: Affinity Fusion-based Framework for Iteratively Random Motion correction of multi-slice fetal brain MRIcited by 5
- 2022Identifying the Context Shift between Test Benchmarks and Production Datacited by 5
- 2022Medical Diagnosis with Large Scale Multimodal Transformers: Leveraging Diverse Data for More Accurate Diagnosiscited by 5
- 2021Semi-weakly Supervised Contrastive Representation Learning for Retinal Fundus Imagescited by 4
- 2024Interpretable Differential Diagnosis with Dual-Inference Large Language Modelscited by 4
- 2024Enhancing Skin Disease Diagnosis: Interpretable Visual Concept Discovery with SAMcited by 4
50 most cited of 118 All 118 (JSON)
- 2026How Medical VLMs Underutilize Their Vision Encoders: A Dermatology Perspective29 Sep 2026
- 2026LENS-GRF: Permutation-Invariant Lesion Evidence Network with Gated Residual Fusion for Acne Severity Grading and Multi-Rater Clinical Oracle Analysis25 Sep 2026
- 2026Benchmarking Off-the-Shelf Multimodal AI Models Against Dermatologists on Patient-Captured Skin Images21 Sep 2026
- 2026FairGen: Preference-Aligned Diffusion for Demographically Equitable Medical Image Synthesis1 Jun 2026
- 2026Clinical Validation of the Melanoscope AI Mobile Dermoscopy Clinical Decision Support System26 May 2026
- 2026CRAFT: Clinical Reward-Aligned Finetuning for Medical Image Synthesis12 May 2026
- 2026Are Multimodal LLMs Ready for Clinical Dermatology? A Real-World Evaluation in Dermatology1 May 2026
- 2026JI-ADF: Joint-Individual Learning with Adaptive Decision Fusion for Multimodal Skin Lesion Classification30 Apr 2026
- 2026MedGemma 1.5 Technical Report6 Apr 2026
- 2026An Image Dataset of Common Skin Diseases of Bangladesh and Benchmarking Performance with Machine Learning Models26 Mar 2026
- 2026Confidence Calibration under Ambiguous Ground Truth24 Mar 2026
- 2026Towards Automated Differential Diagnosis of Skin Diseases Using Deep Learning and Imbalance-Aware Strategies1 Jan 2026
38 more
- 2025OxEnsemble: Fair Ensembles for Low-Data Classification10 Dec 2025
- 2025Multi-Aspect Knowledge-Enhanced Medical Vision-Language Pretraining with Multi-Agent Data Generation3 Dec 2025
- 2025BSFA: Leveraging the Subspace Dichotomy to Accelerate Neural Network Training29 Oct 2025
- 2025Reliability of Large Language Model Generated Clinical Reasoning in Assisted Reproductive Technology: Blinded Comparative Evaluation Study17 Oct 2025
- 2025Ensemble Deep Learning and LLM-Assisted Reporting for Automated Skin Lesion Diagnosis5 Oct 2025
- 2025eSkinHealth: A Multimodal Dataset for Neglected Tropical Skin Diseases26 Aug 2025
- 2025DermINO: Hybrid Pretraining for a Versatile Dermatology Foundation Model17 Aug 2025
- 2025Adaptive Pseudo Label Selection for Individual Unlabeled Data by Positive and Unlabeled Learning11 Aug 2025
- 2025Scaling Artificial Intelligence for Prostate Cancer Detection on MRI towards Organized Screening and Primary Diagnosis in a Global, Multiethnic Population (Study Protocol)4 Aug 2025
- 2025GRASP-PsONet: Gradient-based Removal of Spurious Patterns for PsOriasis Severity Classification27 Jun 2025
- 2025Doctor Approved: Generating Medically Accurate Skin Disease Images through AI-Expert Feedback14 Jun 2025
- 2025An Artificial Intelligence Model for Early Stage Breast Cancer Detection from Biopsy Images24 May 2025
- 2025MAKE: Multi-Aspect Knowledge-Enhanced Vision-Language Pretraining for Zero-shot Dermatological Assessment14 May 2025
- 2025UniCAD: Efficient and Extendable Architecture for Multi-Task Computer-Aided Diagnosis System14 May 2025
- 2025Derm1M: A Million-scale Vision-Language Dataset Aligned with Clinical Ontology Knowledge for Dermatology19 Mar 2025
- 2025MEDDxAgent: A Unified Modular Agent Framework for Explainable Automatic Differential Diagnosis26 Feb 2025
- 2024Health AI Developer Foundations22 Nov 2024
- 2024MpoxVLM: A Vision-Language Model for Diagnosing Skin Lesions from Mpox Virus Infection16 Nov 2024
- 2024Conformalized Credal Regions for Classification with Ambiguous Ground Truth7 Nov 2024
- 2024Evaluating the Impact of Lab Test Results on Large Language Models Generated Differential Diagnoses from Clinical Case Vignettes1 Nov 2024
- 2024Skin Cancer Machine Learning Model Tone Bias8 Oct 2024
- 2024Anisotropic Diffusion Probabilistic Model for Imbalanced Image Classification22 Sep 2024
- 2024Enhancing Skin Disease Diagnosis: Interpretable Visual Concept Discovery with SAM14 Sep 2024
- 2024Tissue Concepts: supervised foundation models in computational pathology5 Sep 2024
- 2024AI-Driven Healthcare: A Review on Ensuring Fairness and Mitigating Bias29 Jul 2024
- 2024Automated Ensemble Multimodal Machine Learning for Healthcare25 Jul 2024
- 2024Pay Less On Clinical Images: Asymmetric Multi-Modal Fusion Method For Efficient Multi-Label Skin Lesion Classification13 Jul 2024
- 2024Interpretable Differential Diagnosis with Dual-Inference Large Language Models10 Jul 2024
- 2024Continuous Sleep Depth Index Annotation with Deep Learning Yields Novel Digital Biomarkers for Sleep Health5 Jul 2024
- 2024From Majority to Minority: A Diffusion-based Augmentation for Underrepresented Groups in Skin Lesion Analysis26 Jun 2024
- 2024Machine Learning Models for Accurately Predicting Properties of CsPbCl3 Perovskite Quantum Dots20 Jun 2024
- 2024Closing the AI generalization gap by adjusting for dermatology condition distribution differences across clinical settings23 Feb 2024
- 2024Investigating the Quality of DermaMNIST and Fitzpatrick17k Dermatological Image Datasets25 Jan 2024
- 2024DDI-CoCo: A Dataset For Understanding The Effect Of Color Contrast In Machine-Assisted Skin Disease Detection24 Jan 2024
- 2024MINT: A wrapper to make multi-modal and multi-image AI models interactive22 Jan 2024
- 2023Joint-Individual Fusion Structure with Fusion Attention Module for Multi-Modal Skin Cancer Classification7 Dec 2023
- 2023Towards Accurate Differential Diagnosis with Large Language Models30 Nov 2023
- 2023Enhancing the Performance of Neural Networks Through Causal Discovery and Integration of Domain Knowledge29 Nov 2023
50 newest of 118 All 118 (JSON)
- 2025Derm1M: A Million-scale Vision-Language Dataset Aligned with Clinical Ontology Knowledge for Dermatologycited by 28
- 2025MAKE: Multi-Aspect Knowledge-Enhanced Vision-Language Pretraining for Zero-shot Dermatological Assessmentcited by 12
- 2025Multi-Aspect Knowledge-Enhanced Medical Vision-Language Pretraining with Multi-Agent Data Generationcited by 1
- 2026CRAFT: Clinical Reward-Aligned Finetuning for Medical Image Synthesiscited by 1
- 2026How Medical VLMs Underutilize Their Vision Encoders: A Dermatology Perspectivecited by 0
- 2026How Medical VLMs Underutilize Their Vision Encoders: A Dermatology Perspective29 Sep 2026
- 2026CRAFT: Clinical Reward-Aligned Finetuning for Medical Image Synthesis12 May 2026
- 2025Multi-Aspect Knowledge-Enhanced Medical Vision-Language Pretraining with Multi-Agent Data Generation3 Dec 2025
- 2025MAKE: Multi-Aspect Knowledge-Enhanced Vision-Language Pretraining for Zero-shot Dermatological Assessment14 May 2025
- 2025Derm1M: A Million-scale Vision-Language Dataset Aligned with Clinical Ontology Knowledge for Dermatology19 Mar 2025
- 2022Improving dermatology classifiers across populations using images generated by large diffusion modelscited by 25
- 2023Augmenting medical image classifiers with synthetic data from latent diffusion modelscited by 21
- 2024Anisotropic Diffusion Probabilistic Model for Imbalanced Image Classificationcited by 0
- 2024Anisotropic Diffusion Probabilistic Model for Imbalanced Image Classification22 Sep 2024
- 2023Augmenting medical image classifiers with synthetic data from latent diffusion models23 Aug 2023
- 2022Improving dermatology classifiers across populations using images generated by large diffusion models23 Nov 2022
- 2021Big Self-Supervised Models Advance Medical Image Classificationcited by 320
- 2021Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Datasetcited by 184
- 2021Disparities in Dermatology AI: Assessments Using Diverse Clinical Imagescited by 132
- 2023Towards Accurate Differential Diagnosis with Large Language Modelscited by 115
- 2021Learning Optimal Conformal Classifierscited by 108
- 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
- 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
- 2022Integrated multimodal artificial intelligence framework for healthcare applicationscited by 69
- 2021Does Your Dermatology Classifier Know What It Doesn't Know? Detecting the Long-Tail of Unseen Conditionscited by 68
- 2022Detecting Shortcut Learning for Fair Medical AI using Shortcut Testingcited by 52
- 2022Diagnosing failures of fairness transfer across distribution shift in real-world medical settingscited by 45
- 2022Long-Tailed Classification of Thorax Diseases on Chest X-Ray: A New Benchmark Studycited by 45
12 most cited of 107 All 107 (JSON)
- 2026LENS-GRF: Permutation-Invariant Lesion Evidence Network with Gated Residual Fusion for Acne Severity Grading and Multi-Rater Clinical Oracle Analysis25 Sep 2026
- 2026Benchmarking Off-the-Shelf Multimodal AI Models Against Dermatologists on Patient-Captured Skin Images21 Sep 2026
- 2026FairGen: Preference-Aligned Diffusion for Demographically Equitable Medical Image Synthesis1 Jun 2026
- 2026Clinical Validation of the Melanoscope AI Mobile Dermoscopy Clinical Decision Support System26 May 2026
- 2026Are Multimodal LLMs Ready for Clinical Dermatology? A Real-World Evaluation in Dermatology1 May 2026
- 2026JI-ADF: Joint-Individual Learning with Adaptive Decision Fusion for Multimodal Skin Lesion Classification30 Apr 2026
- 2026MedGemma 1.5 Technical Report6 Apr 2026
- 2026An Image Dataset of Common Skin Diseases of Bangladesh and Benchmarking Performance with Machine Learning Models26 Mar 2026
- 2026Confidence Calibration under Ambiguous Ground Truth24 Mar 2026
- 2026Towards Automated Differential Diagnosis of Skin Diseases Using Deep Learning and Imbalance-Aware Strategies1 Jan 2026
- 2025OxEnsemble: Fair Ensembles for Low-Data Classification10 Dec 2025
- 2025BSFA: Leveraging the Subspace Dichotomy to Accelerate Neural Network Training29 Oct 2025
12 newest of 107 All 107 (JSON)