Skin-R1: Clinical Knowledge-Guided Dermatological Diagnosis Using Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Medical vision-language models
Abstract (arXiv)
Vision--language models (VLMs) have recently shown promise for assisting clinical reasoning in dermatological diagnosis. However, their trustworthiness and clinical utility remain limited by three key challenges: heterogeneous datasets with inconsistent diagnostic labels and concept annotations, the lack of grounded diagnostic rationales for reliable reasoning supervision, and limited scalability when transferring knowledge from small, densely annotated datasets to large collections with sparse labels. To address these challenges, we propose Skin-R1, a dermatology-oriented VLM that integrates textbook-grounded clinical reasoning supervision with reinforcement learning (RL) to improve the accuracy and robustness of diagnostic prediction. First, we construct a textbook-based reasoning generator that synthesizes hierarchy-aware and differential-diagnosis (DDx) diagnostic trajectories derived from authoritative dermatology knowledge. Second, these trajectories are used for supervised fine-tuning (SFT), establishing a clinically grounded reasoning foundation for the model. Finally, we introduce an RL training framework that incorporates the hierarchical structure of dermatological diseases into the reward design, enabling the model to generalize grounded diagnostic reasoning to large-scale datasets with sparse annotations. Extensive experiments across multiple dermatology benchmarks demonstrate that Skin-R1 consistently improves diagnostic accuracy and robustness compared to state-of-the-art Med-VLM baselines. Ablation studies further highlight the critical role of grounded reasoning supervision introduced during the SFT stage.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 73 references that are in the map. First posted on arXiv 18 Nov 2025.
Builds on
28 of 73 references.
Closest ancestors · 8
Same direction, newest first
- 2025RARL: Improving Medical VLM Reasoning and Generalization with Reinforcement Learning and LoRA under Data and Hardware Constraints7 Jun
- 2025Toward Effective Reinforcement Learning Fine-Tuning for Medical VQA in Vision-Language Models20 May
- 2025MAKE: Multi-Aspect Knowledge-Enhanced Vision-Language Pretraining for Zero-shot Dermatological Assessment14 May
- 2025OmniV-Med: Scaling Medical Vision-Language Model for Universal Visual Understanding20 Apr
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models18 Mar
- 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptation14 Feb
- 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale27 Jun
- 2023XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models13 Jun
Other references · 20
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
- 2025MedGemma Technical Reportcited by 436
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
8 more
- 2025Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement Learningcited by 262
- 2019BCN20000: Dermoscopic Lesions in the Wildcited by 225
- 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 124
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 116
- 2025Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzlescited by 56
- 2025Beyond 'Aha!': Toward Systematic Meta-Abilities Alignment in Large Reasoning Modelscited by 18
- 2025Improving Medical Reasoning with Curriculum-Aware Reinforcement Learningcited by 16
- 2025A Comprehensive Survey of Electronic Health Record Modeling: From Deep Learning Approaches to Large Language Modelscited by 8
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026DermoGPT: Open Weights and Open Data for Morphology-Grounded Dermatological Reasoning MLLMscited by 3
- 2026Regulating Anatomy-Aware Rewards via Trajectory-Integral Feedback for Volumetric Computed Tomography Analysiscited by 2
- 2026Are Multimodal LLMs Ready for Clinical Dermatology? A Real-World Evaluation in Dermatologycited by 1
- 2026Reasoning4Sciences: Bridging Reasoning Language Models to All Scientific Branchescited by 0
- 2026Reasoning4Sciences: Bridging Reasoning Language Models to All Scientific Branches31 May 2026
- 2026Regulating Anatomy-Aware Rewards via Trajectory-Integral Feedback for Volumetric Computed Tomography Analysis19 May 2026
- 2026Are Multimodal LLMs Ready for Clinical Dermatology? A Real-World Evaluation in Dermatology1 May 2026
- 2026DermoGPT: Open Weights and Open Data for Morphology-Grounded Dermatological Reasoning MLLMs5 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Trustworthy and Fair SkinGPT-R1 for Democratizing Dermatological Reasoning across Diverse Ethnicities
- 2026Mind the Rarities: Can Rare Skin Diseases Be Reliably Diagnosed via Diagnostic Reasoning?
- 2025GRPO++: Enhancing Dermatological Reasoning under Low Resource Settings
- 2024SkinGEN: an Explainable Dermatology Diagnosis-to-Generation Framework with Interactive Vision-Language Models
- 2025VL-MedGuide: A Visual-Linguistic Large Model for Intelligent and Explainable Skin Disease Auxiliary Diagnosis
- 2024A Two-Step Concept-Based Approach for Enhanced Interpretability and Trust in Skin Lesion Diagnosis
- 2026SkinFlow: Efficient Information Transmission for Open Dermatological Diagnosis via Dynamic Visual Encoding and Staged RL
- 2026SkinGPT-X: A Self-Evolving Collaborative Multi-Agent System for Transparent and Trustworthy Dermatological Diagnosis