mlsanityData to 14 Oct 2026

VL-MedGuide: A Visual-Linguistic Large Model for Intelligent and Explainable Skin Disease Auxiliary Diagnosis

arXiv 2508.06624 ↗First posted 8 Aug 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate diagnosis of skin diseases remains a significant challenge due to the complex and diverse visual features present in dermatoscopic images, often compounded by a lack of interpretability in existing purely visual diagnostic models. To address these limitations, this study introduces VL-MedGuide (Visual-Linguistic Medical Guide), a novel framework leveraging the powerful multi-modal understanding and reasoning capabilities of Visual-Language Large Models (LVLMs) for intelligent and inherently interpretable auxiliary diagnosis of skin conditions. VL-MedGuide operates in two interconnected stages: a Multi-modal Concept Perception Module, which identifies and linguistically describes dermatologically relevant visual features through sophisticated prompt engineering, and an Explainable Disease Reasoning Module, which integrates these concepts with raw visual information via Chain-of-Thought prompting to provide precise disease diagnoses alongside transparent rationales. Comprehensive experiments on the Derm7pt dataset demonstrate that VL-MedGuide achieves state-of-the-art performance in both disease diagnosis (83.55% BACC, 80.12% F1) and concept detection (76.10% BACC, 67.45% F1), surpassing existing baselines. Furthermore, human evaluations confirm the high clarity, completeness, and trustworthiness of its generated explanations, bridging the gap between AI performance and clinical utility by offering actionable, explainable insights for dermatological practice.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 33 references that are in the map. First posted on arXiv 8 Aug 2025.

Builds on

24 of 33 references.

References · 24

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  3. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  4. 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
  5. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
  6. 2023LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Modelscited by 217
  7. 2024Enhancing Code LLMs with Reinforcement Learning in Code Generation: A Surveycited by 83
  8. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  9. 2024Rethinking Visual Dependency in Long-Context Reasoning for Large Vision-Language Modelscited by 42
  10. 2025SCORE: Story Coherence and Retrieval Enhancement for AI Narrativescited by 42
  11. 2025MAM: Modular Multi-Agent Framework for Multi-Modal Medical Diagnosis via Role-Specialized Collaborationcited by 40
  12. 2022Towards Robust Ranker for Text Retrievalcited by 37
12 more
  1. 2022Explainable Deep Learning Methods in Medical Image Classification: A Surveycited by 32
  2. 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generationcited by 30
  3. 2022Fine-Grained Distillation for Long Document Retrievalcited by 29
  4. 2023Coherent Concept-based Explanations in Medical Image and Its Application to Skin Lesion Diagnosiscited by 26
  5. 2024Cross-Modal Consistency in Multimodal Large Language Modelscited by 19
  6. 2024Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlookscited by 18
  7. 2020Achievements and Challenges in Explaining Deep Learning based Computer-Aided Diagnosis Systemscited by 7
  8. 2023A Survey on Image-text Multimodal Modelscited by 4
  9. 2025CBVLM: Training-free Explainable Concept-based Large Vision Language Models for Medical Image Classificationcited by 4
  10. 2024Concept Complement Bottleneck Model for Interpretable Medical Image Diagnosiscited by 3
  11. 2024Guarding the Gate: ConceptGuard Battles Concept-Level Backdoors in Concept Bottleneck Modelscited by 3
  12. 2024Lesion Elevation Prediction from Skin Images Improves Diagnosiscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MM-Skin: Enhancing Dermatology Vision-Language Model with an Image-Text Dataset Derived from Textbooks
  2. 2024SkinGEN: an Explainable Dermatology Diagnosis-to-Generation Framework with Interactive Vision-Language Models
  3. 2025Skin-R1: Clinical Knowledge-Guided Dermatological Diagnosis Using Vision-Language Models
  4. 2026Mind the Rarities: Can Rare Skin Diseases Be Reliably Diagnosed via Diagnostic Reasoning?
  5. 2026How Medical VLMs Underutilize Their Vision Encoders: A Dermatology Perspective
  6. 2024SkinCaRe: A Multimodal Dermatology Dataset Annotated with Medical Caption and Chain-of-Thought Reasoning
  7. 2026DermaBench: A Clinician-Annotated Benchmark Dataset for Dermatology Visual Question Answering and Reasoning
  8. 2025GRPO++: Enhancing Dermatological Reasoning under Low Resource Settings