Privileged Lesion-Context Relational Distillation for Mask-Free Skin Lesion Classification
Not on the map. Why?
Abstract (arXiv)
Accurate skin lesion classification can benefit from lesion segmentation masks, but requiring masks or an auxiliary segmentation model during inference reduces clinical practicality and increases computational complexity. This work introduces Privileged Lesion-Context Relational Distillation (PLCRD), a teacher-student framework that exploits lesion masks exclusively during training while preserving image-only inference. The privileged teacher jointly analyzes the original dermoscopic image and its mask-guided lesion region to learn lesion-specific and contextual diagnostic representations. An image-only student is then trained through complementary knowledge-transfer mechanisms that convey the teacher's diagnostic distribution, lesion-focused attention, inter-lesion relational geometry, and lesion-context structure. PLCRD decomposes deep representations into lesion and contextual embeddings and transfers their relational organization through inter-lesion similarity alignment, lesion-context affinity matching, separation regularization, and class-aware relational learning. This formulation avoids direct feature matching between heterogeneous teacher and student architectures and enables the student to internalize mask-informed diagnostic structure without accessing masks at deployment. The framework was evaluated on HAM10000 using lesion-disjoint data partitioning and externally validated on ISIC 2018 without retraining. PLCRD achieved a lesion-level macro-F1 of 0.773 +/- 0.018, balanced accuracy of 0.764 +/- 0.023, and macro-AUROC of 0.976 +/- 0.002 on HAM10000, together with a macro-F1 of 0.732 +/- 0.008 on ISIC 2018. The results indicate that privileged lesion annotations can be transformed into transferable relational knowledge, yielding a practical and interpretable approach to mask-free skin lesion classification.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
16 of 25 references.
References · 16
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2019Searching for MobileNetV3cited by 1,994
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,077
- 2019Relational Knowledge Distillationcited by 889
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2016Skin Lesion Analysis toward Melanoma Detection: A Challenge at the International Symposium on Biomedical Imaging (ISBI) 2016, hosted by the International Skin Imaging Collaboration (ISIC)cited by 198
- 2022Rethinking Vision Transformers for MobileNet Size and Speedcited by 121
- 2017Skin Lesion Classification Using Hybrid Deep Neural Networkscited by 14
4 more
- 2020The Effects of Skin Lesion Segmentation on the Performance of Dermatoscopic Image Classificationcited by 14
- 2017A Novel Multi-task Deep Learning Model for Skin Lesion Segmentation and Classificationcited by 13
- 2016Segmentation and Classification of Skin Lesions for Disease Diagnosiscited by 1
- 2018A Multi-Level Deep Ensemble Model for Skin Lesion Classification in Dermoscopy Imagescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Masked Privileged-Information Distillation for Multimodal Skin Lesion Classification Under Missing Clinical Metadata
- 2022SSD-KD: A Self-supervised Diverse Knowledge Distillation Method for Lightweight Skin Lesion Classification Using Dermoscopic Images
- 2026DerMAE: Improving skin lesion classification through conditioned latent diffusion and MAE distillation
- 2026MedTokenBudget: Lesion-Preserving Token Routing for Dermoscopic Image Classification
- 2025Semi-Supervised Learning with Online Knowledge Distillation for Skin Lesion Classification
- 2025MedGrad E-CLIP: Enhancing Trust and Transparency in AI-Driven Skin Lesion Diagnosis
- 2024A Two-Step Concept-Based Approach for Enhanced Interpretability and Trust in Skin Lesion Diagnosis
- 2023Towards Concept-based Interpretability of Skin Lesion Diagnosis using Vision-Language Models