Unsupervised Causal Prototypical Networks for De-biased Interpretable Dermoscopy Diagnosis
Not on the map. Why?
Abstract (arXiv)
Despite the success of deep learning in dermoscopy image analysis, its inherent black-box nature hinders clinical trust, motivating the use of prototypical networks for case-based visual transparency. However, inevitable selection bias in clinical data often drives these models toward shortcut learning, where environmental confounders are erroneously encoded as predictive prototypes, generating spurious visual evidence that misleads medical decision-making. To mitigate these confounding effects, we propose CausalProto, an Unsupervised Causal Prototypical Network that fundamentally purifies the visual evidence chain. Framed within a Structural Causal Model, we employ an Information Bottleneck-constrained encoder to enforce strict unsupervised orthogonal disentanglement between pathological features and environmental confounders. By mapping these decoupled representations into independent prototypical spaces, we leverage the learned spurious dictionary to perform backdoor adjustment via do-calculus, transforming complex causal interventions into efficient expectation pooling to marginalize environmental noise. Extensive experiments on multiple dermoscopy datasets demonstrate that CausalProto achieves superior diagnostic performance and consistently outperforms standard black box models, while simultaneously providing transparent and high purity visual interpretability without suffering from the traditional accuracy compromise.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
18 of 32 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2019Invariant Risk Minimizationcited by 1,854
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2016Deep Variational Information Bottleneckcited by 930
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
- 2018Disentangling by Factorisingcited by 616
- 2020CLUB: A Contrastive Log-ratio Upper Bound of Mutual Informationcited by 235
6 more
- 2019Causality matters in medical imagingcited by 193
- 2021Disparities in Dermatology AI: Assessments Using Diverse Clinical Imagescited by 134
- 2020PAD-UFES-20: a skin lesion dataset composed of patient data and clinical images collected from smartphonescited by 118
- 2021IAIA-BL: A Case-based Interpretable Deep Learning Model for Classification of Mass Lesions in Digital Mammographycited by 72
- 2025Rashomon Sets for Prototypical-Part Networks: Editing Interpretable Models in Real-Timecited by 13
- 2025Geodesic Prototype Matching via Diffusion Maps for Interpretable Fine-Grained Recognitioncited by 6
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolutioncited by 12
- 2026FACT-E: Causality-Inspired Evaluation for Trustworthy Chain-of-Thought Reasoningcited by 4
- 2026This Looks Distinctly Like That: Grounding Interpretable Recognition in Stiefel Geometry against Neural Collapsecited by 1
- 2026Displacement Preserving Relational Distillation for Robust Medical Segmentationcited by 1
- 2026Displacement Preserving Relational Distillation for Robust Medical Segmentation6 Jul 2026
- 2026MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolution29 Apr 2026
- 2026FACT-E: Causality-Inspired Evaluation for Trustworthy Chain-of-Thought Reasoning12 Apr 2026
- 2026This Looks Distinctly Like That: Grounding Interpretable Recognition in Stiefel Geometry against Neural Collapse9 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025SkinGenBench: Generative Model and Preprocessing Effects for Synthetic Dermoscopic Augmentation in Melanoma Diagnosis
- 2026DermoGPT: Open Weights and Open Data for Morphology-Grounded Dermatological Reasoning MLLMs
- 2023DermoSegDiff: A Boundary-aware Segmentation Diffusion Model for Skin Lesion Delineation
- 2025Prompting Medical Vision-Language Models to Mitigate Diagnosis Bias by Generating Realistic Dermoscopic Images
- 2026MedTokenBudget: Lesion-Preserving Token Routing for Dermoscopic Image Classification
- 2026Bridging Research and Practice: A Systematic Evaluation of Generalist and Dermatology-Specific Models in Clinical Skin Lesion Classification
- 2024A Two-Step Concept-Based Approach for Enhanced Interpretability and Trust in Skin Lesion Diagnosis
- 2026Mind the Rarities: Can Rare Skin Diseases Be Reliably Diagnosed via Diagnostic Reasoning?