Biasing & Debiasing based Approach Towards Fair Knowledge Transfer for Equitable Skin Analysis
Not on the map. Why?
Abstract (arXiv)
Deep learning models, particularly Convolutional Neural Networks (CNNs), have demonstrated exceptional performance in diagnosing skin diseases, often outperforming dermatologists. However, they have also unveiled biases linked to specific demographic traits, notably concerning diverse skin tones or gender, prompting concerns regarding fairness and limiting their widespread deployment. Researchers are actively working to ensure fairness in AI-based solutions, but existing methods incur an accuracy loss when striving for fairness. To solve this issue, we propose a `two-biased teachers' (i.e., biased on different sensitive attributes) based approach to transfer fair knowledge into the student network. Our approach mitigates biases present in the student network without harming its predictive accuracy. In fact, in most cases, our approach improves the accuracy of the baseline model. To achieve this goal, we developed a weighted loss function comprising biasing and debiasing loss terms. We surpassed available state-of-the-art approaches to attain fairness and also improved the accuracy at the same time. The proposed approach has been evaluated and validated on two dermatology datasets using standard accuracy and fairness evaluation measures. We will make source code publicly available to foster reproducibility and future research.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 34 references that are in the map. First posted on arXiv 16 May 2024.
Builds on
24 of 34 references.
References · 24
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
- 2018Learning Not to Learn: Training Deep Neural Networks with Biased Datacited by 255
- 2019Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigationcited by 252
- 2021Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Datasetcited by 185
- 2018Adversarial Removal of Demographic Attributes from Text Datacited by 170
- 2019Fairness in Deep Learning: A Computational Perspectivecited by 123
- 2018Turning a Blind Eye: Explicit Removal of Biases and Variation from Deep Neural Network Embeddingscited by 114
- 2023Finetuning Text-to-Image Diffusion Models for Fairnesscited by 92
- 2020Investigating Bias and Fairness in Facial Expression Recognitioncited by 87
12 more
- 2021Fairness via Representation Neutralizationcited by 63
- 2021Fair Feature Distillation for Visual Recognitioncited by 59
- 2022FairPrune: Achieving Fairness Through Pruning for Dermatological Disease Diagnosiscited by 59
- 2022Bias Mimicking: A Simple Sampling Approach for Bias Mitigationcited by 30
- 2022Feature robustness and sex differences in medical imaging: a case study in MRI-based Alzheimer's disease detectioncited by 19
- 2023FairAdaBN: Mitigating unfairness with adaptive batch normalization and its application to dermatological disease classificationcited by 19
- 2019Bias Remediation in Driver Drowsiness Detection systems using Generative Adversarial Networkscited by 14
- 2023RELIANT: Fair Knowledge Distillation for Graph Neural Networkscited by 10
- 2022Representative Image Feature Extraction via Contrastive Learning Pretraining for Chest X-ray Report Generationcited by 8
- 2021Evaluating subgroup disparity using epistemic uncertainty in mammographycited by 6
- 2021Distill and De-bias: Mitigating Bias in Face Verification using Knowledge Distillationcited by 6
- 2023Dual-Teacher De-biasing Distillation Framework for Multi-domain Fake News Detectioncited by 2
Built on by
Citing papers per year: 2025: 2.
2 papers.