Biased Models Have Biased Explanations
Not on the map. Why?
Abstract (arXiv)
We study fairness in Machine Learning (FairML) through the lens of attribute-based explanations generated for machine learning models. Our hypothesis is: Biased Models have Biased Explanations. To establish that, we first translate existing statistical notions of group fairness and define these notions in terms of explanations given by the model. Then, we propose a novel way of detecting (un)fairness for any black box model. We further look at post-processing techniques for fairness and reason how explanations can be used to make a bias mitigation technique more individually fair. We also introduce a novel post-processing mitigation technique which increases individual fairness in recourse while maintaining group level fairness.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 1; 2025: 4.
9 papers.
- 2022Impossibility Theorems for Feature Attributioncited by 78
- 2021RKHS-SHAP: Shapley Values for Kernel Methodscited by 30
- 2023A Critical Survey on Fairness Benefits of Explainable AIcited by 16
- 2024Bt-GAN: Generating Fair Synthetic Healthdata via Bias-transforming Generative Adversarial Networkscited by 4
- 2025Beyond Predictions: A Participatory Framework for Multi-Stakeholder Decision-Makingcited by 2
- 2025Explanations as Bias Detectors: A Critical Study of Local Post-hoc XAI Methods for Fairness Explorationcited by 2
- 2022Achieving Transparency in Distributed Machine Learning with Explainable Data Collaborationcited by 0
- 2025EVolutionary Independent DEtermiNistiC Explanationcited by 0
- 2025MUPAX: Multidimensional Problem Agnostic eXplainable AIcited by 0
- 2025MUPAX: Multidimensional Problem Agnostic eXplainable AI17 Jul 2025
- 2025Explanations as Bias Detectors: A Critical Study of Local Post-hoc XAI Methods for Fairness Exploration1 May 2025
- 2025Beyond Predictions: A Participatory Framework for Multi-Stakeholder Decision-Making12 Feb 2025
- 2025EVolutionary Independent DEtermiNistiC Explanation20 Jan 2025
- 2024Bt-GAN: Generating Fair Synthetic Healthdata via Bias-transforming Generative Adversarial Networks21 Apr 2024
- 2023A Critical Survey on Fairness Benefits of Explainable AI15 Oct 2023
- 2022Impossibility Theorems for Feature Attribution22 Dec 2022
- 2022Achieving Transparency in Distributed Machine Learning with Explainable Data Collaboration6 Dec 2022
- 2021RKHS-SHAP: Shapley Values for Kernel Methods18 Oct 2021