Explaining Algorithmic Fairness Through Fairness-Aware Causal Path Decomposition
Not on the map. Why?
Abstract (arXiv)
Algorithmic fairness has aroused considerable interests in data mining and machine learning communities recently. So far the existing research has been mostly focusing on the development of quantitative metrics to measure algorithm disparities across different protected groups, and approaches for adjusting the algorithm output to reduce such disparities. In this paper, we propose to study the problem of identification of the source of model disparities. Unlike existing interpretation methods which typically learn feature importance, we consider the causal relationships among feature variables and propose a novel framework to decompose the disparity into the sum of contributions from fairness-aware causal paths, which are paths linking the sensitive attribute and the final predictions, on the graph. We also consider the scenario when the directions on certain edges within those paths cannot be determined. Our framework is also model agnostic and applicable to a variety of quantitative disparity measures. Empirical evaluations on both synthetic and real-world data sets are provided to show that our method can provide precise and comprehensive explanations to the model disparities.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 19 of its 37 references that are in the map. First posted on arXiv 11 Aug 2021.
Builds on
19 of 37 references.
References · 19
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2017Counterfactual Fairnesscited by 802
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2018A Reductions Approach to Fair Classificationcited by 585
- 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 368
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2019Explaining individual predictions when features are dependent: More accurate approximations to Shapley valuescited by 205
- 2017Avoiding Discrimination through Causal Reasoningcited by 191
- 2018Path-Specific Counterfactual Fairnesscited by 179
- 2017Fair Inference On Outcomescited by 143
7 more
- 2019Asymmetric Shapley values: incorporating causal knowledge into model-agnostic explainabilitycited by 114
- 2020Causal Shapley Values: Exploiting Causal Knowledge to Explain Individual Predictions of Complex Modelscited by 107
- 2018Learning Controllable Fair Representationscited by 83
- 2019PC-Fairness: A Unified Framework for Measuring Causality-based Fairnesscited by 67
- 2020Shapley Flow: A Graph-based Approach to Interpreting Model Predictionscited by 51
- 2020Explainability for fair machine learningcited by 33
- 2019Fairness criteria through the lens of directed acyclic graphical modelscited by 6
Built on by
Citing papers per year: 2021: 3; 2022: 5; 2023: 4; 2024: 3; 2025: 1; 2026: 1.
17 papers.
Sort:
- 2021Addressing Algorithmic Disparity and Performance Inconsistency in Federated Learningcited by 50
- 2022Fairness and Explainability: Bridging the Gap Towards Fair Model Explanationscited by 22
- 2021Algorithm Fairness in AI for Medicine and Healthcarecited by 21
- 2023A Critical Survey on Fairness Benefits of Explainable AIcited by 16
- 2021Collaboration Equilibrium in Federated Learningcited by 15
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systemscited by 14
- 2022Input-agnostic Certified Group Fairness via Gaussian Parameter Smoothingcited by 11
- 2022How Biased are Your Features?: Computing Fairness Influence Functions with Global Sensitivity Analysiscited by 7
- 2022What Is Fairness? On the Role of Protected Attributes and Fictitious Worldscited by 6
- 2024Procedural Fairness in Machine Learningcited by 4
- 2024On Explaining Unfairness: An Overviewcited by 3
- 2022Quantifying Feature Contributions to Overall Disparity Using Information Theorycited by 2
5 more
- 2023PWSHAP: A Path-Wise Explanation Model for Targeted Variablescited by 2
- 2023Detecting algorithmic bias in medical-AI models using treescited by 1
- 2024How Video Meetings Change Your Expressioncited by 1
- 2025Detecting clinician implicit biases in diagnoses using proximal causal inferencecited by 1
- 2026Shapley-Value-Based Feature Attribution for Data Maskingcited by 0
- 2026Shapley-Value-Based Feature Attribution for Data Masking31 Jul 2026
- 2025Detecting clinician implicit biases in diagnoses using proximal causal inference27 Jan 2025
- 2024How Video Meetings Change Your Expression3 Jun 2024
- 2024Procedural Fairness in Machine Learning2 Apr 2024
- 2024On Explaining Unfairness: An Overview16 Feb 2024
- 2023Detecting algorithmic bias in medical-AI models using trees5 Dec 2023
- 2023A Critical Survey on Fairness Benefits of Explainable AI15 Oct 2023
- 2023PWSHAP: A Path-Wise Explanation Model for Targeted Variables26 Jun 2023
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systems14 Feb 2023
- 2022Fairness and Explainability: Bridging the Gap Towards Fair Model Explanations7 Dec 2022
- 2022Input-agnostic Certified Group Fairness via Gaussian Parameter Smoothing22 Jun 2022
- 2022Quantifying Feature Contributions to Overall Disparity Using Information Theory16 Jun 2022
5 more
- 2022How Biased are Your Features?: Computing Fairness Influence Functions with Global Sensitivity Analysis1 Jun 2022
- 2022What Is Fairness? On the Role of Protected Attributes and Fictitious Worlds19 May 2022
- 2021Algorithm Fairness in AI for Medicine and Healthcare1 Oct 2021
- 2021Addressing Algorithmic Disparity and Performance Inconsistency in Federated Learning19 Aug 2021
- 2021Collaboration Equilibrium in Federated Learning18 Aug 2021
- 2021Addressing Algorithmic Disparity and Performance Inconsistency in Federated Learningcited by 50
- 2022Fairness and Explainability: Bridging the Gap Towards Fair Model Explanationscited by 22
- 2021Algorithm Fairness in AI for Medicine and Healthcarecited by 21
- 2023A Critical Survey on Fairness Benefits of Explainable AIcited by 16
- 2021Collaboration Equilibrium in Federated Learningcited by 15
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systemscited by 14
- 2022Input-agnostic Certified Group Fairness via Gaussian Parameter Smoothingcited by 11
- 2022How Biased are Your Features?: Computing Fairness Influence Functions with Global Sensitivity Analysiscited by 7
- 2022What Is Fairness? On the Role of Protected Attributes and Fictitious Worldscited by 6
- 2024Procedural Fairness in Machine Learningcited by 4
- 2024On Explaining Unfairness: An Overviewcited by 3
- 2022Quantifying Feature Contributions to Overall Disparity Using Information Theorycited by 2
12 most cited of 17 All 17 (JSON)
- 2026Shapley-Value-Based Feature Attribution for Data Masking31 Jul 2026
- 2025Detecting clinician implicit biases in diagnoses using proximal causal inference27 Jan 2025
- 2024How Video Meetings Change Your Expression3 Jun 2024
- 2024Procedural Fairness in Machine Learning2 Apr 2024
- 2024On Explaining Unfairness: An Overview16 Feb 2024
- 2023Detecting algorithmic bias in medical-AI models using trees5 Dec 2023
- 2023A Critical Survey on Fairness Benefits of Explainable AI15 Oct 2023
- 2023PWSHAP: A Path-Wise Explanation Model for Targeted Variables26 Jun 2023
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systems14 Feb 2023
- 2022Fairness and Explainability: Bridging the Gap Towards Fair Model Explanations7 Dec 2022
- 2022Input-agnostic Certified Group Fairness via Gaussian Parameter Smoothing22 Jun 2022
- 2022Quantifying Feature Contributions to Overall Disparity Using Information Theory16 Jun 2022
12 newest of 17 All 17 (JSON)