A causal framework for discovering and removing direct and indirect discrimination
Not on the map. Why?
Abstract (arXiv)
Anti-discrimination is an increasingly important task in data science. In this paper, we investigate the problem of discovering both direct and indirect discrimination from the historical data, and removing the discriminatory effects before the data is used for predictive analysis (e.g., building classifiers). We make use of the causal network to capture the causal structure of the data. Then we model direct and indirect discrimination as the path-specific effects, which explicitly distinguish the two types of discrimination as the causal effects transmitted along different paths in the network. Based on that, we propose an effective algorithm for discovering direct and indirect discrimination, as well as an algorithm for precisely removing both types of discrimination while retaining good data utility. Different from previous works, our approaches can ensure that the predictive models built from the modified data will not incur discrimination in decision making. Experiments using real datasets show the effectiveness of our approaches.
Key facts. Cited by 71 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 21; 2023: 9; 2024: 14; 2025: 7; 2026: 3.
71 papers.
Sort:
By area:
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2021DECAF: Generating Fair Synthetic Data Using Causally-Aware Generative Networkscited by 109
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021Bias in Machine Learning Software: Why? How? What to do?cited by 92
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2022Synthetic Data -- what, why and how?cited by 66
- 2024Navigating the Risks: A Survey of Security, Privacy, and Ethics Threats in LLM-Based Agentscited by 63
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
- 2021Agent Incentives: A Causal Perspectivecited by 51
- 2022Causal Conceptions of Fairness and their Consequencescited by 38
- 2022Marrying Fairness and Explainability in Supervised Learningcited by 23
- 2024Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumventioncited by 21
38 more
- 2022Counterfactual Fairness with Partially Known Causal Graphcited by 20
- 2021FairMask: Better Fairness via Model-based Rebalancing of Protected Attributescited by 19
- 2022Achieving Long-Term Fairness in Sequential Decision Makingcited by 18
- 2022What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspectivecited by 18
- 2022D-BIAS: A Causality-Based Human-in-the-Loop System for Tackling Algorithmic Biascited by 18
- 2023Causal Inference with Conditional Front-Door Adjustment and Identifiable Variational Autoencodercited by 17
- 2022Causal Discovery for Fairnesscited by 16
- 2021Achieving Counterfactual Fairness for Causal Banditcited by 15
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systemscited by 14
- 2021Through the Data Management Lens: Experimental Analysis and Evaluation of Fair Classificationcited by 13
- 2022Demographic-Reliant Algorithmic Fairness: Characterizing the Risks of Demographic Data Collection in the Pursuit of Fairnesscited by 13
- 2021From Learning to Relearning: A Framework for Diminishing Bias in Social Robot Navigationcited by 11
- 2021Fairness-Aware Unsupervised Feature Selectioncited by 10
- 2021Attributing Fair Decisions with Attention Interventionscited by 10
- 2021Equality of opportunity in travel behavior prediction with deep neural networks and discrete choice modelscited by 10
- 2022Why Fair Labels Can Yield Unfair Predictions: Graphical Conditions for Introduced Unfairnesscited by 10
- 2022Attainability and Optimality: The Equalized Odds Fairness Revisitedcited by 10
- 2023Causal Fairness under Unobserved Confounding: A Neural Sensitivity Frameworkcited by 10
- 2024AIM: Attributing, Interpreting, Mitigating Data Unfairnesscited by 9
- 2022Disentangled Representation with Causal Constraints for Counterfactual Fairnesscited by 7
- 2023Tier Balancing: Towards Dynamic Fairness over Underlying Causal Factorscited by 7
- 2024Fairness Evaluation with Item Response Theorycited by 7
- 2021End-To-End Bias Mitigation: Removing Gender Bias in Deep Learningcited by 6
- 2022On Learning and Testing of Counterfactual Fairness through Data Preprocessingcited by 6
- 2024Interventional Fairness on Partially Known Causal Graphs: A Constrained Optimization Approachcited by 6
- 2024Local Causal Discovery for Structural Evidence of Direct Discriminationcited by 6
- 2022Social Bias Meets Data Bias: The Impacts of Labeling and Measurement Errors on Fairness Criteriacited by 5
- 2024What is Fair? Defining Fairness in Machine Learning for Healthcited by 5
- 2021Fair-SSL: Building fair ML Software with less datacited by 4
- 2021Contrastive Mixture of Posteriors for Counterfactual Inference, Data Integration and Fairnesscited by 3
- 2022The Fairness Field Guide: Perspectives from Social and Formal Sciencescited by 3
- 2022Causal Fairness Assessment of Treatment Allocation with Electronic Health Recordscited by 3
- 2023Procedural Fairness Through Decoupling Objectionable Data Generating Componentscited by 3
- 2024What Hides behind Unfairness? Exploring Dynamics Fairness in Reinforcement Learningcited by 3
- 2022Distraction is All You Need for Fairnesscited by 2
- 2022SCALES: From Fairness Principles to Constrained Decision-Makingcited by 2
- 2023Designing Equitable Algorithmscited by 2
- 2024Formalising Anti-Discrimination Law in Automated Decision Systemscited by 2
50 most cited of 71 All 71 (JSON)
- 2026Path-specific harm decomposition: A partial identification framework24 Sep 2026
- 2026Portable Causal Fairness Across Synthetic Data Generator Families2 Sep 2026
- 2026Tuning Derivatives for Causal Fairness in Machine Learning7 May 2026
- 2025FairAgent: Democratizing Fairness-Aware Machine Learning with LLM-Powered Agents5 Oct 2025
- 2025Partial Identification Approach to Counterfactual Fairness Assessment30 Sep 2025
- 2025Position: Beyond Sensitive Attributes, ML Fairness Should Quantify Structural Injustice via Social Determinants10 Aug 2025
- 2025A Causal Lens for Learning Long-term Fair Policies12 Jun 2025
- 2025Causally Fair Node Classification on Non-IID Graph Data3 May 2025
- 2025Revisiting the Berkeley Admissions data: Statistical Tests for Causal Hypotheses14 Feb 2025
- 2025Detecting clinician implicit biases in diagnoses using proximal causal inference27 Jan 2025
- 2024Navigating the Risks: A Survey of Security, Privacy, and Ethics Threats in LLM-Based Agents14 Nov 2024
- 2024Fairness Evaluation with Item Response Theory20 Oct 2024
38 more
- 2024Causal Effect Estimation using identifiable Variational AutoEncoder with Latent Confounders and Post-Treatment Variables13 Aug 2024
- 2024Fair Risk Minimization under Causal Path-Specific Effect Constraints3 Aug 2024
- 2024Practical Guide for Causal Pathways and Sub-group Disparity Analysis2 Jul 2024
- 2024Formalising Anti-Discrimination Law in Automated Decision Systems29 Jun 2024
- 2024What is Fair? Defining Fairness in Machine Learning for Health13 Jun 2024
- 2024AIM: Attributing, Interpreting, Mitigating Data Unfairness13 Jun 2024
- 2024IncomeSCM: From tabular data set to time-series simulator and causal estimation benchmark25 May 2024
- 2024Local Causal Discovery for Structural Evidence of Direct Discrimination23 May 2024
- 2024Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumvention3 May 2024
- 2024What Hides behind Unfairness? Exploring Dynamics Fairness in Reinforcement Learning16 Apr 2024
- 2024Long-Term Fair Decision Making through Deep Generative Models20 Jan 2024
- 2024Interventional Fairness on Partially Known Causal Graphs: A Constrained Optimization Approach19 Jan 2024
- 2023Causal Fairness under Unobserved Confounding: A Neural Sensitivity Framework30 Nov 2023
- 2023Causal Fairness-Guided Dataset Reweighting using Neural Networks17 Nov 2023
- 2023Procedural Fairness Through Decoupling Objectionable Data Generating Components5 Nov 2023
- 2023Causal Inference with Conditional Front-Door Adjustment and Identifiable Variational Autoencoder3 Oct 2023
- 2023Measuring, Interpreting, and Improving Fairness of Algorithms using Causal Inference and Randomized Experiments4 Sep 2023
- 2023DBFed: Debiasing Federated Learning Framework based on Domain-Independent10 Jul 2023
- 2023Designing Equitable Algorithms17 Feb 2023
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systems14 Feb 2023
- 2023Tier Balancing: Towards Dynamic Fairness over Underlying Causal Factors21 Jan 2023
- 2022Equality of Effort via Algorithmic Recourse21 Nov 2022
- 2022Causal Fairness Assessment of Treatment Allocation with Electronic Health Records21 Nov 2022
- 2022SCALES: From Fairness Principles to Constrained Decision-Making22 Sep 2022
- 2022Disentangled Representation with Causal Constraints for Counterfactual Fairness19 Aug 2022
- 2022D-BIAS: A Causality-Based Human-in-the-Loop System for Tackling Algorithmic Bias10 Aug 2022
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey14 Jul 2022
- 2022Causal Conceptions of Fairness and their Consequences12 Jul 2022
- 2022Causal Discovery for Fairness14 Jun 2022
- 2022What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspective8 Jun 2022
- 2022Social Bias Meets Data Bias: The Impacts of Labeling and Measurement Errors on Fairness Criteria31 May 2022
- 2022Counterfactual Fairness with Partially Known Causal Graph27 May 2022
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trends16 May 2022
- 2022Synthetic Data -- what, why and how?6 May 2022
- 2022Demographic-Reliant Algorithmic Fairness: Characterizing the Risks of Demographic Data Collection in the Pursuit of Fairness18 Apr 2022
- 2022Marrying Fairness and Explainability in Supervised Learning6 Apr 2022
- 2022Achieving Long-Term Fairness in Sequential Decision Making4 Apr 2022
- 2022Distraction is All You Need for Fairness15 Mar 2022
50 newest of 71 All 71 (JSON)
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2021DECAF: Generating Fair Synthetic Data Using Causally-Aware Generative Networkscited by 109
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021Bias in Machine Learning Software: Why? How? What to do?cited by 92
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2022Synthetic Data -- what, why and how?cited by 66
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
- 2021Agent Incentives: A Causal Perspectivecited by 51
- 2022Causal Conceptions of Fairness and their Consequencescited by 38
- 2022Marrying Fairness and Explainability in Supervised Learningcited by 23
- 2024Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumventioncited by 21
- 2022Counterfactual Fairness with Partially Known Causal Graphcited by 20
12 most cited of 69 All 69 (JSON)
- 2026Path-specific harm decomposition: A partial identification framework24 Sep 2026
- 2026Portable Causal Fairness Across Synthetic Data Generator Families2 Sep 2026
- 2026Tuning Derivatives for Causal Fairness in Machine Learning7 May 2026
- 2025Partial Identification Approach to Counterfactual Fairness Assessment30 Sep 2025
- 2025Position: Beyond Sensitive Attributes, ML Fairness Should Quantify Structural Injustice via Social Determinants10 Aug 2025
- 2025A Causal Lens for Learning Long-term Fair Policies12 Jun 2025
- 2025Causally Fair Node Classification on Non-IID Graph Data3 May 2025
- 2025Revisiting the Berkeley Admissions data: Statistical Tests for Causal Hypotheses14 Feb 2025
- 2025Detecting clinician implicit biases in diagnoses using proximal causal inference27 Jan 2025
- 2024Fairness Evaluation with Item Response Theory20 Oct 2024
- 2024Causal Effect Estimation using identifiable Variational AutoEncoder with Latent Confounders and Post-Treatment Variables13 Aug 2024
- 2024Fair Risk Minimization under Causal Path-Specific Effect Constraints3 Aug 2024
12 newest of 69 All 69 (JSON)