Improving Fairness of AI Systems with Lossless De-biasing
Not on the map. Why?
Abstract (arXiv)
In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented groups. Mitigating bias in AI systems to increase overall fairness has emerged as an important challenge. Existing studies on mitigating bias in AI systems focus on eliminating sensitive demographic information embedded in data. Given the temporal and contextual complexity of conceptualizing fairness, lossy treatment of demographic information may contribute to an unnecessary trade-off between accuracy and fairness, especially when demographic attributes and class labels are correlated. In this paper, we present an information-lossless de-biasing technique that targets the scarcity of data in the disadvantaged group. Unlike the existing work, we demonstrate, both theoretically and empirically, that oversampling underrepresented groups can not only mitigate algorithmic bias in AI systems that consistently predict a favorable outcome for a certain group, but improve overall accuracy by mitigating class imbalance within data that leads to a bias towards the majority class. We demonstrate the effectiveness of our technique on real datasets using a variety of fairness metrics.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 10 May 2021.
Builds on
12 of 33 references.
References · 12
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2014Certifying and removing disparate impactcited by 715
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2017On Fairness and Calibrationcited by 406
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
- 2018Multiaccuracy: Black-Box Post-Processing for Fairness in Classificationcited by 221
- 2015Censoring Representations with an Adversarycited by 191
- 2018Classification with Fairness Constraints: A Meta-Algorithm with Provable Guaranteescited by 146
- 2018An Intersectional Definition of Fairnesscited by 126
- 2018An Empirical Study of Rich Subgroup Fairness for Machine Learningcited by 81
Built on by
Citing papers per year: 2022: 3; 2023: 1.
4 papers.
- 2022A Sandbox Tool to Bias(Stress)-Test Fairness Algorithmscited by 12
- 2022Algorithmic decision making methods for fair credit scoringcited by 5
- 2022Fair mappingcited by 0
- 2023Survey of Trustworthy AI: A Meta Decision of AIcited by 0
- 2023Survey of Trustworthy AI: A Meta Decision of AI1 Jun 2023
- 2022Algorithmic decision making methods for fair credit scoring16 Sep 2022
- 2022Fair mapping1 Sep 2022
- 2022A Sandbox Tool to Bias(Stress)-Test Fairness Algorithms21 Apr 2022