mlsanityData to 7 Oct 2026

Improving Fairness of AI Systems with Lossless De-biasing

arXiv 2105.04534 ↗First posted 10 May 2021cs.LG cs.AI cs.CYcited by 4

Not on the map. Why?

Abstract (arXiv)

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented groups. Mitigating bias in AI systems to increase overall fairness has emerged as an important challenge. Existing studies on mitigating bias in AI systems focus on eliminating sensitive demographic information embedded in data. Given the temporal and contextual complexity of conceptualizing fairness, lossy treatment of demographic information may contribute to an unnecessary trade-off between accuracy and fairness, especially when demographic attributes and class labels are correlated. In this paper, we present an information-lossless de-biasing technique that targets the scarcity of data in the disadvantaged group. Unlike the existing work, we demonstrate, both theoretically and empirically, that oversampling underrepresented groups can not only mitigate algorithmic bias in AI systems that consistently predict a favorable outcome for a certain group, but improve overall accuracy by mitigating class imbalance within data that leads to a bias towards the majority class. We demonstrate the effectiveness of our technique on real datasets using a variety of fairness metrics.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 10 May 2021.

Builds on

12 of 33 references.

References · 12

  1. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  2. 2014Certifying and removing disparate impactcited by 715
  3. 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
  4. 2017On Fairness and Calibrationcited by 406
  5. 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
  6. 2018Learning Adversarially Fair and Transferable Representationscited by 353
  7. 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
  8. 2018Multiaccuracy: Black-Box Post-Processing for Fairness in Classificationcited by 221
  9. 2015Censoring Representations with an Adversarycited by 191
  10. 2018Classification with Fairness Constraints: A Meta-Algorithm with Provable Guaranteescited by 146
  11. 2018An Intersectional Definition of Fairnesscited by 126
  12. 2018An Empirical Study of Rich Subgroup Fairness for Machine Learningcited by 81

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 1.

4 papers.