A Reduction to Binary Approach for Debiasing Multiclass Datasets
Not on the map. Why?
Abstract (arXiv)
We propose a novel reduction-to-binary (R2B) approach that enforces demographic parity for multiclass classification with non-binary sensitive attributes via a reduction to a sequence of binary debiasing tasks. We prove that R2B satisfies optimality and bias guarantees and demonstrate empirically that it can lead to an improvement over two baselines: (1) treating multiclass problems as multi-label by debiasing labels independently and (2) transforming the features instead of the labels. Surprisingly, we also demonstrate that independent label debiasing yields competitive results in most (but not all) settings. We validate these conclusions on synthetic and real-world datasets from social science, computer vision, and healthcare.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 34 of its 73 references that are in the map. First posted on arXiv 31 May 2022.
Builds on
34 of 73 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Convex optimizationcited by 2,479
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2014Certifying and removing disparate impactcited by 715
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2018A Reductions Approach to Fair Classificationcited by 585
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
- 2017Algorithmic decision making and the cost of fairnesscited by 402
22 more
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
- 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 368
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2019Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigationcited by 252
- 2018Women also Snowboard: Overcoming Bias in Captioning Modelscited by 236
- 2019Causality matters in medical imagingcited by 193
- 2019Towards Fairer Datasets: Filtering and Balancing the Distribution of the People Subtree in the ImageNet Hierarchycited by 156
- 2018Classification with Fairness Constraints: A Meta-Algorithm with Provable Guaranteescited by 146
- 2019Inherent Tradeoffs in Learning Fair Representationscited by 144
- 2020REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasetscited by 136
- 2019A deep learning system for differential diagnosis of skin diseasescited by 118
- 2020Mitigating Bias in Calibration Error Estimationcited by 100
- 2021Counterfactual Invariance to Spurious Correlations: Why and How to Pass Stress Testscited by 77
- 2021Does Your Dermatology Classifier Know What It Doesn't Know? Detecting the Long-Tail of Unseen Conditionscited by 68
- 2019Mathematical Notions vs. Human Perception of Fairness: A Descriptive Approach to Fairness for Machine Learningcited by 57
- 2016A statistical framework for fair predictive algorithmscited by 37
- 2019On the Consistency of Top-k Surrogate Lossescited by 35
- 2015A General Analysis of the Convergence of ADMMcited by 22
- 2021A Near-Optimal Algorithm for Debiasing Trained Machine Learning Modelscited by 19
- 2020Fairness with Overlapping Groupscited by 12
- 2020Uncovering the Bias in Facial Expressionscited by 12
- 2014Conditional Probability Tree Estimation Analysis and Algorithmscited by 10
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 6; 2025: 1.
9 papers.
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2024CLIP the Bias: How Useful is Balancing Data in Multimodal Learning?cited by 35
- 2023Learning Optimal Fair Scoring Systems for Multi-Class Classificationcited by 8
- 2024Looking Beyond What You See: An Empirical Analysis on Subgroup Intersectional Fairness for Multi-label Chest X-ray Classification Using Social Determinants of Racial Health Inequitiescited by 3
- 2024Evaluating Model Bias Requires Characterizing its Mistakescited by 3
- 2024Studying and Mitigating Biases in Sign Language Understanding Modelscited by 1
- 2024SimClone: Detecting Tabular Data Clones using Value Similaritycited by 0
- 2024Fair Class-Incremental Learning using Sample Weightingcited by 0
- 2025A Critical Review of Predominant Bias in Neural Networkscited by 0
- 2025A Critical Review of Predominant Bias in Neural Networks16 Feb 2025
- 2024Studying and Mitigating Biases in Sign Language Understanding Models7 Oct 2024
- 2024Fair Class-Incremental Learning using Sample Weighting2 Oct 2024
- 2024Evaluating Model Bias Requires Characterizing its Mistakes15 Jul 2024
- 2024SimClone: Detecting Tabular Data Clones using Value Similarity24 Jun 2024
- 2024Looking Beyond What You See: An Empirical Analysis on Subgroup Intersectional Fairness for Multi-label Chest X-ray Classification Using Social Determinants of Racial Health Inequities27 Mar 2024
- 2024CLIP the Bias: How Useful is Balancing Data in Multimodal Learning?7 Mar 2024
- 2023Learning Optimal Fair Scoring Systems for Multi-Class Classification11 Apr 2023
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey14 Jul 2022