Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey
Not on the map. Why?
Abstract (arXiv)
This paper provides a comprehensive survey of bias mitigation methods for achieving fairness in Machine Learning (ML) models. We collect a total of 341 publications concerning bias mitigation for ML classifiers. These methods can be distinguished based on their intervention procedure (i.e., pre-processing, in-processing, post-processing) and the technique they apply. We investigate how existing bias mitigation methods are evaluated in the literature. In particular, we consider datasets, metrics and benchmarking. Based on the gathered insights (e.g., What is the most popular fairness metric? How many datasets are used for evaluating bias mitigation methods?), we hope to support practitioners in making informed choices when developing and evaluating new bias mitigation methods.
Key facts. Cited by 125 papers in the map (data through 7 Oct 2026). Builds on 229 of its 428 references that are in the map. First posted on arXiv 14 Jul 2022.
Builds on
229 of 428 references.
References · 229
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2017Counterfactual Fairnesscited by 802
- 2014Certifying and removing disparate impactcited by 715
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2018A Reductions Approach to Fair Classificationcited by 585
- 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 443
- 2017On Fairness and Calibrationcited by 406
- 2017Algorithmic decision making and the cost of fairnesscited by 402
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
- 2020Fairness in Machine Learning: A Surveycited by 369
38 more
- 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 368
- 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 363
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
- 2017Fairness in Criminal Justice Risk Assessments: The State of the Artcited by 315
- 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
- 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
- 2020Fairness without Demographics through Adversarially Reweighted Learningcited by 251
- 2017Predict Responsibly: Improving Fairness and Accuracy by Learning to Defercited by 228
- 2018Empirical Risk Minimization under Fairness Constraintscited by 226
- 2015The Variational Fair Autoencodercited by 223
- 2018Multiaccuracy: Black-Box Post-Processing for Fairness in Classificationcited by 221
- 2019Machine Learning Testing: Survey, Landscapes and Horizonscited by 213
- 2018A comparative study of fairness-enhancing interventions in machine learningcited by 208
- 2019Flexibly Fair Representation Learning by Disentanglementcited by 196
- 2015Censoring Representations with an Adversarycited by 191
- 2017Avoiding Discrimination through Causal Reasoningcited by 191
- 2018Path-Specific Counterfactual Fairnesscited by 179
- 2018Learning Gender-Neutral Word Embeddingscited by 169
- 2019Fair Regression: Quantitative Definitions and Reduction-based Algorithmscited by 168
- 2016Fairness in Learning: Classic and Contextual Banditscited by 167
- 2017Data Decisions and Theoretical Implications when Adversarially Learning Fair Representationscited by 165
- 2018FairGAN: Fairness-aware Generative Adversarial Networkscited by 164
- 2021A survey on datasets for fairness-aware machine learningcited by 157
- 2020Minimax Pareto Fairness: A Multi Objective Perspectivecited by 152
- 2017A Convex Framework for Fair Regressioncited by 147
- 2018Classification with Fairness Constraints: A Meta-Algorithm with Provable Guaranteescited by 146
- 2019Identifying and Correcting Label Bias in Machine Learningcited by 146
- 2019Inherent Tradeoffs in Learning Fair Representationscited by 144
- 2017Fair Inference On Outcomescited by 143
- 2018Why Is My Classifier Discriminatory?cited by 143
- 2020Algorithmic Fairnesscited by 143
- 2018The Frontiers of Fairness in Machine Learningcited by 139
- 2019Wasserstein Fair Classificationcited by 131
- 2017Controllable Invariance through Adversarial Feature Learningcited by 127
- 2021FairFed: Enabling Group Fairness in Federated Learningcited by 114
- 2018Invariant Representations without Adversarial Trainingcited by 111
- 2021Fair Mixup: Fairness via Interpolationcited by 109
50 most cited of 229 All 229 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 32; 2024: 35; 2025: 39; 2026: 18.
125 papers.
Sort:
By area:
- 2023Bias Testing and Mitigation in LLM-based Code Generationcited by 53
- 2023Aleatoric and Epistemic Discrimination: Fundamental Limits of Fairness Interventionscited by 19
- 2024Fairness and Bias in Multimodal AI: A Surveycited by 19
- 2025Systemizing Multiplicity: The Curious Case of Arbitrariness in Machine Learningcited by 17
- 2023FRAPPE: A Group Fairness Framework for Post-Processing Everythingcited by 16
- 2023Uncertainty-based Fairness Measurescited by 15
- 2024New Job, New Gender? Measuring the Social Bias in Image Generation Modelscited by 15
- 2025U-Fair: Uncertainty-based Multimodal Multitask Learning for Fairer Depression Detectioncited by 12
- 2023Post-processing Private Synthetic Data for Improving Utility on Selected Measurescited by 9
- 2023Fix Fairness, Don't Ruin Accuracy: Performance Aware Fairness Repair using AutoMLcited by 9
- 2023Understanding Fairness Surrogate Functions in Algorithmic Fairnesscited by 8
- 2023Fair Wasserstein Coresetscited by 8
38 more
- 2023Bias Behind the Wheel: Fairness Testing of Autonomous Driving Systemscited by 7
- 2023Learning Human-like Representations to Enable Learning Human Valuescited by 7
- 2025Machine Learning Fairness for Depression Detection using EEG Datacited by 7
- 2025Review of Demographic Fairness in Face Recognitioncited by 7
- 2023Towards Fairness in Personalized Ads Using Impression Variance Aware Reinforcement Learningcited by 6
- 2024Underneath the Numbers: Quantitative and Qualitative Gender Fairness in LLMs for Depression Predictioncited by 6
- 2024FairJob: A Real-World Dataset for Fairness in Online Systemscited by 6
- 2023Compatibility of Fairness Metrics with EU Non-Discrimination Laws: Demographic Parity & Conditional Demographic Disparitycited by 5
- 2023Arbitrariness Lies Beyond the Fairness-Accuracy Frontiercited by 5
- 2023FairWASP: Fast and Optimal Fair Wasserstein Pre-processingcited by 5
- 2023DSAP: Analyzing Bias Through Demographic Comparison of Datasetscited by 5
- 2024Implications of the AI Act for Non-Discrimination Law and Algorithmic Fairnesscited by 5
- 2024What is Fair? Defining Fairness in Machine Learning for Healthcited by 5
- 2024Less can be more: representational vs. stereotypical gender bias in facial expression recognitioncited by 5
- 2024EARN Fairness: Explaining, Asking, Reviewing, and Negotiating Artificial Intelligence Fairness Metrics Among Stakeholderscited by 5
- 2024Fairness Concerns in App Reviews: A Study on AI-based Mobile Appscited by 4
- 2024A Catalog of Fairness-Aware Practices in Machine Learning Engineeringcited by 4
- 2025Self-Regularization with Sparse Autoencoders for Controllable LLM-based Classificationcited by 4
- 2025BIASINSPECTOR: Detecting Bias in Structured Data through LLM Agentscited by 4
- 2023Standardized Interpretable Fairness Measures for Continuous Risk Scorescited by 3
- 2023RAI4IoE: Responsible AI for Enabling the Internet of Energycited by 3
- 2023Enhancing Group Fairness in Online Settings Using Oblique Decision Forestscited by 3
- 2023Multi-Group Fairness Evaluation via Conditional Value-at-Risk Testingcited by 3
- 2024Inducing Group Fairness in Prompt-Based Language Model Decisionscited by 3
- 2024AI-Driven Healthcare: A Review on Ensuring Fairness and Mitigating Biascited by 3
- 2024Ethical Concern Identification in NLP: A Corpus of ACL Anthology Ethics Statementscited by 3
- 2024Diversity Drives Fairness: Ensemble of Higher Order Mutants for Intersectional Fairness of Machine Learning Softwarecited by 3
- 2025Fair Text Classification via Transferable Representationscited by 3
- 2025Counterfactual Fairness Evaluation of Machine Learning Models on Educational Datasetscited by 3
- 2025Generative AI for Testing of Autonomous Driving Systems: A Surveycited by 3
- 2022Enhanced Fairness Testing via Generating Effective Initial Individual Discriminatory Instancescited by 2
- 2023Pushing the Accuracy-Group Robustness Frontier with Introspective Self-playcited by 2
- 2023Fair Active Learning in Low-Data Regimescited by 2
- 2025Deontic Temporal Logic for Formal Verification of AI Ethicscited by 2
- 2025Underrepresentation, Label Bias, and Proxies: Towards Data Bias Profiles for the EU AI Act and Beyondcited by 2
- 2025Machine Learning with Multitype Protected Attributes: Intersectional Fairness through Regularisationcited by 2
- 2026The Voice of Equity: A Systematic Evaluation of Bias Mitigation Techniques for Speech-Based Cognitive Impairment Detection Across Architectures and Demographicscited by 2
- 2026FairLogue: A Toolkit for Intersectional Fairness Analysis in Clinical Machine Learning Modelscited by 2
50 most cited of 125 All 125 (JSON)
- 2026textttfindr: Transparent and Fair Credit Risk Decisions through Semi-Structured Regressions25 Aug 2026
- 2026Trustworthy AI in Digital Health: A Comprehensive Review of Robustness and Explainability3 Aug 2026
- 2026FairSelect: A Systematic Evaluation of Multi-Level and Intersectional Algorithmic Fairness9 Jul 2026
- 2026Unraveling Machine Behavior by Multi-Level Bias Analysis and Detection: Methodology and Application to Computer Vision8 Jul 2026
- 2026Whose fairness? Structural concentration in AI bias research6 Jul 2026
- 2026Data Bias Mitigation under Coverage Constraints & The Price of Fairness18 Jun 2026
- 2026Reinforcement Learning for Neural Model Editing11 Jun 2026
- 2026Trustworthy AI: Ensuring Reliability and Accountability from Models to Agents9 May 2026
- 2026Benchmarking Fairness in Spiking Neural Networks: Data Bias, Spurious Features, and Hardware Effects8 May 2026
- 2026Measuring and Mitigating Bias in Code Generated by Large Language Models5 May 2026
- 2026Investigating Bias and Fairness in Appearance-based Gaze Estimation12 Apr 2026
- 2026Evaluating Intersectional Fairness across Clinical Machine Learning Use Cases using Fairlogue and the All of Us Research Program7 Apr 2026
38 more
- 2026FairLogue: A Toolkit for Intersectional Fairness Analysis in Clinical Machine Learning Models6 Apr 2026
- 2026A Generalised Exponentiated Gradient Approach to Enhance Fairness in Binary and Multi-class Classification Tasks22 Mar 2026
- 2026Optimal Fair Aggregation of Crowdsourced Noisy Labels using Demographic Parity Constraints30 Jan 2026
- 2026Intersectional Fairness via Mixed-Integer Optimization27 Jan 2026
- 2026Trade-offs Between Individual and Group Fairness in Machine Learning: A Comprehensive Review23 Jan 2026
- 2026The Voice of Equity: A Systematic Evaluation of Bias Mitigation Techniques for Speech-Based Cognitive Impairment Detection Across Architectures and Demographics7 Jan 2026
- 2025Fairness Is Not Just Ethical: Performance Trade-Off via Data Correlation Tuning to Mitigate Bias in ML Software19 Dec 2025
- 2025Fair Representation Learning with Controllable High Confidence Guarantees via Adversarial Inference23 Oct 2025
- 2025EQPO: Equitable Group Relative Policy Optimization for Clinical Reasoning22 Oct 2025
- 2025FairNet: Dynamic Fairness Correction without Performance Loss via Contrastive Conditional LoRA22 Oct 2025
- 2025Towards Continual Expansion of Data Coverage: Automatic Text-guided Edge-case Synthesis30 Sep 2025
- 2025"I think this is fair": Uncovering the Complexities of Stakeholder Decision-Making in AI Fairness Assessment22 Sep 2025
- 2025CAF'E: Causal Black-Box Testing of Machine Unlearning20 Sep 2025
- 2025Controllable Pareto Trade-off between Fairness and Accuracy17 Sep 2025
- 2025Machine Learning with Multitype Protected Attributes: Intersectional Fairness through Regularisation9 Sep 2025
- 2025Bias Mitigation for AI-Feedback Loops in Recommender Systems: A Systematic Literature Review and Taxonomy28 Aug 2025
- 2025Generative AI for Testing of Autonomous Driving Systems: A Survey27 Aug 2025
- 2025From Data to Decision: A Multi-Stage Framework for Class Imbalance Mitigation in Optical Network Failure Analysis25 Aug 2025
- 2025The Fair Game: Auditing & Debiasing AI Algorithms Over Time8 Aug 2025
- 2025Software Fairness Dilemma: Is Bias Mitigation a Zero-Sum Game?5 Aug 2025
- 2025Pre-, In-, and Post-Processing Class Imbalance Mitigation Techniques for Failure Detection in Optical Networks17 Jul 2025
- 2025Underrepresentation, Label Bias, and Proxies: Towards Data Bias Profiles for the EU AI Act and Beyond9 Jul 2025
- 2025FAIRTOPIA: Envisioning Multi-Agent Guardianship for Disrupting Unfair AI Pipelines10 Jun 2025
- 2025Assessing Intersectional Bias in Representations of Pre-Trained Image Recognition Models4 Jun 2025
- 2025Fairness under Competition22 May 2025
- 2025When majority rules, minority loses: bias amplification of gradient descent19 May 2025
- 2025FairSHAP: Preprocessing for Fairness Through Attribution-Based Data Augmentation16 May 2025
- 2025Counterfactual Fairness Evaluation of Machine Learning Models on Educational Datasets15 Apr 2025
- 2025BIASINSPECTOR: Detecting Bias in Structured Data through LLM Agents7 Apr 2025
- 2025Investigating the Capabilities and Limitations of Machine Learning for Identifying Bias in English Language Data with Information and Heritage Professionals1 Apr 2025
- 2025On the Origins of Sampling Bias: Implications on Fairness Measurement and Mitigation23 Mar 2025
- 2025Enhancing Hand Palm Motion Gesture Recognition by Eliminating Reference Frame Bias via Frame-Invariant Similarity Measures14 Mar 2025
- 2025Fair Text Classification via Transferable Representations10 Mar 2025
- 2025Fairness-Aware Low-Rank Representation Fine-Tuning7 Mar 2025
- 2025Biased Heritage: How Datasets Shape Models in Facial Expression Recognition5 Mar 2025
- 2025A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practice1 Mar 2025
- 2025Controlled Model Debiasing through Minimal and Interpretable Updates28 Feb 2025
- 2025Self-Regularization with Sparse Autoencoders for Controllable LLM-based Classification19 Feb 2025
50 newest of 125 All 125 (JSON)
- 2025BiasGuard: Guardrailing Fairness in Machine Learning Production Systemscited by 0
- 2025Fairness-Aware Low-Rank Representation Fine-Tuningcited by 0
- 2025CAF'E: Causal Black-Box Testing of Machine Unlearningcited by 0
- 2026Reinforcement Learning for Neural Model Editingcited by 0
- 2026Reinforcement Learning for Neural Model Editing11 Jun 2026
- 2025CAF'E: Causal Black-Box Testing of Machine Unlearning20 Sep 2025
- 2025Fairness-Aware Low-Rank Representation Fine-Tuning7 Mar 2025
- 2025BiasGuard: Guardrailing Fairness in Machine Learning Production Systems7 Jan 2025
- 2024Fairness and Bias in Multimodal AI: A Surveycited by 19
- 2024Fairness and Bias in Multimodal AI: A Survey27 Jun 2024
- 2023Bias Testing and Mitigation in LLM-based Code Generationcited by 53
- 2023Aleatoric and Epistemic Discrimination: Fundamental Limits of Fairness Interventionscited by 19
- 2025Systemizing Multiplicity: The Curious Case of Arbitrariness in Machine Learningcited by 17
- 2023FRAPPE: A Group Fairness Framework for Post-Processing Everythingcited by 16
- 2023Uncertainty-based Fairness Measurescited by 15
- 2024New Job, New Gender? Measuring the Social Bias in Image Generation Modelscited by 15
- 2025U-Fair: Uncertainty-based Multimodal Multitask Learning for Fairer Depression Detectioncited by 12
- 2023Post-processing Private Synthetic Data for Improving Utility on Selected Measurescited by 9
- 2023Fix Fairness, Don't Ruin Accuracy: Performance Aware Fairness Repair using AutoMLcited by 9
- 2023Understanding Fairness Surrogate Functions in Algorithmic Fairnesscited by 8
- 2023Fair Wasserstein Coresetscited by 8
- 2023Bias Behind the Wheel: Fairness Testing of Autonomous Driving Systemscited by 7
12 most cited of 118 All 118 (JSON)
- 2026textttfindr: Transparent and Fair Credit Risk Decisions through Semi-Structured Regressions25 Aug 2026
- 2026Trustworthy AI in Digital Health: A Comprehensive Review of Robustness and Explainability3 Aug 2026
- 2026FairSelect: A Systematic Evaluation of Multi-Level and Intersectional Algorithmic Fairness9 Jul 2026
- 2026Unraveling Machine Behavior by Multi-Level Bias Analysis and Detection: Methodology and Application to Computer Vision8 Jul 2026
- 2026Whose fairness? Structural concentration in AI bias research6 Jul 2026
- 2026Data Bias Mitigation under Coverage Constraints & The Price of Fairness18 Jun 2026
- 2026Benchmarking Fairness in Spiking Neural Networks: Data Bias, Spurious Features, and Hardware Effects8 May 2026
- 2026Measuring and Mitigating Bias in Code Generated by Large Language Models5 May 2026
- 2026Investigating Bias and Fairness in Appearance-based Gaze Estimation12 Apr 2026
- 2026Evaluating Intersectional Fairness across Clinical Machine Learning Use Cases using Fairlogue and the All of Us Research Program7 Apr 2026
- 2026FairLogue: A Toolkit for Intersectional Fairness Analysis in Clinical Machine Learning Models6 Apr 2026
- 2026A Generalised Exponentiated Gradient Approach to Enhance Fairness in Binary and Multi-class Classification Tasks22 Mar 2026
12 newest of 118 All 118 (JSON)