A Framework for Fairness: A Systematic Review of Existing Fair AI Solutions
Not on the map. Why?
Abstract (arXiv)
In a world of daily emerging scientific inquisition and discovery, the prolific launch of machine learning across industries comes to little surprise for those familiar with the potential of ML. Neither so should the congruent expansion of ethics-focused research that emerged as a response to issues of bias and unfairness that stemmed from those very same applications. Fairness research, which focuses on techniques to combat algorithmic bias, is now more supported than ever before. A large portion of fairness research has gone to producing tools that machine learning practitioners can use to audit for bias while designing their algorithms. Nonetheless, there is a lack of application of these fairness solutions in practice. This systematic review provides an in-depth summary of the algorithmic bias issues that have been defined and the fairness solution space that has been proposed. Moreover, this review provides an in-depth breakdown of the caveats to the solution space that have arisen since their release and a taxonomy of needs that have been proposed by machine learning practitioners, fairness researchers, and institutional stakeholders. These needs have been organized and addressed to the parties most influential to their implementation, which includes fairness researchers, organizations that produce ML algorithms, and the machine learning practitioners themselves. These findings can be used in the future to bridge the gap between practitioners and fairness experts and inform the creation of usable fair ML toolkits.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 34 of its 108 references that are in the map. First posted on arXiv 10 Dec 2021.
Builds on
34 of 108 references.
References · 34
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2018Datasheets for Datasetscited by 1,386
- 2018Model Cards for Model Reportingcited by 1,080
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 672
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 586
- 2017Algorithmic decision making and the cost of fairnesscited by 403
- 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
- 2017Fairness in Criminal Justice Risk Assessments: The State of the Artcited by 315
- 2019Measurement and Fairnesscited by 308
- 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
- 2018A comparative study of fairness-enhancing interventions in machine learningcited by 208
22 more
- 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
- 2017Avoiding Discrimination through Causal Reasoningcited by 194
- 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
- 2017Fairness in Machine Learning: Lessons from Political Philosophycited by 149
- 2018Aequitas: A Bias and Fairness Audit Toolkitcited by 147
- 2019"How do I fool you?": Manipulating User Trust via Misleading Black Box Explanationscited by 111
- 201850 Years of Test (Un)fairness: Lessons for Machine Learningcited by 101
- 2018'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisionscited by 91
- 2016A Confidence-Based Approach for Balancing Fairness and Accuracycited by 73
- 2018Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Makingcited by 67
- 2019Garbage In, Garbage Out? Do Machine Learning Application Papers in Social Computing Report Where Human-Labeled Training Data Comes From?cited by 64
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
- 2015On the relation between accuracy and fairness in binary classificationcited by 48
- 2020What's Sex Got To Do With Fair Machine Learning?cited by 38
- 2020Algorithmic Fairness from a Non-ideal Perspectivecited by 30
- 2020LiFT: A Scalable Framework for Measuring Fairness in ML Applicationscited by 22
- 2017How algorithmic popularity bias hinders or promotes qualitycited by 20
- 2019On the Legal Compatibility of Fairness Definitionscited by 19
- 2020Fairkit, Fairkit, on the Wall, Who's the Fairest of Them All? Supporting Data Scientists in Training Fair Modelscited by 9
- 2018Assessing and Addressing Algorithmic Bias - But Before We Get Therecited by 4
- 2020Designing Tools for Semi-Automated Detection of Machine Learning Biases: An Interview Studycited by 4
- 2020The Impact of Presentation Style on Human-In-The-Loop Detection of Algorithmic Biascited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 6; 2025: 5; 2026: 2.
18 papers.
Sort:
By area:
- 2024The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligencecited by 23
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Surveycited by 22
- 2025Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)cited by 19
- 2023Diversity and Inclusion in Artificial Intelligencecited by 14
- 2024The Pursuit of Fairness in Artificial Intelligence Models: A Surveycited by 13
- 2025FairEval: Evaluating Fairness in LLM-Based Recommendations with Personality Awarenesscited by 8
- 2025Measuring What Matters: Connecting AI Ethics Evaluations to System Attributes, Hazards, and Harmscited by 5
- 2023Challenges and Solutions in AI for Allcited by 3
- 2023FairCompass: Operationalising Fairness in Machine Learningcited by 3
- 2024SoK: Security and Privacy Risks of Healthcare AIcited by 2
- 2024Data Augmentation via Diffusion Model to Enhance AI Fairnesscited by 2
- 2022A Seven-Layer Model for Standardising AI Fairness Assessmentcited by 1
6 more
- 2024Transfer Learning for Security: Challenges and Future Directionscited by 1
- 2025Fair for a few: Improving Fairness in Doubly Imbalanced Datasetscited by 1
- 2026Uncertainty and Fairness Awareness in LLM-Based Recommendation Systemscited by 1
- 2024A resource-constrained stochastic scheduling algorithm for homeless street outreach and gleaning edible foodcited by 0
- 2025Fairness Evaluation of Risk Estimation Models for Lung Cancer Screeningcited by 0
- 2026Variable Selection in the Context of AI Fairnesscited by 0
- 2026Variable Selection in the Context of AI Fairness4 Aug 2026
- 2026Uncertainty and Fairness Awareness in LLM-Based Recommendation Systems31 Jan 2026
- 2025Fairness Evaluation of Risk Estimation Models for Lung Cancer Screening23 Dec 2025
- 2025Measuring What Matters: Connecting AI Ethics Evaluations to System Attributes, Hazards, and Harms11 Oct 2025
- 2025Fair for a few: Improving Fairness in Doubly Imbalanced Datasets17 Jun 2025
- 2025Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)27 May 2025
- 2025FairEval: Evaluating Fairness in LLM-Based Recommendations with Personality Awareness10 Apr 2025
- 2024Data Augmentation via Diffusion Model to Enhance AI Fairness20 Oct 2024
- 2024SoK: Security and Privacy Risks of Healthcare AI11 Sep 2024
- 2024The Pursuit of Fairness in Artificial Intelligence Models: A Survey26 Mar 2024
- 2024The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligence20 Mar 2024
- 2024A resource-constrained stochastic scheduling algorithm for homeless street outreach and gleaning edible food15 Mar 2024
6 more
- 2024Transfer Learning for Security: Challenges and Future Directions1 Mar 2024
- 2023FairCompass: Operationalising Fairness in Machine Learning27 Dec 2023
- 2023Challenges and Solutions in AI for All20 Jul 2023
- 2023Diversity and Inclusion in Artificial Intelligence22 May 2023
- 2022A Seven-Layer Model for Standardising AI Fairness Assessment21 Dec 2022
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Survey10 Nov 2022
- 2024Data Augmentation via Diffusion Model to Enhance AI Fairness20 Oct 2024
- 2024The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligencecited by 23
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Surveycited by 22
- 2025Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)cited by 19
- 2023Diversity and Inclusion in Artificial Intelligencecited by 14
- 2024The Pursuit of Fairness in Artificial Intelligence Models: A Surveycited by 13
- 2025FairEval: Evaluating Fairness in LLM-Based Recommendations with Personality Awarenesscited by 8
- 2025Measuring What Matters: Connecting AI Ethics Evaluations to System Attributes, Hazards, and Harmscited by 5
- 2023Challenges and Solutions in AI for Allcited by 3
- 2023FairCompass: Operationalising Fairness in Machine Learningcited by 3
- 2024SoK: Security and Privacy Risks of Healthcare AIcited by 2
- 2022A Seven-Layer Model for Standardising AI Fairness Assessmentcited by 1
- 2024Transfer Learning for Security: Challenges and Future Directionscited by 1
12 most cited of 17 All 17 (JSON)
- 2026Variable Selection in the Context of AI Fairness4 Aug 2026
- 2026Uncertainty and Fairness Awareness in LLM-Based Recommendation Systems31 Jan 2026
- 2025Fairness Evaluation of Risk Estimation Models for Lung Cancer Screening23 Dec 2025
- 2025Measuring What Matters: Connecting AI Ethics Evaluations to System Attributes, Hazards, and Harms11 Oct 2025
- 2025Fair for a few: Improving Fairness in Doubly Imbalanced Datasets17 Jun 2025
- 2025Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)27 May 2025
- 2025FairEval: Evaluating Fairness in LLM-Based Recommendations with Personality Awareness10 Apr 2025
- 2024SoK: Security and Privacy Risks of Healthcare AI11 Sep 2024
- 2024The Pursuit of Fairness in Artificial Intelligence Models: A Survey26 Mar 2024
- 2024The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligence20 Mar 2024
- 2024A resource-constrained stochastic scheduling algorithm for homeless street outreach and gleaning edible food15 Mar 2024
- 2024Transfer Learning for Security: Challenges and Future Directions1 Mar 2024
12 newest of 17 All 17 (JSON)