Fairlearn: Assessing and Improving Fairness of AI Systems
Not on the map. Why?
Abstract (arXiv)
Fairlearn is an open source project to help practitioners assess and improve fairness of artificial intelligence (AI) systems. The associated Python library, also named fairlearn, supports evaluation of a model's output across affected populations and includes several algorithms for mitigating fairness issues. Grounded in the understanding that fairness is a sociotechnical challenge, the project integrates learning resources that aid practitioners in considering a system's broader societal context.
Key facts. Cited by 74 papers in the map (data through 7 Oct 2026). Builds on 12 of its 37 references that are in the map. First posted on arXiv 29 Mar 2023.
Builds on
12 of 37 references.
References · 12
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2018A Reductions Approach to Fair Classificationcited by 585
- 2019Measurement and Fairnesscited by 299
- 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
- 2019Fair Regression: Quantitative Definitions and Reduction-based Algorithmscited by 168
- 2021Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffscited by 48
- 2022The four-fifths rule is not disparate impact: a woeful tale of epistemic trespassing in algorithmic fairnesscited by 21
- 2019On the Legal Compatibility of Fairness Definitionscited by 19
- 2021The Contestation of Tech Ethics: A Sociotechnical Approach to Technology Ethics in Practicecited by 12
Built on by
Citing papers per year: 2023: 11; 2024: 17; 2025: 31; 2026: 15.
74 papers.
Sort:
By area:
- 2023Adversarial attacks and defenses in explainable artificial intelligence: A surveycited by 47
- 2024PyRIT: A Framework for Security Risk Identification and Red Teaming in Generative AI Systemcited by 29
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
- 2023FairTune: Optimizing Parameter Efficient Fine Tuning for Fairness in Medical Image Analysiscited by 23
- 2023One Model Many Scores: Using Multiverse Analysis to Prevent Fairness Hacking and Evaluate the Influence of Model Design Decisionscited by 12
- 2024OxonFair: A Flexible Toolkit for Algorithmic Fairnesscited by 12
- 2023A Sequentially Fair Mechanism for Multiple Sensitive Attributescited by 8
- 2024A structured regression approach for evaluating model performance across intersectional subgroupscited by 8
- 2024ABCFair: an Adaptable Benchmark approach for Comparing Fairness Methodscited by 8
- 2023Positivity-free Policy Learning with Observational Datacited by 6
- 2023Mining bias-target Alignment from Voronoi Cellscited by 5
- 2024Unlawful Proxy Discrimination: A Framework for Challenging Inherently Discriminatory Algorithmscited by 5
38 more
- 2024EARN Fairness: Explaining, Asking, Reviewing, and Negotiating Artificial Intelligence Fairness Metrics Among Stakeholderscited by 5
- 2025LangFair: A Python Package for Assessing Bias and Fairness in Large Language Model Use Casescited by 5
- 2023Survey on AI Ethics: A Socio-technical Perspectivecited by 4
- 2025Revisiting Pre-processing Group Fairness: A Modular Benchmarking Frameworkcited by 4
- 2023Human-in-the-loop Fairness: Integrating Stakeholder Feedback to Incorporate Fairness Perspectives in Responsible AIcited by 3
- 2024The Life Cycle of Large Language Models: A Review of Biases in Educationcited by 3
- 2024Trustworthy and Responsible AI for Human-Centric Autonomous Decision-Making Systemscited by 3
- 2024FairFML: Fair Federated Machine Learning with a Case Study on Reducing Gender Disparities in Cardiac Arrest Outcome Predictioncited by 3
- 2025Advancing Responsible Innovation in Agentic AI: A study of Ethical Frameworks for Household Automationcited by 3
- 2023Fair Enough? A map of the current limitations of the requirements to have fair algorithmscited by 2
- 2024FairX: A comprehensive benchmarking tool for model analysis using fairness, utility, and explainabilitycited by 2
- 2024Cherry on the Cake: Fairness is NOT an Optimization Problemcited by 2
- 2024Feasibility of Detecting Cognitive Impairment and Psychological Well-being among Older Adults Using Facial, Acoustic, Linguistic, and Cardiovascular Patterns Derived from Remote Conversationscited by 2
- 2025Evidence for Phenotype-Driven Disparities in Freezing of Gait Detection and Approaches to Bias Mitigationcited by 2
- 2025Advances in LLMs with Focus on Reasoning, Adaptability, Efficiency and Ethicscited by 2
- 2025Bias Begins with Data: The FairGround Corpus for Robust and Reproducible Research on Algorithmic Fairnesscited by 2
- 2026FairLogue: A Toolkit for Intersectional Fairness Analysis in Clinical Machine Learning Modelscited by 2
- 2023Simulating counterfactualscited by 1
- 2023Rethinking Algorithmic Fairness for Human-AI Collaborationcited by 1
- 2024SureMap: Simultaneous Mean Estimation for Single-Task and Multi-Task Disaggregated Evaluationcited by 1
- 2025A Multi-Objective Evaluation Framework for Analyzing Utility-Fairness Trade-Offs in Machine Learning Systemscited by 1
- 2025Fairmetrics: An R package for group fairness evaluationcited by 1
- 2025Size-adaptive Hypothesis Testing for Fairnesscited by 1
- 2025Measurement as Bricolage: Examining How Data Scientists Construct Target Variables for Predictive Modeling Taskscited by 1
- 2025FairTabGen: High-Fidelity and Fair Synthetic Health Data Generation from Limited Samplescited by 1
- 2025JustEva: A Toolkit to Evaluate LLM Fairness in Legal Knowledge Inferencecited by 1
- 2025Amulet: a Python Library for Assessing Interactions Among ML Defenses and Riskscited by 1
- 2025RAISE: A Unified Framework for Responsible AI Scoring and Evaluationcited by 1
- 2025A multimodal Bayesian Network for symptom-level depression and anxiety prediction from voice and speech datacited by 1
- 2026RISED: A Pre-Deployment Evaluation Framework for High-Stakes AI Decision-Support Systems, with Application to Healthcarecited by 1
- 2024Advancing Explainable AI Toward Human-Like Intelligence: Forging the Path to Artificial Braincited by 0
- 2024Data Quality in Edge Machine Learning: A State-of-the-Art Surveycited by 0
- 2024Fair4Free: Generating High-fidelity Fair Synthetic Samples using Data Free Distillationcited by 0
- 2025Fairness-Aware Low-Rank Representation Fine-Tuningcited by 0
- 2025EquiPy: Sequential Fairness using Optimal Transport in Pythoncited by 0
- 2025seeBias: A Comprehensive Tool for Assessing and Visualizing AI Fairnesscited by 0
- 2025FairSHAP: Preprocessing for Fairness Through Attribution-Based Data Augmentationcited by 0
- 2025Simulating Biases for Interpretable Fairness in Offline and Online Classifierscited by 0
50 most cited of 74 All 74 (JSON)
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026FairLMs: A Turnkey Library for Fairness in Language Models18 Sep 2026
- 2026Distilling Foundation Models for Agentic What-If Reasoning:Cost, Latency, and Governance in a Hybrid LLM+SLM Architecture14 Sep 2026
- 2026Unequal Verdicts: Investigating Gender Bias in LLM-Based Fake News Detection4 Aug 2026
- 2026FairDiffuseVQVAE: Sampling-Time Fairness in Tabular Diffusion via Conditional Refinement of Vector-Quantized Latents31 Jul 2026
- 2026FairSelect: A Systematic Evaluation of Multi-Level and Intersectional Algorithmic Fairness9 Jul 2026
- 2026Adaptive Calibration for Fair and Performant Facial Recognition3 Jun 2026
- 2026Demystifying the Optimal Fair Classifier in Multi-Class Classification30 May 2026
- 2026Multi-Dimensional Model Integrity and Responsibility Assessment Index and Scoring Framework14 May 2026
- 2026RISED: A Pre-Deployment Evaluation Framework for High-Stakes AI Decision-Support Systems, with Application to Healthcare13 May 2026
- 2026The Pok'emon Theorem and other Fairness Impossibility Results9 May 2026
- 2026FairLogue: A Toolkit for Intersectional Fairness Analysis in Clinical Machine Learning Models6 Apr 2026
38 more
- 2026Building the ethical AI framework of the future: from philosophy to practice16 Feb 2026
- 2026An Accounting Identity for Algorithmic Fairness28 Jan 2026
- 2026Nishpaksh: TEC Standard-Compliant Framework for Fairness Auditing and Certification of AI Models23 Jan 2026
- 2025Statistical Guarantees in the Search for Less Discriminatory Algorithms30 Dec 2025
- 2025meval: A Statistical Toolbox for Fine-Grained Model Performance Analysis19 Dec 2025
- 2025A multimodal Bayesian Network for symptom-level depression and anxiety prediction from voice and speech data8 Dec 2025
- 2025Evolved Sample Weights for Bias Mitigation: Effectiveness Depends on the Fairness Objective25 Nov 2025
- 2025An Explainable and Fair AI Tool for PCOS Risk Assessment: Calibration, Subgroup Equity, and Interactive Clinical Deployment8 Nov 2025
- 2025flowengineR: A Modular and Extensible Framework for Fair and Reproducible Workflow Design in R29 Oct 2025
- 2025Bias Begins with Data: The FairGround Corpus for Robust and Reproducible Research on Algorithmic Fairness25 Oct 2025
- 2025Predicting Metabolic Dysfunction-Associated Steatotic Liver Disease using Machine Learning Methods: A Retrospective Cohort Study25 Oct 2025
- 2025RAISE: A Unified Framework for Responsible AI Scoring and Evaluation21 Oct 2025
- 2025PyCFRL: A Python library for counterfactually fair offline reinforcement learning via sequential data preprocessing8 Oct 2025
- 2025Fair Classification by Direct Intervention on Operating Characteristics29 Sep 2025
- 2025humancompatible.detect: a Python Toolkit for Detecting Bias in AI Models29 Sep 2025
- 2025"I think this is fair": Uncovering the Complexities of Stakeholder Decision-Making in AI Fairness Assessment22 Sep 2025
- 2025Amulet: a Python Library for Assessing Interactions Among ML Defenses and Risks15 Sep 2025
- 2025JustEva: A Toolkit to Evaluate LLM Fairness in Legal Knowledge Inference15 Sep 2025
- 2025Transparent and Fair Profiling in Employment Services: Evidence from Switzerland15 Sep 2025
- 2025Revisiting Pre-processing Group Fairness: A Modular Benchmarking Framework21 Aug 2025
- 2025FairTabGen: High-Fidelity and Fair Synthetic Health Data Generation from Limited Samples15 Aug 2025
- 2025Advancing Responsible Innovation in Agentic AI: A study of Ethical Frameworks for Household Automation21 Jul 2025
- 2025Simulating Biases for Interpretable Fairness in Offline and Online Classifiers14 Jul 2025
- 2025Measurement as Bricolage: Examining How Data Scientists Construct Target Variables for Predictive Modeling Tasks3 Jul 2025
- 2025Advances in LLMs with Focus on Reasoning, Adaptability, Efficiency and Ethics14 Jun 2025
- 2025Size-adaptive Hypothesis Testing for Fairness12 Jun 2025
- 2025Fairmetrics: An R package for group fairness evaluation6 Jun 2025
- 2025FairSHAP: Preprocessing for Fairness Through Attribution-Based Data Augmentation16 May 2025
- 2025seeBias: A Comprehensive Tool for Assessing and Visualizing AI Fairness11 Apr 2025
- 2025A Multi-Objective Evaluation Framework for Analyzing Utility-Fairness Trade-Offs in Machine Learning Systems14 Mar 2025
- 2025EquiPy: Sequential Fairness using Optimal Transport in Python12 Mar 2025
- 2025Fairness-Aware Low-Rank Representation Fine-Tuning7 Mar 2025
- 2025Evidence for Phenotype-Driven Disparities in Freezing of Gait Detection and Approaches to Bias Mitigation29 Jan 2025
- 2025LangFair: A Python Package for Assessing Bias and Fairness in Large Language Model Use Cases6 Jan 2025
- 2024Feasibility of Detecting Cognitive Impairment and Psychological Well-being among Older Adults Using Facial, Acoustic, Linguistic, and Cardiovascular Patterns Derived from Remote Conversations12 Dec 2024
- 2024SureMap: Simultaneous Mean Estimation for Single-Task and Multi-Task Disaggregated Evaluation14 Nov 2024
- 2024FairFML: Fair Federated Machine Learning with a Case Study on Reducing Gender Disparities in Cardiac Arrest Outcome Prediction7 Oct 2024
- 2024Fair4Free: Generating High-fidelity Fair Synthetic Samples using Data Free Distillation2 Oct 2024
50 newest of 74 All 74 (JSON)
- 2025Advancing Responsible Innovation in Agentic AI: A study of Ethical Frameworks for Household Automationcited by 3
- 2026Building the ethical AI framework of the future: from philosophy to practicecited by 0
- 2026Distilling Foundation Models for Agentic What-If Reasoning:Cost, Latency, and Governance in a Hybrid LLM+SLM Architecturecited by 0
- 2026Distilling Foundation Models for Agentic What-If Reasoning:Cost, Latency, and Governance in a Hybrid LLM+SLM Architecture14 Sep 2026
- 2026Building the ethical AI framework of the future: from philosophy to practice16 Feb 2026
- 2025Advancing Responsible Innovation in Agentic AI: A study of Ethical Frameworks for Household Automation21 Jul 2025
- 2023Adversarial attacks and defenses in explainable artificial intelligence: A surveycited by 47
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
- 2023FairTune: Optimizing Parameter Efficient Fine Tuning for Fairness in Medical Image Analysiscited by 23
- 2023One Model Many Scores: Using Multiverse Analysis to Prevent Fairness Hacking and Evaluate the Influence of Model Design Decisionscited by 12
- 2024OxonFair: A Flexible Toolkit for Algorithmic Fairnesscited by 12
- 2023A Sequentially Fair Mechanism for Multiple Sensitive Attributescited by 8
- 2024A structured regression approach for evaluating model performance across intersectional subgroupscited by 8
- 2024ABCFair: an Adaptable Benchmark approach for Comparing Fairness Methodscited by 8
- 2023Positivity-free Policy Learning with Observational Datacited by 6
- 2023Mining bias-target Alignment from Voronoi Cellscited by 5
- 2024Unlawful Proxy Discrimination: A Framework for Challenging Inherently Discriminatory Algorithmscited by 5
- 2024EARN Fairness: Explaining, Asking, Reviewing, and Negotiating Artificial Intelligence Fairness Metrics Among Stakeholderscited by 5
12 most cited of 67 All 67 (JSON)
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026FairLMs: A Turnkey Library for Fairness in Language Models18 Sep 2026
- 2026Unequal Verdicts: Investigating Gender Bias in LLM-Based Fake News Detection4 Aug 2026
- 2026FairDiffuseVQVAE: Sampling-Time Fairness in Tabular Diffusion via Conditional Refinement of Vector-Quantized Latents31 Jul 2026
- 2026FairSelect: A Systematic Evaluation of Multi-Level and Intersectional Algorithmic Fairness9 Jul 2026
- 2026Adaptive Calibration for Fair and Performant Facial Recognition3 Jun 2026
- 2026Demystifying the Optimal Fair Classifier in Multi-Class Classification30 May 2026
- 2026Multi-Dimensional Model Integrity and Responsibility Assessment Index and Scoring Framework14 May 2026
- 2026RISED: A Pre-Deployment Evaluation Framework for High-Stakes AI Decision-Support Systems, with Application to Healthcare13 May 2026
- 2026The Pok'emon Theorem and other Fairness Impossibility Results9 May 2026
- 2026FairLogue: A Toolkit for Intersectional Fairness Analysis in Clinical Machine Learning Models6 Apr 2026
- 2026An Accounting Identity for Algorithmic Fairness28 Jan 2026
12 newest of 67 All 67 (JSON)