On the relation between accuracy and fairness in binary classification
Not on the map. Why?
Abstract (arXiv)
Our study revisits the problem of accuracy-fairness tradeoff in binary classification. We argue that comparison of non-discriminatory classifiers needs to account for different rates of positive predictions, otherwise conclusions about performance may be misleading, because accuracy and discrimination of naive baselines on the same dataset vary with different rates of positive predictions. We provide methodological recommendations for sound comparison of non-discriminatory classifiers, and present a brief theoretical and empirical analysis of tradeoffs between accuracy and non-discrimination.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 May 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 11; 2023: 7; 2024: 4; 2025: 7; 2026: 4.
47 papers.
Sort:
By area:
- 2021A survey on datasets for fairness-aware machine learningcited by 157
- 2022Perturbation Augmentation for Fairer NLPcited by 51
- 2021Understanding and Mitigating Annotation Bias in Facial Expression Recognitioncited by 50
- 2022The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanationscited by 41
- 2021Understanding and Improving Fairness-Accuracy Trade-offs in Multi-Task Learningcited by 34
- 2021Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Informationcited by 33
- 2021Fairness in Ranking under Uncertaintycited by 27
- 2023Fair Machine Unlearning: Data Removal while Mitigating Disparitiescited by 25
- 2021Characterizing the risk of fairwashingcited by 21
- 2022Counterfactual Fairness with Partially Known Causal Graphcited by 20
- 2021A Framework for Fairness: A Systematic Review of Existing Fair AI Solutionscited by 18
- 2021Algorithmic Fairness Verification with Graphical Modelscited by 16
35 more
- 2022Counterfactual Fairness Is Basically Demographic Paritycited by 15
- 2021Disentangled Representations from Non-Disentangled Modelscited by 13
- 2024The Pursuit of Fairness in Artificial Intelligence Models: A Surveycited by 13
- 2023How Spurious Features Are Memorized: Precise Analysis for Random and NTK Featurescited by 11
- 2022To the Fairness Frontier and Beyond: Identifying, Quantifying, and Optimizing the Fairness-Accuracy Pareto Frontiercited by 10
- 2022Group Meritocratic Fairness in Linear Contextual Banditscited by 9
- 2022Survey on Fairness Notions and Related Tensionscited by 9
- 2025Spurious Correlations in High Dimensional Regression: The Roles of Regularization, Simplicity Bias and Over-Parameterizationcited by 9
- 2021An Empirical Comparison of Bias Reduction Methods on Real-World Problems in High-Stakes Policy Settingscited by 8
- 2021Costs and Benefits of Fair Regressioncited by 8
- 2022How Biased are Your Features?: Computing Fairness Influence Functions with Global Sensitivity Analysiscited by 7
- 2024Interventional Fairness on Partially Known Causal Graphs: A Constrained Optimization Approachcited by 6
- 2021Fair Sparse Regression with Clustering: An Invex Relaxation for a Combinatorial Problemcited by 5
- 2022Evaluation of group fairness measures in student performance prediction problemscited by 5
- 2025Overcoming Fairness Trade-offs via Pre-processing: A Causal Perspectivecited by 5
- 2022Fairness in Forecasting of Observations of Linear Dynamical Systemscited by 4
- 2024A Review of Fairness and A Practical Guide to Selecting Context-Appropriate Fairness Metrics in Machine Learningcited by 3
- 2025Causality Is Key to Understand and Balance Multiple Goals in Trustworthy ML and Foundation Modelscited by 2
- 2025Aggregating Concepts of Fairness and Accuracy in Prediction Algorithmscited by 2
- 2023Bias Mitigation Methods for Binary Classification Decision-Making Systems: Survey and Recommendationscited by 1
- 2023A Counterfactual Fair Model for Longitudinal Electronic Health Records via Deconfoundercited by 1
- 2023Rethinking Algorithmic Fairness for Human-AI Collaborationcited by 1
- 2023Fair Feature Importance Scores for Interpreting Tree-Based Methods and Surrogatescited by 1
- 2024LLM-Assisted Content Conditional Debiasing for Fair Text Embeddingcited by 1
- 2025Mitigation of Gender and Ethnicity Bias in AI-Generated Stories through Model Explanationscited by 1
- 2026Trustworthy AI Suffers from Invariance Conflicts and Causality is The Solutioncited by 1
- 2021Coping with Mistreatment in Fair Algorithmscited by 0
- 2021CONFAIR: Configurable and Interpretable Algorithmic Fairnesscited by 0
- 2022Causal Intervention for Fairness in Multi-behavior Recommendationcited by 0
- 2023FairPilot: An Explorative System for Hyperparameter Tuning through the Lens of Fairnesscited by 0
- 2025You Only Debias Once: Towards Flexible Accuracy-Fairness Trade-offs at Inference Timecited by 0
- 2025Algorithmic Fairness: Not a Purely Technical but Socio-Technical Propertycited by 0
- 2026Unravelling the (In)compatibility of Statistical-Parity and Equalized-Oddscited by 0
- 2026Investigating Data Interventions for Subgroup Fairness: An ICU Case Studycited by 0
- 2026Controlling for Omitted Variable Bias in Deep Neural Networkscited by 0
- 2026Controlling for Omitted Variable Bias in Deep Neural Networks26 Aug 2026
- 2026Trustworthy AI Suffers from Invariance Conflicts and Causality is The Solution4 May 2026
- 2026Investigating Data Interventions for Subgroup Fairness: An ICU Case Study3 Apr 2026
- 2026Unravelling the (In)compatibility of Statistical-Parity and Equalized-Odds26 Jan 2026
- 2025Mitigation of Gender and Ethnicity Bias in AI-Generated Stories through Model Explanations3 Sep 2025
- 2025Algorithmic Fairness: Not a Purely Technical but Socio-Technical Property14 Jun 2025
- 2025Aggregating Concepts of Fairness and Accuracy in Prediction Algorithms13 May 2025
- 2025You Only Debias Once: Towards Flexible Accuracy-Fairness Trade-offs at Inference Time10 Mar 2025
- 2025Causality Is Key to Understand and Balance Multiple Goals in Trustworthy ML and Foundation Models28 Feb 2025
- 2025Spurious Correlations in High Dimensional Regression: The Roles of Regularization, Simplicity Bias and Over-Parameterization3 Feb 2025
- 2025Overcoming Fairness Trade-offs via Pre-processing: A Causal Perspective24 Jan 2025
- 2024A Review of Fairness and A Practical Guide to Selecting Context-Appropriate Fairness Metrics in Machine Learning10 Nov 2024
35 more
- 2024The Pursuit of Fairness in Artificial Intelligence Models: A Survey26 Mar 2024
- 2024LLM-Assisted Content Conditional Debiasing for Fair Text Embedding22 Feb 2024
- 2024Interventional Fairness on Partially Known Causal Graphs: A Constrained Optimization Approach19 Jan 2024
- 2023Fair Feature Importance Scores for Interpreting Tree-Based Methods and Surrogates6 Oct 2023
- 2023Rethinking Algorithmic Fairness for Human-AI Collaboration5 Oct 2023
- 2023A Counterfactual Fair Model for Longitudinal Electronic Health Records via Deconfounder22 Aug 2023
- 2023Fair Machine Unlearning: Data Removal while Mitigating Disparities27 Jul 2023
- 2023Bias Mitigation Methods for Binary Classification Decision-Making Systems: Survey and Recommendations31 May 2023
- 2023How Spurious Features Are Memorized: Precise Analysis for Random and NTK Features20 May 2023
- 2023FairPilot: An Explorative System for Hyperparameter Tuning through the Lens of Fairness10 Apr 2023
- 2022Survey on Fairness Notions and Related Tensions16 Sep 2022
- 2022Fairness in Forecasting of Observations of Linear Dynamical Systems12 Sep 2022
- 2022Causal Intervention for Fairness in Multi-behavior Recommendation10 Sep 2022
- 2022Evaluation of group fairness measures in student performance prediction problems22 Aug 2022
- 2022Counterfactual Fairness Is Basically Demographic Parity7 Aug 2022
- 2022Group Meritocratic Fairness in Linear Contextual Bandits7 Jun 2022
- 2022How Biased are Your Features?: Computing Fairness Influence Functions with Global Sensitivity Analysis1 Jun 2022
- 2022To the Fairness Frontier and Beyond: Identifying, Quantifying, and Optimizing the Fairness-Accuracy Pareto Frontier31 May 2022
- 2022Counterfactual Fairness with Partially Known Causal Graph27 May 2022
- 2022Perturbation Augmentation for Fairer NLP25 May 2022
- 2022The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanations6 May 2022
- 2021A Framework for Fairness: A Systematic Review of Existing Fair AI Solutions10 Dec 2021
- 2021CONFAIR: Configurable and Interpretable Algorithmic Fairness17 Nov 2021
- 2021A survey on datasets for fairness-aware machine learning1 Oct 2021
- 2021Algorithmic Fairness Verification with Graphical Models20 Sep 2021
- 2021Understanding and Mitigating Annotation Bias in Facial Expression Recognition19 Aug 2021
- 2021Fairness in Ranking under Uncertainty14 Jul 2021
- 2021Costs and Benefits of Fair Regression16 Jun 2021
- 2021Characterizing the risk of fairwashing14 Jun 2021
- 2021Understanding and Improving Fairness-Accuracy Trade-offs in Multi-Task Learning4 Jun 2021
- 2021An Empirical Comparison of Bias Reduction Methods on Real-World Problems in High-Stakes Policy Settings13 May 2021
- 2021Coping with Mistreatment in Fair Algorithms22 Feb 2021
- 2021Fair Sparse Regression with Clustering: An Invex Relaxation for a Combinatorial Problem19 Feb 2021
- 2021Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Information16 Feb 2021
- 2021Disentangled Representations from Non-Disentangled Models11 Feb 2021
- 2021A survey on datasets for fairness-aware machine learningcited by 157
- 2022Perturbation Augmentation for Fairer NLPcited by 51
- 2021Understanding and Mitigating Annotation Bias in Facial Expression Recognitioncited by 50
- 2022The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanationscited by 41
- 2021Understanding and Improving Fairness-Accuracy Trade-offs in Multi-Task Learningcited by 34
- 2021Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Informationcited by 33
- 2021Fairness in Ranking under Uncertaintycited by 27
- 2021Characterizing the risk of fairwashingcited by 21
- 2022Counterfactual Fairness with Partially Known Causal Graphcited by 20
- 2021A Framework for Fairness: A Systematic Review of Existing Fair AI Solutionscited by 18
- 2021Algorithmic Fairness Verification with Graphical Modelscited by 16
- 2022Counterfactual Fairness Is Basically Demographic Paritycited by 15
12 most cited of 46 All 46 (JSON)
- 2026Controlling for Omitted Variable Bias in Deep Neural Networks26 Aug 2026
- 2026Trustworthy AI Suffers from Invariance Conflicts and Causality is The Solution4 May 2026
- 2026Investigating Data Interventions for Subgroup Fairness: An ICU Case Study3 Apr 2026
- 2026Unravelling the (In)compatibility of Statistical-Parity and Equalized-Odds26 Jan 2026
- 2025Mitigation of Gender and Ethnicity Bias in AI-Generated Stories through Model Explanations3 Sep 2025
- 2025Algorithmic Fairness: Not a Purely Technical but Socio-Technical Property14 Jun 2025
- 2025Aggregating Concepts of Fairness and Accuracy in Prediction Algorithms13 May 2025
- 2025You Only Debias Once: Towards Flexible Accuracy-Fairness Trade-offs at Inference Time10 Mar 2025
- 2025Causality Is Key to Understand and Balance Multiple Goals in Trustworthy ML and Foundation Models28 Feb 2025
- 2025Spurious Correlations in High Dimensional Regression: The Roles of Regularization, Simplicity Bias and Over-Parameterization3 Feb 2025
- 2025Overcoming Fairness Trade-offs via Pre-processing: A Causal Perspective24 Jan 2025
- 2024A Review of Fairness and A Practical Guide to Selecting Context-Appropriate Fairness Metrics in Machine Learning10 Nov 2024
12 newest of 46 All 46 (JSON)