An Accounting Identity for Algorithmic Fairness
Not on the map. Why?
Abstract (arXiv)
We derive an accounting identity for predictive models that links accuracy with common fairness criteria. The identity shows that for globally calibrated models, the weighted sums of miscalibration within groups and error imbalance across groups is equal to a "total unfairness budget." For binary outcomes, this budget is the model's mean-squared error times the difference in group prevalence across outcome classes. The identity nests standard impossibility results as special cases, while also describing inherent tradeoffs when one or more fairness measures are not perfectly satisfied. The results suggest that accuracy and fairness are best viewed as complements in binary prediction tasks: increasing accuracy necessarily shrinks the total unfairness budget and vice-versa. Experiments on benchmark data confirm the theory and show that many fairness interventions largely substitute between fairness violations, and when they reduce accuracy they tend to expand the total unfairness budget. The results extend naturally to prediction tasks with non-binary outcomes, illustrating how additional outcome information can relax fairness incompatibilities and identifying conditions under which the binary-style impossibility does and does not extend to regression tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 20 references that are in the map. First posted on arXiv 28 Jan 2026.
Builds on
13 of 20 references.
References · 13
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
- 2018A Reductions Approach to Fair Classificationcited by 585
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2017On Fairness and Calibrationcited by 406
- 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
- 2017A Convex Framework for Fair Regressioncited by 147
- 2020Algorithmic Fairnesscited by 143
- 2018The Measure and Mismeasure of Fairnesscited by 94
- 2023Fairlearn: Assessing and Improving Fairness of AI Systemscited by 74
- 2023The Possibility of Fairness: Revisiting the Impossibility Theorem in Practicecited by 18
Built on by
Not cited yet.