mlsanityData to 7 Oct 2026

An Accounting Identity for Algorithmic Fairness

arXiv 2601.20217 ↗First posted 28 Jan 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We derive an accounting identity for predictive models that links accuracy with common fairness criteria. The identity shows that for globally calibrated models, the weighted sums of miscalibration within groups and error imbalance across groups is equal to a "total unfairness budget." For binary outcomes, this budget is the model's mean-squared error times the difference in group prevalence across outcome classes. The identity nests standard impossibility results as special cases, while also describing inherent tradeoffs when one or more fairness measures are not perfectly satisfied. The results suggest that accuracy and fairness are best viewed as complements in binary prediction tasks: increasing accuracy necessarily shrinks the total unfairness budget and vice-versa. Experiments on benchmark data confirm the theory and show that many fairness interventions largely substitute between fairness violations, and when they reduce accuracy they tend to expand the total unfairness budget. The results extend naturally to prediction tasks with non-binary outcomes, illustrating how additional outcome information can relax fairness incompatibilities and identifying conditions under which the binary-style impossibility does and does not extend to regression tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 20 references that are in the map. First posted on arXiv 28 Jan 2026.

Builds on

13 of 20 references.

References · 13

  1. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  2. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  3. 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
  4. 2018A Reductions Approach to Fair Classificationcited by 585
  5. 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
  6. 2017On Fairness and Calibrationcited by 406
  7. 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
  8. 2017A Convex Framework for Fair Regressioncited by 147
  9. 2020Algorithmic Fairnesscited by 143
  10. 2018The Measure and Mismeasure of Fairnesscited by 94
  11. 2023Fairlearn: Assessing and Improving Fairness of AI Systemscited by 74
  12. 2023The Possibility of Fairness: Revisiting the Impossibility Theorem in Practicecited by 18
1 more
  1. 2020A Possibility in Algorithmic Fairness: Can Calibration and Equal Error Rates Be Reconciled?cited by 10

Built on by

Not cited yet.