No-Free-Fairness: Fundamental Limits and Trade-offs in Learning Systems
Not on the map. Why?
Abstract (arXiv)
In this paper, we establish a set of theoretical impossibility results, termed the No-Free-Fairness theorems, that identify three fundamental sources of disparity in learning systems. First, we show that when a task exhibits irreducible cost on a subgroup, any decision rule must trade off overall performance with disparity, yielding an inherent fairness--cost frontier. Second, we prove that even in ideal, noise-free settings where a perfectly fair and accurate solution exists, finite-sample learning alone induces nontrivial subgroup disparity, ruling out distribution-free fairness guarantees. More seriously, enforcing strict relative fairness creates a statistical bottleneck: achieving low cost may require exponentially many samples. Third, we show that limitations of the model class can independently induce disparity: if the model cannot represent accurate solutions for a subgroup, fairness remains unattainable regardless of data or training procedure. Overall, these results demonstrate that unfairness is not solely a consequence of biased data or suboptimal optimization, but arises from the intrinsic structure of decision problems, the constraints of finite data, and the expressivity of models. Our framework applies broadly beyond standard supervised learning, and suggests that achieving fairness requires explicit trade-offs and should be treated as a core design consideration.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 44 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
29 of 44 references.
References · 29
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
- 2014Certifying and removing disparate impactcited by 715
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 672
- 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 653
- 2023Bias and Fairness in Large Language Models: A Surveycited by 639
- 2018A Reductions Approach to Fair Classificationcited by 587
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 586
- 2019Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networkscited by 566
17 more
- 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 496
- 2019Confident Learning: Estimating Uncertainty in Dataset Labelscited by 413
- 2017On Fairness and Calibrationcited by 406
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 384
- 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 377
- 2020Fairness in Machine Learning: A Surveycited by 370
- 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 364
- 2017Fairness in Criminal Justice Risk Assessments: The State of the Artcited by 315
- 2018Empirical Risk Minimization under Fairness Constraintscited by 226
- 2021Societal Biases in Language Generation: Progress and Challengescited by 202
- 2018Delayed Impact of Fair Machine Learningcited by 184
- 2023Generative Language Models Exhibit Social Identity Biasescited by 111
- 2024Large Language Models Still Exhibit Bias in Long Textcited by 16
- 2022Inherent Limitations of AI Fairnesscited by 12
- 2025BiasFilter: An Inference-Time Debiasing Framework for Large Language Modelscited by 6
- 2025Metamorphic Testing for Fairness Evaluation in Large Language Models: Identifying Intersectional Bias in LLaMA and GPTcited by 4
- 2025Fairness Overfitting in Machine Learning: An Information-Theoretic Perspectivecited by 3
Built on by
Not cited yet.