What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspective
Not on the map. Why?
Abstract (arXiv)
Algorithmic fairness has attracted increasing attention in the machine learning community. Various definitions are proposed in the literature, but the differences and connections among them are not clearly addressed. In this paper, we review and reflect on various fairness notions previously proposed in machine learning literature, and make an attempt to draw connections to arguments in moral and political philosophy, especially theories of justice. We also consider fairness inquiries from a dynamic perspective, and further consider the long-term impact that is induced by current prediction and decision. In light of the differences in the characterized fairness, we present a flowchart that encompasses implicit assumptions and expected outcomes of different types of fairness inquiries on the data generating process, on the predicted outcome, and on the induced impact, respectively. This paper demonstrates the importance of matching the mission (which kind of fairness one would like to enforce) and the means (which spectrum of fairness analysis is of interest, what is the appropriate analyzing scheme) to fulfill the intended purpose.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 122 of its 245 references that are in the map. First posted on arXiv 8 Jun 2022.
Builds on
122 of 245 references.
References · 122
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2017Counterfactual Fairnesscited by 802
- 2015Deep Learning and the Information Bottleneck Principlecited by 793
- 2014Certifying and removing disparate impactcited by 715
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2018A Reductions Approach to Fair Classificationcited by 585
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2017Algorithmic decision making and the cost of fairnesscited by 402
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
38 more
- 2020Fairness in Machine Learning: A Surveycited by 369
- 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 368
- 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 363
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2018Actionable Recourse in Linear Classificationcited by 327
- 2017Fairness in Criminal Justice Risk Assessments: The State of the Artcited by 315
- 2018Empirical Risk Minimization under Fairness Constraintscited by 226
- 2019Flexibly Fair Representation Learning by Disentanglementcited by 196
- 2017Avoiding Discrimination through Causal Reasoningcited by 191
- 2018Fairness of Exposure in Rankingscited by 189
- 2018Delayed Impact of Fair Machine Learningcited by 183
- 2018Path-Specific Counterfactual Fairnesscited by 179
- 2016Fairness in Learning: Classic and Contextual Banditscited by 167
- 2013Causal Inference in the Presence of Latent Variables and Selection Biascited by 165
- 2017Fairness in Machine Learning: Lessons from Political Philosophycited by 148
- 2017A Convex Framework for Fair Regressioncited by 147
- 2017Fair Inference On Outcomescited by 143
- 2016Foundations of Structural Causal Models with Cycles and Latent Variablescited by 134
- 2019Towards Realistic Individual Recourse and Actionable Explanations in Black-Box Decision Making Systemscited by 128
- 2017Strategic Classification from Revealed Preferencescited by 126
- 2018An Intersectional Definition of Fairnesscited by 126
- 2019On the Apparent Conflict Between Individual and Group Fairnesscited by 126
- 2019The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasonscited by 115
- 2021Fair Mixup: Fairness via Interpolationcited by 109
- 2018The Social Cost of Strategic Classificationcited by 105
- 2017Runaway Feedback Loops in Predictive Policingcited by 97
- 2018A Unified Approach to Quantifying Algorithmic Unfairness: Measuring Individual & Group Unfairness via Inequality Indicescited by 97
- 2018Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobservedcited by 94
- 2013Discrimination in Online Ad Deliverycited by 93
- 2016Fairness in Reinforcement Learningcited by 93
- 2014Automated Experiments on Ad Privacy Settings: A Tale of Opacity, Choice, and Discriminationcited by 83
- 2018Learning Controllable Fair Representationscited by 83
- 2018How Do Classifiers Induce Agents To Invest Effort Strategically?cited by 82
- 2018An Empirical Study of Rich Subgroup Fairness for Machine Learningcited by 81
- 2019Conditional Learning of Fair Representationscited by 78
- 2020Robust Optimization for Fairness with Noisy Protected Groupscited by 78
- 2019Achieving Fairness in the Stochastic Multi-armed Bandit Problemcited by 77
- 2021Towards Long-term Fairness in Recommendationcited by 77
50 most cited of 122 All 122 (JSON)
Built on by
Citing papers per year: 2023: 4; 2024: 10; 2025: 2; 2026: 2.
18 papers.
Sort:
- 2024Prompting Fairness: Integrating Causality to Debias Large Language Modelscited by 20
- 2023Causal Adversarial Perturbations for Individual Fairness and Robustness in Heterogeneous Data Spacescited by 4
- 2023Directed Cyclic Graph for Causal Discovery from Multivariate Functional Datacited by 4
- 2024Striking a Balance in Fairness for Dynamic Systems Through Reinforcement Learningcited by 4
- 2024Procedural Fairness in Machine Learningcited by 4
- 2024Long-Term Fairness Inquiries and Pursuits in Machine Learning: A Survey of Notions, Methods, and Challengescited by 4
- 2023Procedural Fairness Through Decoupling Objectionable Data Generating Componentscited by 3
- 2024A Review of Fairness and A Practical Guide to Selecting Context-Appropriate Fairness Metrics in Machine Learningcited by 3
- 2024Counterfactual Fairness through Transforming Data Orthogonal to Biascited by 2
- 2024Measuring Model-Induced Discrimination via Efficient Fairness Approximationcited by 2
- 2024Outlier Detection Bias Busted: Understanding Sources of Algorithmic Bias through Data-centric Factorscited by 2
- 2023Assessing Electricity Service Unfairness with Transfer Counterfactual Learningcited by 1
6 more
- 2024Long-Term Fair Decision Making through Deep Generative Modelscited by 1
- 2026Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generationcited by 1
- 2024Beyond RMSE and MAE: Introducing EAUC to unmask hidden bias and unfairness in dyadic regression modelscited by 0
- 2025Position: Beyond Sensitive Attributes, ML Fairness Should Quantify Structural Injustice via Social Determinantscited by 0
- 2025"I think this is fair": Uncovering the Complexities of Stakeholder Decision-Making in AI Fairness Assessmentcited by 0
- 2026Whose fairness? Structural concentration in AI bias researchcited by 0
- 2026Whose fairness? Structural concentration in AI bias research6 Jul 2026
- 2026Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generation18 Jan 2026
- 2025"I think this is fair": Uncovering the Complexities of Stakeholder Decision-Making in AI Fairness Assessment22 Sep 2025
- 2025Position: Beyond Sensitive Attributes, ML Fairness Should Quantify Structural Injustice via Social Determinants10 Aug 2025
- 2024A Review of Fairness and A Practical Guide to Selecting Context-Appropriate Fairness Metrics in Machine Learning10 Nov 2024
- 2024Outlier Detection Bias Busted: Understanding Sources of Algorithmic Bias through Data-centric Factors24 Aug 2024
- 2024Long-Term Fairness Inquiries and Pursuits in Machine Learning: A Survey of Notions, Methods, and Challenges10 Jun 2024
- 2024Measuring Model-Induced Discrimination via Efficient Fairness Approximation15 May 2024
- 2024Procedural Fairness in Machine Learning2 Apr 2024
- 2024Counterfactual Fairness through Transforming Data Orthogonal to Bias26 Mar 2024
- 2024Prompting Fairness: Integrating Causality to Debias Large Language Models13 Mar 2024
- 2024Long-Term Fair Decision Making through Deep Generative Models20 Jan 2024
6 more
- 2024Beyond RMSE and MAE: Introducing EAUC to unmask hidden bias and unfairness in dyadic regression models19 Jan 2024
- 2024Striking a Balance in Fairness for Dynamic Systems Through Reinforcement Learning12 Jan 2024
- 2023Procedural Fairness Through Decoupling Objectionable Data Generating Components5 Nov 2023
- 2023Directed Cyclic Graph for Causal Discovery from Multivariate Functional Data31 Oct 2023
- 2023Assessing Electricity Service Unfairness with Transfer Counterfactual Learning5 Oct 2023
- 2023Causal Adversarial Perturbations for Individual Fairness and Robustness in Heterogeneous Data Spaces17 Aug 2023
- 2024Prompting Fairness: Integrating Causality to Debias Large Language Modelscited by 20
- 2023Causal Adversarial Perturbations for Individual Fairness and Robustness in Heterogeneous Data Spacescited by 4
- 2023Directed Cyclic Graph for Causal Discovery from Multivariate Functional Datacited by 4
- 2024Striking a Balance in Fairness for Dynamic Systems Through Reinforcement Learningcited by 4
- 2024Procedural Fairness in Machine Learningcited by 4
- 2024Long-Term Fairness Inquiries and Pursuits in Machine Learning: A Survey of Notions, Methods, and Challengescited by 4
- 2023Procedural Fairness Through Decoupling Objectionable Data Generating Componentscited by 3
- 2024A Review of Fairness and A Practical Guide to Selecting Context-Appropriate Fairness Metrics in Machine Learningcited by 3
- 2024Counterfactual Fairness through Transforming Data Orthogonal to Biascited by 2
- 2024Measuring Model-Induced Discrimination via Efficient Fairness Approximationcited by 2
- 2024Outlier Detection Bias Busted: Understanding Sources of Algorithmic Bias through Data-centric Factorscited by 2
- 2023Assessing Electricity Service Unfairness with Transfer Counterfactual Learningcited by 1
12 most cited of 18 All 18 (JSON)
- 2026Whose fairness? Structural concentration in AI bias research6 Jul 2026
- 2026Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generation18 Jan 2026
- 2025"I think this is fair": Uncovering the Complexities of Stakeholder Decision-Making in AI Fairness Assessment22 Sep 2025
- 2025Position: Beyond Sensitive Attributes, ML Fairness Should Quantify Structural Injustice via Social Determinants10 Aug 2025
- 2024A Review of Fairness and A Practical Guide to Selecting Context-Appropriate Fairness Metrics in Machine Learning10 Nov 2024
- 2024Outlier Detection Bias Busted: Understanding Sources of Algorithmic Bias through Data-centric Factors24 Aug 2024
- 2024Long-Term Fairness Inquiries and Pursuits in Machine Learning: A Survey of Notions, Methods, and Challenges10 Jun 2024
- 2024Measuring Model-Induced Discrimination via Efficient Fairness Approximation15 May 2024
- 2024Procedural Fairness in Machine Learning2 Apr 2024
- 2024Counterfactual Fairness through Transforming Data Orthogonal to Bias26 Mar 2024
- 2024Prompting Fairness: Integrating Causality to Debias Large Language Models13 Mar 2024
- 2024Long-Term Fair Decision Making through Deep Generative Models20 Jan 2024
12 newest of 18 All 18 (JSON)