On Formalizing Fairness in Prediction with Machine Learning
Not on the map. Why?
Abstract (arXiv)
Machine learning algorithms for prediction are increasingly being used in critical decisions affecting human lives. Various fairness formalizations, with no firm consensus yet, are employed to prevent such algorithms from systematically discriminating against people based on certain attributes protected by law. The aim of this article is to survey how fairness is formalized in the machine learning literature for the task of prediction and present these formalizations with their corresponding notions of distributive justice from the social sciences literature. We provide theoretical as well as empirical critiques of these notions from the social sciences literature and explain how these critiques limit the suitability of the corresponding fairness formalizations to certain domains. We also suggest two notions of distributive justice which address some of these critiques and discuss avenues for prospective fairness formalizations.
Key facts. Cited by 65 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 15; 2023: 17; 2024: 10; 2025: 8; 2026: 2.
65 papers.
Sort:
By area:
- 2021Strong Optimal Classification Treescited by 28
- 2021Fairness Perceptions of Algorithmic Decision-Making: A Systematic Review of the Empirical Literaturecited by 27
- 2021UDIS: Unsupervised Discovery of Bias in Deep Visual Recognition Modelscited by 23
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Surveycited by 22
- 2023Improving Recommendation Fairness via Data Augmentationcited by 18
- 2021Can Explainable AI Explain Unfairness? A Framework for Evaluating Explainable AIcited by 16
- 2022FairEGM: Fair Link Prediction and Recommendation via Emulated Graph Modificationcited by 15
- 2022Counterfactual Fairness Is Basically Demographic Paritycited by 15
- 2022Survey on Fair Reinforcement Learning: Theory and Practicecited by 14
- 2024Swiss Cheese Model for AI Safety: A Taxonomy and Reference Architecture for Multi-Layered Guardrails of Foundation Model Based Agentscited by 14
- 2021Personalized Education in the AI Era: What to Expect Next?cited by 13
- 2021Towards Equity and Algorithmic Fairness in Student Grade Predictioncited by 13
38 more
- 2022The Long Arc of Fairness: Formalisations and Ethical Discoursecited by 13
- 2021A Unified Approach to Fair Online Learning via Blackwell Approachabilitycited by 12
- 2023FairGen: Towards Fair Graph Generationcited by 12
- 2023Evaluating the Fairness of Discriminative Foundation Models in Computer Visioncited by 12
- 2021Fairness with Continuous Optimal Transportcited by 10
- 2021Distributive Justice and Fairness Metrics in Automated Decision-making: How Much Overlap Is There?cited by 10
- 2021Equality of opportunity in travel behavior prediction with deep neural networks and discrete choice modelscited by 10
- 2022Survey on Fairness Notions and Related Tensionscited by 9
- 2022Stochastic Methods for AUC Optimization subject to AUC-based Fairness Constraintscited by 9
- 2023Fairness-enhancing deep learning for ride-hailing demand predictioncited by 9
- 2024Properties of fairness measures in the context of varying class imbalance and protected group ratioscited by 7
- 2021End-To-End Bias Mitigation: Removing Gender Bias in Deep Learningcited by 6
- 2022What Is Fairness? On the Role of Protected Attributes and Fictitious Worldscited by 6
- 2023DualFair: Fair Representation Learning at Both Group and Individual Levels via Contrastive Self-supervisioncited by 6
- 2022FaiREE: Fair Classification with Finite-Sample and Distribution-Free Guaranteecited by 5
- 2023Fairness Hacking: The Malicious Practice of Shrouding Unfairness in Algorithmscited by 5
- 2021User Acceptance of Gender Stereotypes in Automated Career Recommendationscited by 4
- 2021Statistical discrimination in learning agentscited by 4
- 2022Fairness in Forecasting of Observations of Linear Dynamical Systemscited by 4
- 2022The Fairness Field Guide: Perspectives from Social and Formal Sciencescited by 3
- 2023Improving Fairness with Ensemble Combination: Margin-Dependent Boundscited by 3
- 2022Mitigating Algorithmic Bias with Limited Annotationscited by 2
- 2022Diversely Regularized Matrix Factorization for Accurate and Aggregately Diversified Recommendationcited by 2
- 2023Consumer-side Fairness in Recommender Systems: A Systematic Survey of Methods and Evaluationcited by 2
- 2023FairLay-ML: Intuitive Remedies for Unfairness in Data-Driven Social-Critical Algorithmscited by 2
- 2023Automated discovery of trade-off between utility, privacy and fairness in machine learning modelscited by 2
- 2024Measuring Model-Induced Discrimination via Efficient Fairness Approximationcited by 2
- 2025Underrepresentation, Label Bias, and Proxies: Towards Data Bias Profiles for the EU AI Act and Beyondcited by 2
- 2025Controllable Feature Whitening for Hyperparameter-Free Bias Mitigationcited by 2
- 2022fAux: Testing Individual Fairness via Gradient Alignmentcited by 1
- 2022Simultaneous Improvement of ML Model Fairness and Performance by Identifying Bias in Datacited by 1
- 2023Matrix Estimation for Individual Fairnesscited by 1
- 2023Provable Detection of Propagating Sampling Bias in Prediction Modelscited by 1
- 2023Robust probabilistic inference via a constrained transport metriccited by 1
- 2023Towards Fair and Explainable AI using a Human-Centered AI Approachcited by 1
- 2023A Novel Information-Theoretic Objective to Disentangle Representations for Fair Classificationcited by 1
- 2024Data Ethics in the Era of Healthcare Artificial Intelligence in Africa: An Ubuntu Philosophy Perspectivecited by 1
- 2024Approximating Discrimination Within Models When Faced With Several Non-Binary Sensitive Attributescited by 1
50 most cited of 65 All 65 (JSON)
- 2026Fairness in Link Prediction Beyond Demographic Parity: A Reproducibility Study10 Aug 2026
- 2026No evaluation without fair representation : Impact of label and selection bias on the evaluation, performance and mitigation of classification models10 Mar 2026
- 2025Breaking the Cycle of Incarceration With Targeted Mental Health Outreach: A Case Study in Machine Learning for Public Policy17 Sep 2025
- 2025Applications and Challenges of Fairness APIs in Machine Learning Software22 Aug 2025
- 2025Controllable Feature Whitening for Hyperparameter-Free Bias Mitigation27 Jul 2025
- 2025Underrepresentation, Label Bias, and Proxies: Towards Data Bias Profiles for the EU AI Act and Beyond9 Jul 2025
- 2025Algorithmic Fairness: Not a Purely Technical but Socio-Technical Property14 Jun 2025
- 2025Simple and Effective Specialized Representations for Fair Classifiers16 May 2025
- 2025Fairness-aware Anomaly Detection via Fair Projection16 May 2025
- 2025FairPlay: A Collaborative Approach to Mitigate Bias in Datasets for Improved AI Fairness22 Apr 2025
- 2024Properties of fairness measures in the context of varying class imbalance and protected group ratios13 Nov 2024
- 2024Revisiting Technical Bias Mitigation Strategies22 Oct 2024
38 more
- 2024A Semidefinite Relaxation Approach for Fair Graph Clustering19 Oct 2024
- 2024Approximating Discrimination Within Models When Faced With Several Non-Binary Sensitive Attributes12 Aug 2024
- 2024Swiss Cheese Model for AI Safety: A Taxonomy and Reference Architecture for Multi-Layered Guardrails of Foundation Model Based Agents5 Aug 2024
- 2024fairBERTs: Erasing Sensitive Information Through Semantic and Fairness-aware Perturbations11 Jul 2024
- 2024Data Ethics in the Era of Healthcare Artificial Intelligence in Africa: An Ubuntu Philosophy Perspective14 Jun 2024
- 2024Measuring Model-Induced Discrimination via Efficient Fairness Approximation15 May 2024
- 2024Investigating Gender Fairness in Machine Learning-driven Personalized Care for Chronic Pain29 Feb 2024
- 2024Connecting Algorithmic Fairness to Quality Dimensions in Machine Learning in Official Statistics and Survey Production14 Feb 2024
- 2023Automated discovery of trade-off between utility, privacy and fairness in machine learning models27 Nov 2023
- 2023Fairness Hacking: The Malicious Practice of Shrouding Unfairness in Algorithms12 Nov 2023
- 2023A Novel Information-Theoretic Objective to Disentangle Representations for Fair Classification21 Oct 2023
- 2023Constrained Reweighting of Distributions: an Optimal Transport Approach19 Oct 2023
- 2023Evaluating the Fairness of Discriminative Foundation Models in Computer Vision18 Oct 2023
- 2023FairLay-ML: Intuitive Remedies for Unfairness in Data-Driven Social-Critical Algorithms11 Jul 2023
- 2023Towards Fair and Explainable AI using a Human-Centered AI Approach12 Jun 2023
- 2023Counterpart Fairness -- Addressing Systematic between-group Differences in Fairness Evaluation29 May 2023
- 2023Consumer-side Fairness in Recommender Systems: A Systematic Survey of Methods and Evaluation16 May 2023
- 2023FairGen: Towards Fair Graph Generation30 Mar 2023
- 2023Robust probabilistic inference via a constrained transport metric17 Mar 2023
- 2023DualFair: Fair Representation Learning at Both Group and Individual Levels via Contrastive Self-supervision15 Mar 2023
- 2023Fairness-enhancing deep learning for ride-hailing demand prediction10 Mar 2023
- 2023Provable Detection of Propagating Sampling Bias in Prediction Models13 Feb 2023
- 2023Improving Recommendation Fairness via Data Augmentation13 Feb 2023
- 2023Matrix Estimation for Individual Fairness4 Feb 2023
- 2023Improving Fairness with Ensemble Combination: Margin-Dependent Bounds25 Jan 2023
- 2022Stochastic Methods for AUC Optimization subject to AUC-based Fairness Constraints23 Dec 2022
- 2022FaiREE: Fair Classification with Finite-Sample and Distribution-Free Guarantee28 Nov 2022
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Survey10 Nov 2022
- 2022Simultaneous Improvement of ML Model Fairness and Performance by Identifying Bias in Data24 Oct 2022
- 2022Diversely Regularized Matrix Factorization for Accurate and Aggregately Diversified Recommendation19 Oct 2022
- 2022fAux: Testing Individual Fairness via Gradient Alignment10 Oct 2022
- 2022Survey on Fairness Notions and Related Tensions16 Sep 2022
- 2022Fairness in Forecasting of Observations of Linear Dynamical Systems12 Sep 2022
- 2022Counterfactual Fairness Is Basically Demographic Parity7 Aug 2022
- 2022Mitigating Algorithmic Bias with Limited Annotations20 Jul 2022
- 2022Survey on Fair Reinforcement Learning: Theory and Practice20 May 2022
- 2022What Is Fairness? On the Role of Protected Attributes and Fictitious Worlds19 May 2022
- 2022The Long Arc of Fairness: Formalisations and Ethical Discourse8 Mar 2022
50 newest of 65 All 65 (JSON)
- 2021Strong Optimal Classification Treescited by 28
- 2021Fairness Perceptions of Algorithmic Decision-Making: A Systematic Review of the Empirical Literaturecited by 27
- 2021UDIS: Unsupervised Discovery of Bias in Deep Visual Recognition Modelscited by 23
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Surveycited by 22
- 2023Improving Recommendation Fairness via Data Augmentationcited by 18
- 2021Can Explainable AI Explain Unfairness? A Framework for Evaluating Explainable AIcited by 16
- 2022FairEGM: Fair Link Prediction and Recommendation via Emulated Graph Modificationcited by 15
- 2022Counterfactual Fairness Is Basically Demographic Paritycited by 15
- 2022Survey on Fair Reinforcement Learning: Theory and Practicecited by 14
- 2021Personalized Education in the AI Era: What to Expect Next?cited by 13
- 2021Towards Equity and Algorithmic Fairness in Student Grade Predictioncited by 13
- 2022The Long Arc of Fairness: Formalisations and Ethical Discoursecited by 13
12 most cited of 64 All 64 (JSON)
- 2026Fairness in Link Prediction Beyond Demographic Parity: A Reproducibility Study10 Aug 2026
- 2026No evaluation without fair representation : Impact of label and selection bias on the evaluation, performance and mitigation of classification models10 Mar 2026
- 2025Breaking the Cycle of Incarceration With Targeted Mental Health Outreach: A Case Study in Machine Learning for Public Policy17 Sep 2025
- 2025Applications and Challenges of Fairness APIs in Machine Learning Software22 Aug 2025
- 2025Controllable Feature Whitening for Hyperparameter-Free Bias Mitigation27 Jul 2025
- 2025Underrepresentation, Label Bias, and Proxies: Towards Data Bias Profiles for the EU AI Act and Beyond9 Jul 2025
- 2025Algorithmic Fairness: Not a Purely Technical but Socio-Technical Property14 Jun 2025
- 2025Simple and Effective Specialized Representations for Fair Classifiers16 May 2025
- 2025Fairness-aware Anomaly Detection via Fair Projection16 May 2025
- 2025FairPlay: A Collaborative Approach to Mitigate Bias in Datasets for Improved AI Fairness22 Apr 2025
- 2024Properties of fairness measures in the context of varying class imbalance and protected group ratios13 Nov 2024
- 2024Revisiting Technical Bias Mitigation Strategies22 Oct 2024
12 newest of 64 All 64 (JSON)