Modeling Techniques for Machine Learning Fairness: A Survey
Not on the map. Why?
Abstract (arXiv)
Machine learning models are becoming pervasive in high-stakes applications. Despite their clear benefits in terms of performance, the models could show discrimination against minority groups and result in fairness issues in a decision-making process, leading to severe negative impacts on the individuals and the society. In recent years, various techniques have been developed to mitigate the unfairness for machine learning models. Among them, in-processing methods have drawn increasing attention from the community, where fairness is directly taken into consideration during model design to induce intrinsically fair models and fundamentally mitigate fairness issues in outputs and representations. In this survey, we review the current progress of in-processing fairness mitigation techniques. Based on where the fairness is achieved in the model, we categorize them into explicit and implicit methods, where the former directly incorporates fairness metrics in training objectives, and the latter focuses on refining latent representation learning. Finally, we conclude the survey with a discussion of the research challenges in this community to motivate future exploration.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 62 of its 88 references that are in the map. First posted on arXiv 4 Nov 2021.
Builds on
62 of 88 references.
References · 62
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
- 2017Neural Collaborative Filteringcited by 1,108
- 2017Counterfactual Fairnesscited by 802
- 2014Certifying and removing disparate impactcited by 715
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2017On Fairness and Calibrationcited by 406
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
38 more
- 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 368
- 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 363
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2017Fairness in Criminal Justice Risk Assessments: The State of the Artcited by 315
- 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 293
- 2020Fairness without Demographics through Adversarially Reweighted Learningcited by 251
- 2018Techniques for Interpretable Machine Learningcited by 237
- 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
- 2015Censoring Representations with an Adversarycited by 191
- 2018Fair Clustering Through Fairletscited by 176
- 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 170
- 2019Fair Regression: Quantitative Definitions and Reduction-based Algorithmscited by 168
- 2018Adversarial Removal of Demographic Attributes from Text Datacited by 166
- 2018Counterfactual Fairness in Text Classification through Robustnesscited by 150
- 2017A Convex Framework for Fair Regressioncited by 147
- 2019On the Fairness of Disentangled Representationscited by 144
- 2017Fair Inference On Outcomescited by 143
- 2020Algorithmic Fairnesscited by 143
- 2019Wasserstein Fair Classificationcited by 131
- 2019Fairness in Recommendation Ranking through Pairwise Comparisonscited by 127
- 2018An Intersectional Definition of Fairnesscited by 126
- 2019Compositional Fairness Constraints for Graph Embeddingscited by 126
- 2019Fairness in Deep Learning: A Computational Perspectivecited by 123
- 2020FairBatch: Batch Selection for Model Fairnesscited by 99
- 2018An Empirical Study of Rich Subgroup Fairness for Machine Learningcited by 81
- 2019Scalable Fair Clusteringcited by 78
- 2018Achieving Fairness through Adversarial Learning: an Application to Recidivism Predictioncited by 77
- 2019Learning Optimal and Fair Decision Trees for Non-Discriminative Decision-Makingcited by 75
- 2021FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoderscited by 75
- 2019Putting Fairness Principles into Practice: Challenges, Metrics, and Improvementscited by 70
- 2019Incorporating Priors with Feature Attribution on Text Classificationcited by 68
- 2018Fairness Through Computationally-Bounded Awarenesscited by 55
- 2020Learning Disentangled Semantic Representation for Domain Adaptationcited by 54
- 2021Directional Bias Amplificationcited by 54
- 2021Fair Preprocessing: Towards Understanding Compositional Fairness of Data Transformers in Machine Learning Pipelinecited by 49
- 2020Counterfactual Fairness with Disentangled Causal Effect Variational Autoencodercited by 45
- 2020Understanding Training Efficiency of Deep Learning Recommendation Models at Scalecited by 43
- 2020Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systemscited by 38
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2022: 2; 2023: 11; 2024: 4.
17 papers.
Sort:
By area:
- 2022Fairness in Recommendation: Foundations, Methods and Applicationscited by 27
- 2023Fairness of ChatGPTcited by 19
- 2023Improving Fairness in AI Models on Electronic Health Records: The Case for Federated Learning Methodscited by 17
- 2023Fairly Predicting Graft Failure in Liver Transplant for Organ Assigningcited by 7
- 2023Explaining CLIP's performance disparities on data from blind/low vision userscited by 7
- 2023Mitigating Group Bias in Federated Learning for Heterogeneous Devicescited by 5
- 2024Achieving Fairness Across Local and Global Models in Federated Learningcited by 5
- 2023Fairness Uncertainty Quantification: How certain are you that the model is fair?cited by 4
- 2023Holistic Survey of Privacy and Fairness in Machine Learningcited by 4
- 2023f-FERM: A Scalable Framework for Robust Fair Empirical Risk Minimizationcited by 4
- 2024Data vs. Model Machine Learning Fairness Testing: An Empirical Studycited by 4
- 2023Evaluating the Fairness of the MIMIC-IV Dataset and a Baseline Algorithm: Application to the ICU Length of Stay Predictioncited by 2
5 more
- 2023Towards Personalized Preprocessing Pipeline Searchcited by 1
- 2023Towards Assumption-free Bias Mitigationcited by 1
- 2024Debiasing Graph Representation Learning based on Information Bottleneckcited by 1
- 2022Neural Contrastive Clustering: Fully Unsupervised Bias Reduction for Sentiment Classificationcited by 0
- 2024Generalizing Fairness to Generative Language Models via Reformulation of Non-discrimination Criteriacited by 0
- 2024Debiasing Graph Representation Learning based on Information Bottleneck2 Sep 2024
- 2024Achieving Fairness Across Local and Global Models in Federated Learning24 Jun 2024
- 2024Generalizing Fairness to Generative Language Models via Reformulation of Non-discrimination Criteria13 Mar 2024
- 2024Data vs. Model Machine Learning Fairness Testing: An Empirical Study15 Jan 2024
- 2023Evaluating the Fairness of the MIMIC-IV Dataset and a Baseline Algorithm: Application to the ICU Length of Stay Prediction31 Dec 2023
- 2023f-FERM: A Scalable Framework for Robust Fair Empirical Risk Minimization6 Dec 2023
- 2023Explaining CLIP's performance disparities on data from blind/low vision users29 Nov 2023
- 2023Mitigating Group Bias in Federated Learning for Heterogeneous Devices13 Sep 2023
- 2023Holistic Survey of Privacy and Fairness in Machine Learning28 Jul 2023
- 2023Towards Assumption-free Bias Mitigation9 Jul 2023
- 2023Fairness of ChatGPT22 May 2023
- 2023Improving Fairness in AI Models on Electronic Health Records: The Case for Federated Learning Methods19 May 2023
5 more
- 2023Fairness Uncertainty Quantification: How certain are you that the model is fair?27 Apr 2023
- 2023Towards Personalized Preprocessing Pipeline Search28 Feb 2023
- 2023Fairly Predicting Graft Failure in Liver Transplant for Organ Assigning18 Feb 2023
- 2022Fairness in Recommendation: Foundations, Methods and Applications26 May 2022
- 2022Neural Contrastive Clustering: Fully Unsupervised Bias Reduction for Sentiment Classification22 Apr 2022
- 2022Fairness in Recommendation: Foundations, Methods and Applicationscited by 27
- 2023Fairness of ChatGPTcited by 19
- 2023Improving Fairness in AI Models on Electronic Health Records: The Case for Federated Learning Methodscited by 17
- 2023Fairly Predicting Graft Failure in Liver Transplant for Organ Assigningcited by 7
- 2023Mitigating Group Bias in Federated Learning for Heterogeneous Devicescited by 5
- 2024Achieving Fairness Across Local and Global Models in Federated Learningcited by 5
- 2023Fairness Uncertainty Quantification: How certain are you that the model is fair?cited by 4
- 2023Holistic Survey of Privacy and Fairness in Machine Learningcited by 4
- 2023f-FERM: A Scalable Framework for Robust Fair Empirical Risk Minimizationcited by 4
- 2024Data vs. Model Machine Learning Fairness Testing: An Empirical Studycited by 4
- 2023Evaluating the Fairness of the MIMIC-IV Dataset and a Baseline Algorithm: Application to the ICU Length of Stay Predictioncited by 2
- 2023Towards Personalized Preprocessing Pipeline Searchcited by 1
12 most cited of 16 All 16 (JSON)
- 2024Debiasing Graph Representation Learning based on Information Bottleneck2 Sep 2024
- 2024Achieving Fairness Across Local and Global Models in Federated Learning24 Jun 2024
- 2024Generalizing Fairness to Generative Language Models via Reformulation of Non-discrimination Criteria13 Mar 2024
- 2024Data vs. Model Machine Learning Fairness Testing: An Empirical Study15 Jan 2024
- 2023Evaluating the Fairness of the MIMIC-IV Dataset and a Baseline Algorithm: Application to the ICU Length of Stay Prediction31 Dec 2023
- 2023f-FERM: A Scalable Framework for Robust Fair Empirical Risk Minimization6 Dec 2023
- 2023Mitigating Group Bias in Federated Learning for Heterogeneous Devices13 Sep 2023
- 2023Holistic Survey of Privacy and Fairness in Machine Learning28 Jul 2023
- 2023Towards Assumption-free Bias Mitigation9 Jul 2023
- 2023Fairness of ChatGPT22 May 2023
- 2023Improving Fairness in AI Models on Electronic Health Records: The Case for Federated Learning Methods19 May 2023
- 2023Fairness Uncertainty Quantification: How certain are you that the model is fair?27 Apr 2023
12 newest of 16 All 16 (JSON)