Achieving Fairness through Adversarial Learning: an Application to Recidivism Prediction
Not on the map. Why?
Abstract (arXiv)
Recidivism prediction scores are used across the USA to determine sentencing and supervision for hundreds of thousands of inmates. One such generator of recidivism prediction scores is Northpointe's Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) score, used in states like California and Florida, which past research has shown to be biased against black inmates according to certain measures of fairness. To counteract this racial bias, we present an adversarially-trained neural network that predicts recidivism and is trained to remove racial bias. When comparing the results of our model to COMPAS, we gain predictive accuracy and get closer to achieving two out of three measures of fairness: parity and equality of odds. Our model can be generalized to any prediction and demographic. This piece of research contributes an example of scientific replication and simplification in a high-stakes real-world application like recidivism prediction.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 29; 2023: 14; 2024: 8; 2025: 4; 2026: 3.
77 papers.
Sort:
By area:
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2022A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learningcited by 104
- 2022Fair Contrastive Learning for Facial Attribute Classificationcited by 71
- 2021Fairness via Representation Neutralizationcited by 63
- 2022Improving the Fairness of Chest X-ray Classifierscited by 52
- 2022Detecting Shortcut Learning for Fair Medical AI using Shortcut Testingcited by 52
- 2022The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanationscited by 41
- 2022Representation Bias in Data: A Survey on Identification and Resolution Techniquescited by 37
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectivescited by 30
- 2024Identifying Implicit Social Biases in Vision-Language Modelscited by 27
- 2022Bayes-Optimal Classifiers under Group Fairnesscited by 24
- 2022FairDisCo: Fairer AI in Dermatology via Disentanglement Contrastive Learningcited by 22
38 more
- 2021Fairness without the sensitive attribute via Causal Variational Autoencodercited by 21
- 2021Algorithm Fairness in AI for Medicine and Healthcarecited by 21
- 2021Removing biased data to improve fairness and accuracycited by 17
- 2021Modeling Techniques for Machine Learning Fairness: A Surveycited by 17
- 2023On Fairness of Medical Image Classification with Multiple Sensitive Attributes via Learning Orthogonal Representationscited by 17
- 2022Fair Bayes-Optimal Classifiers Under Predictive Paritycited by 16
- 2021MIMIC-IF: Interpretability and Fairness Evaluation of Deep Learning Models on MIMIC-IV Datasetcited by 15
- 2021Fair Enough: Searching for Sufficient Measures of Fairnesscited by 14
- 2022Fairness Score and Process Standardization: Framework for Fairness Certification in Artificial Intelligence Systemscited by 14
- 2021Towards Equity and Algorithmic Fairness in Student Grade Predictioncited by 13
- 2023Learning for Counterfactual Fairness from Observational Datacited by 13
- 2022Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and Utilitycited by 12
- 2022Input-agnostic Certified Group Fairness via Gaussian Parameter Smoothingcited by 11
- 2022How Robust is Your Fairness? Evaluating and Sustaining Fairness under Unseen Distribution Shiftscited by 11
- 2021Equality of opportunity in travel behavior prediction with deep neural networks and discrete choice modelscited by 10
- 2021AI Fairness via Domain Adaptationcited by 8
- 2021Fairness in Missing Data Imputationcited by 8
- 2022Towards Equal Opportunity Fairness through Adversarial Learningcited by 8
- 2022A Fair Pricing Model via Adversarial Learningcited by 7
- 2021End-To-End Bias Mitigation: Removing Gender Bias in Deep Learningcited by 6
- 2021Can Information Flows Suggest Targets for Interventions in Neural Circuits?cited by 6
- 2023Toward responsible face datasets: modeling the distribution of a disentangled latent space for sampling face images from demographic groupscited by 6
- 2023Fairness and Sequential Decision Making: Limits, Lessons, and Opportunitiescited by 5
- 2023Implementing Responsible AI: Tensions and Trade-Offs Between Ethics Aspectscited by 5
- 2022fairlib: A Unified Framework for Assessing and Improving Classification Fairnesscited by 4
- 2022Fairness via In-Processing in the Over-parameterized Regime: A Cautionary Talecited by 4
- 2022Fairness-aware Regression Robust to Adversarial Attackscited by 4
- 2023Consistent End-to-End Estimation for Counterfactual Fairnesscited by 4
- 2021Fairness-aware Summarization for Justified Decision-Makingcited by 3
- 2023Backdoor for Debias: Mitigating Model Bias with Backdoor Attack-based Artificial Biascited by 3
- 2024Debiased Noise Editing on Foundation Models for Fair Medical Image Classificationcited by 3
- 2024FairREAD: Re-fusing Demographic Attributes after Disentanglement for Fair Medical Image Classificationcited by 3
- 2021Using Adversarial Debiasing to Remove Bias from Word Embeddingscited by 2
- 2022Prediction Sensitivity: Continual Audit of Counterfactual Fairness in Deployed Classifierscited by 2
- 2022Gradient Based Activations for Accurate Bias-Free Learningcited by 2
- 2023Improving Identity-Robustness for Face Modelscited by 2
- 2023TrojFair: Trojan Fairness Attackscited by 2
- 2024Learning Fairer Representations with FairVICcited by 2
50 most cited of 77 All 77 (JSON)
- 2026Worst-Group Equalized Odds Regularization for Multi-Attribute Fair Medical Image Classification19 May 2026
- 2026Stride-Net: Fairness-Aware Disentangled Representation Learning for Chest X-Ray Diagnosis11 Feb 2026
- 2026SHaSaM: Submodular Hard Sample Mining for Fair Facial Attribute Recognition5 Feb 2026
- 2025Machine Learning with Multitype Protected Attributes: Intersectional Fairness through Regularisation9 Sep 2025
- 2025Explaining How Quantization Disparately Skews a Model8 Sep 2025
- 2025FairDRL-ST: Disentangled Representation Learning for Fair Spatio-Temporal Mobility Prediction11 Aug 2025
- 2025General Post-Processing Framework for Fairness Adjustment of Machine Learning Models22 Apr 2025
- 2024FairREAD: Re-fusing Demographic Attributes after Disentanglement for Fair Medical Image Classification20 Dec 2024
- 2024Identifying Implicit Social Biases in Vision-Language Models1 Nov 2024
- 2024Balancing the Scales: Reinforcement Learning for Fair Classification15 Jul 2024
- 2024Provable Optimization for Adversarial Fair Self-supervised Contrastive Learning9 Jun 2024
- 2024Learning Fairer Representations with FairVIC28 Apr 2024
38 more
- 2024OptiGrad: A Fair and more Efficient Price Elasticity Optimization via a Gradient Based Learning16 Apr 2024
- 2024Debiased Noise Editing on Foundation Models for Fair Medical Image Classification10 Mar 2024
- 2024Improving Fairness of Automated Chest X-ray Diagnosis by Contrastive Learning25 Jan 2024
- 2023TrojFair: Trojan Fairness Attacks16 Dec 2023
- 2023Adversarial Reweighting Guided by Wasserstein Distance for Bias Mitigation21 Nov 2023
- 2023Consistent End-to-End Estimation for Counterfactual Fairness26 Oct 2023
- 2023Toward responsible face datasets: modeling the distribution of a disentangled latent space for sampling face images from demographic groups15 Sep 2023
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectives31 Jul 2023
- 2023Learning for Counterfactual Fairness from Observational Data17 Jul 2023
- 2023Towards Assumption-free Bias Mitigation9 Jul 2023
- 2023Implementing Responsible AI: Tensions and Trade-Offs Between Ethics Aspects17 Apr 2023
- 2023Improving Identity-Robustness for Face Models7 Apr 2023
- 2023Implicit Visual Bias Mitigation by Posterior Estimate Sharpening of a Bayesian Neural Network29 Mar 2023
- 2023Backdoor for Debias: Mitigating Model Bias with Backdoor Attack-based Artificial Bias1 Mar 2023
- 2023Evaluating Trade-offs in Computer Vision Between Attribute Privacy, Fairness and Utility15 Feb 2023
- 2023Fairness and Sequential Decision Making: Limits, Lessons, and Opportunities13 Jan 2023
- 2023On Fairness of Medical Image Classification with Multiple Sensitive Attributes via Learning Orthogonal Representations4 Jan 2023
- 2022A Seven-Layer Model for Standardising AI Fairness Assessment21 Dec 2022
- 2022Fairness-aware Regression Robust to Adversarial Attacks4 Nov 2022
- 2022How Technology Impacts and Compares to Humans in Socially Consequential Arenas2 Nov 2022
- 2022Fairness via Adversarial Attribute Neighbourhood Robust Learning12 Oct 2022
- 2022Improving Data-Efficient Fossil Segmentation via Model Editing8 Oct 2022
- 2022FairDisCo: Fairer AI in Dermatology via Disentanglement Contrastive Learning22 Aug 2022
- 2022Detecting Shortcut Learning for Fair Medical AI using Shortcut Testing21 Jul 2022
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey14 Jul 2022
- 2022Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and Utility11 Jul 2022
- 2022How Robust is Your Fairness? Evaluating and Sustaining Fairness under Unseen Distribution Shifts4 Jul 2022
- 2022Fairness via In-Processing in the Over-parameterized Regime: A Cautionary Tale29 Jun 2022
- 2022Input-agnostic Certified Group Fairness via Gaussian Parameter Smoothing22 Jun 2022
- 2022Classification Utility, Fairness, and Compactness via Tunable Information Bottleneck and R'enyi Measures20 Jun 2022
- 2022Fair Bayes-Optimal Classifiers Under Predictive Parity15 May 2022
- 2022The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanations6 May 2022
- 2022On Disentangled and Locally Fair Representations5 May 2022
- 2022fairlib: A Unified Framework for Assessing and Improving Classification Fairness4 May 2022
- 2022Fair Contrastive Learning for Facial Attribute Classification30 Mar 2022
- 2022Improving the Fairness of Chest X-ray Classifiers23 Mar 2022
- 2022A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning22 Mar 2022
- 2022Representation Bias in Data: A Survey on Identification and Resolution Techniques22 Mar 2022
50 newest of 77 All 77 (JSON)
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2022Fair Contrastive Learning for Facial Attribute Classificationcited by 71
- 2021Fairness via Representation Neutralizationcited by 63
- 2022Improving the Fairness of Chest X-ray Classifierscited by 52
- 2022Detecting Shortcut Learning for Fair Medical AI using Shortcut Testingcited by 52
- 2022The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanationscited by 41
- 2022Representation Bias in Data: A Survey on Identification and Resolution Techniquescited by 37
- 2022Bayes-Optimal Classifiers under Group Fairnesscited by 24
- 2022FairDisCo: Fairer AI in Dermatology via Disentanglement Contrastive Learningcited by 22
- 2021Fairness without the sensitive attribute via Causal Variational Autoencodercited by 21
- 2021Algorithm Fairness in AI for Medicine and Healthcarecited by 21
- 2021Removing biased data to improve fairness and accuracycited by 17
12 most cited of 74 All 74 (JSON)
- 2026Worst-Group Equalized Odds Regularization for Multi-Attribute Fair Medical Image Classification19 May 2026
- 2026Stride-Net: Fairness-Aware Disentangled Representation Learning for Chest X-Ray Diagnosis11 Feb 2026
- 2026SHaSaM: Submodular Hard Sample Mining for Fair Facial Attribute Recognition5 Feb 2026
- 2025Machine Learning with Multitype Protected Attributes: Intersectional Fairness through Regularisation9 Sep 2025
- 2025Explaining How Quantization Disparately Skews a Model8 Sep 2025
- 2025FairDRL-ST: Disentangled Representation Learning for Fair Spatio-Temporal Mobility Prediction11 Aug 2025
- 2025General Post-Processing Framework for Fairness Adjustment of Machine Learning Models22 Apr 2025
- 2024FairREAD: Re-fusing Demographic Attributes after Disentanglement for Fair Medical Image Classification20 Dec 2024
- 2024Balancing the Scales: Reinforcement Learning for Fair Classification15 Jul 2024
- 2024Provable Optimization for Adversarial Fair Self-supervised Contrastive Learning9 Jun 2024
- 2024Learning Fairer Representations with FairVIC28 Apr 2024
- 2024OptiGrad: A Fair and more Efficient Price Elasticity Optimization via a Gradient Based Learning16 Apr 2024
12 newest of 74 All 74 (JSON)