Adapting Fairness Interventions to Missing Values
Not on the map. Why?
Abstract (arXiv)
Missing values in real-world data pose a significant and unique challenge to algorithmic fairness. Different demographic groups may be unequally affected by missing data, and the standard procedure for handling missing values where first data is imputed, then the imputed data is used for classification -- a procedure referred to as "impute-then-classify" -- can exacerbate discrimination. In this paper, we analyze how missing values affect algorithmic fairness. We first prove that training a classifier from imputed data can significantly worsen the achievable values of group fairness and average accuracy. This is because imputing data results in the loss of the missing pattern of the data, which often conveys information about the predictive label. We present scalable and adaptive algorithms for fair classification with missing values. These algorithms can be combined with any preexisting fairness-intervention algorithm to handle all possible missing patterns while preserving information encoded within the missing patterns. Numerical experiments with state-of-the-art fairness interventions demonstrate that our adaptive algorithms consistently achieve higher fairness and accuracy than impute-then-classify across different datasets.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 26 of its 62 references that are in the map. First posted on arXiv 30 May 2023.
Builds on
26 of 62 references.
References · 26
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2018A Reductions Approach to Fair Classificationcited by 585
- 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 443
- 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
- 2018Empirical Risk Minimization under Fairness Constraintscited by 226
- 2018Multiaccuracy: Black-Box Post-Processing for Fairness in Classificationcited by 221
- 2019Predictive Multiplicity in Classificationcited by 162
- 2018Classification with Fairness Constraints: A Meta-Algorithm with Provable Guaranteescited by 146
- 2019Identifying and Correcting Label Bias in Machine Learningcited by 146
- 2019Assessing Algorithmic Fairness with Unobserved Protected Class Using Data Combinationcited by 79
- 2015Supersparse Linear Integer Models for Optimized Medical Scoring Systemscited by 76
- 2021What's a good imputation to predict with missing values?cited by 61
14 more
- 2019Leveraging Labeled and Unlabeled Data for Consistent Fair Binary Classificationcited by 60
- 2019On the consistency of supervised learning with missing valuescited by 52
- 2020Can I Trust My Fairness Metric? Assessing Fairness with Unlabeled Data and Bayesian Inferencecited by 31
- 2021Fairness without Imputation: A Decision Tree Approach for Fair Prediction with Missing Valuescited by 24
- 2021Assessing Fairness in the Presence of Missing Datacited by 24
- 2022Benchmarking missing-values approaches for predictive models on health databasescited by 23
- 2020Linear predictor on linearly-generated data with missing values: non consistency and solutionscited by 20
- 2017On Fairness, Diversity and Randomness in Algorithmic Decision Makingcited by 17
- 2019FairPrep: Promoting Data to a First-Class Citizen in Studies on Fairness-Enhancing Interventionscited by 13
- 2022Fairness-aware Model-agnostic Positive and Unlabeled Learningcited by 10
- 2021Fairness in Missing Data Imputationcited by 8
- 2022Impact Of Missing Data Imputation On The Fairness And Accuracy Of Graph Node Classifierscited by 3
- 2018Bootstrapping and Multiple Imputation Ensemble Approaches for Missing Datacited by 2
- 2023Group Fairness with Uncertainty in Sensitive Attributescited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 1.
5 papers.
- 2024Exploring the Impact of Dataset Bias on Dataset Distillationcited by 4
- 2025Addressing Missing Data Issue for Diffusion-based Recommendationcited by 4
- 2024On the Maximal Local Disparity of Fairness-Aware Classifierscited by 3
- 2024Still More Shades of Null: An Evaluation Suite for Responsible Missing Value Imputationcited by 1
- 2023Fair Graph Machine Learning under Adversarial Missingness Processescited by 0
- 2025Addressing Missing Data Issue for Diffusion-based Recommendation18 May 2025
- 2024Still More Shades of Null: An Evaluation Suite for Responsible Missing Value Imputation11 Sep 2024
- 2024On the Maximal Local Disparity of Fairness-Aware Classifiers5 Jun 2024
- 2024Exploring the Impact of Dataset Bias on Dataset Distillation24 Mar 2024
- 2023Fair Graph Machine Learning under Adversarial Missingness Processes2 Nov 2023