Equalized odds postprocessing under imperfect group information
Not on the map. Why?
Abstract (arXiv)
Most approaches aiming to ensure a model's fairness with respect to a protected attribute (such as gender or race) assume to know the true value of the attribute for every data point. In this paper, we ask to what extent fairness interventions can be effective even when only imperfect information about the protected attribute is available. In particular, we study the prominent equalized odds postprocessing method of Hardt et al. (2016) under a perturbation of the attribute. We identify conditions on the perturbation that guarantee that the bias of a classifier is reduced even by running equalized odds with the perturbed attribute. We also study the error of the resulting classifier. We empirically observe that under our identified conditions most often the error does not suffer from a perturbation of the protected attribute. For a special case, we formally prove this observation to be true.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 9; 2023: 9; 2024: 10; 2025: 5; 2026: 3.
48 papers.
Sort:
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2021Sample Selection for Fair and Robust Trainingcited by 48
- 2021Your fairness may vary: Pretrained language model fairness in toxic text classificationcited by 38
- 2021Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Informationcited by 33
- 2022Fairness Reprogrammingcited by 33
- 2021Fairness for Image Generation with Uncertain Sensitive Attributescited by 31
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-offcited by 26
- 2021Fair Classification with Adversarial Perturbationscited by 23
- 2021Fairness-Aware PAC Learning from Corrupted Datacited by 18
- 2021Multiaccurate Proxies for Downstream Fairnesscited by 17
- 2022Fair Ranking with Noisy Protected Attributescited by 17
- 2021Fair Sequential Selection Using Supervised Learning Modelscited by 16
36 more
- 2024OxonFair: A Flexible Toolkit for Algorithmic Fairnesscited by 12
- 2022FAIR-FATE: Fair Federated Learning with Momentumcited by 10
- 2021Measuring Fairness Under Unawareness of Sensitive Attributes: A Quantification-Based Approachcited by 9
- 2024FairJob: A Real-World Dataset for Fairness in Online Systemscited by 6
- 2024Exploring Bias and Prediction Metrics to Characterise the Fairness of Machine Learning for Equity-Centered Public Health Decision-Making: A Narrative Reviewcited by 6
- 2021FairBalance: How to Achieve Equalized Odds With Data Pre-processingcited by 5
- 2022Estimating and Controlling for Equalized Odds via Sensitive Attribute Predictorscited by 5
- 2022Breaking Fair Binary Classification with Optimal Flipping Attackscited by 4
- 2023Equalised Odds is not Equal Individual Odds: Post-processing for Group and Individual Fairnesscited by 4
- 2023Fairness in Ranking under Disparate Uncertaintycited by 4
- 2023Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learningcited by 4
- 2024Stability and Multigroup Fairness in Ranking with Uncertain Predictionscited by 4
- 2024Learning With Multi-Group Guarantees For Clusterable Subpopulationscited by 3
- 2025Fair Text Classification via Transferable Representationscited by 3
- 2021Hard Choices and Hard Limits for Artificial Intelligencecited by 2
- 2021Dataset Bias Mitigation Through Analysis of CNN Training Scorescited by 2
- 2022How Robust is your Fair Model? Exploring the Robustness of Diverse Fairness Strategiescited by 2
- 2022A Survey on Preserving Fairness Guarantees in Changing Environmentscited by 2
- 2023Group Fairness with Uncertainty in Sensitive Attributescited by 2
- 2023Gender Bias in Transformer Models: A comprehensive surveycited by 2
- 2023Sampling Individually-Fair Rankings that are Always Group Faircited by 2
- 2023Fair Active Learning in Low-Data Regimescited by 2
- 2024Multi-Output Distributional Fairness via Post-Processingcited by 2
- 2024Fairness in Ranking: Robustness through Randomization without the Protected Attributecited by 1
- 2024Robust Fair Clustering with Group Membership Uncertainty Setscited by 1
- 2024Fair Clustering: Critique, Caveats, and Future Directionscited by 1
- 2025Multiaccuracy and Multicalibration via Proxy Groupscited by 1
- 2022Are Your Reviewers Being Treated Equally? Discovering Subgroup Structures to Improve Fairness in Spam Detectioncited by 0
- 2023Integrating Fairness and Model Pruning Through Bi-level Optimizationcited by 0
- 2024Text-to-Image Representativity Fairness Evaluation Frameworkcited by 0
- 2025FairUDT: Fairness-aware Uplift Decision Treescited by 0
- 2025FairSAM: Fair Classification on Corrupted Image Data Through Sharpness-Aware Minimizationcited by 0
- 2025FedPF: Accurate Target Privacy Preserving Federated Learning Balancing Fairness and Utilitycited by 0
- 2026Rank-Constrained Adaptation for Reliable Real-World Performancecited by 0
- 2026Geometry of Relaxed Fair Regression: A Unified Framework for Aware and Unaware Settingscited by 0
- 2026Beyond Aggregate Calibration: Decomposing Income-Conditional Recall Disparities in Automated Credit Default Predictioncited by 0
- 2026Beyond Aggregate Calibration: Decomposing Income-Conditional Recall Disparities in Automated Credit Default Prediction8 Aug 2026
- 2026Geometry of Relaxed Fair Regression: A Unified Framework for Aware and Unaware Settings27 May 2026
- 2026Rank-Constrained Adaptation for Reliable Real-World Performance6 Feb 2026
- 2025FedPF: Accurate Target Privacy Preserving Federated Learning Balancing Fairness and Utility30 Oct 2025
- 2025FairSAM: Fair Classification on Corrupted Image Data Through Sharpness-Aware Minimization29 Mar 2025
- 2025Fair Text Classification via Transferable Representations10 Mar 2025
- 2025Multiaccuracy and Multicalibration via Proxy Groups4 Mar 2025
- 2025FairUDT: Fairness-aware Uplift Decision Trees3 Feb 2025
- 2024Learning With Multi-Group Guarantees For Clusterable Subpopulations18 Oct 2024
- 2024Text-to-Image Representativity Fairness Evaluation Framework18 Oct 2024
- 2024Multi-Output Distributional Fairness via Post-Processing31 Aug 2024
- 2024Exploring Bias and Prediction Metrics to Characterise the Fairness of Machine Learning for Equity-Centered Public Health Decision-Making: A Narrative Review23 Aug 2024
36 more
- 2024FairJob: A Real-World Dataset for Fairness in Online Systems3 Jul 2024
- 2024OxonFair: A Flexible Toolkit for Algorithmic Fairness30 Jun 2024
- 2024Fair Clustering: Critique, Caveats, and Future Directions22 Jun 2024
- 2024Robust Fair Clustering with Group Membership Uncertainty Sets2 Jun 2024
- 2024Fairness in Ranking: Robustness through Randomization without the Protected Attribute28 Mar 2024
- 2024Stability and Multigroup Fairness in Ranking with Uncertain Predictions14 Feb 2024
- 2023Integrating Fairness and Model Pruning Through Bi-level Optimization15 Dec 2023
- 2023Fair Active Learning in Low-Data Regimes13 Dec 2023
- 2023Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learning30 Nov 2023
- 2023Fairness in Ranking under Disparate Uncertainty4 Sep 2023
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-off25 Jun 2023
- 2023Sampling Individually-Fair Rankings that are Always Group Fair21 Jun 2023
- 2023Gender Bias in Transformer Models: A comprehensive survey18 Jun 2023
- 2023Equalised Odds is not Equal Individual Odds: Post-processing for Group and Individual Fairness19 Apr 2023
- 2023Group Fairness with Uncertainty in Sensitive Attributes16 Feb 2023
- 2022Fair Ranking with Noisy Protected Attributes30 Nov 2022
- 2022A Survey on Preserving Fairness Guarantees in Changing Environments14 Nov 2022
- 2022FAIR-FATE: Fair Federated Learning with Momentum27 Sep 2022
- 2022Fairness Reprogramming21 Sep 2022
- 2022Estimating and Controlling for Equalized Odds via Sensitive Attribute Predictors25 Jul 2022
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey14 Jul 2022
- 2022How Robust is your Fair Model? Exploring the Robustness of Diverse Fairness Strategies11 Jul 2022
- 2022Are Your Reviewers Being Treated Equally? Discovering Subgroup Structures to Improve Fairness in Spam Detection24 Apr 2022
- 2022Breaking Fair Binary Classification with Optimal Flipping Attacks12 Apr 2022
- 2021Sample Selection for Fair and Robust Training27 Oct 2021
- 2021Fair Sequential Selection Using Supervised Learning Models26 Oct 2021
- 2021Measuring Fairness Under Unawareness of Sensitive Attributes: A Quantification-Based Approach17 Sep 2021
- 2021Your fairness may vary: Pretrained language model fairness in toxic text classification3 Aug 2021
- 2021FairBalance: How to Achieve Equalized Odds With Data Pre-processing17 Jul 2021
- 2021Multiaccurate Proxies for Downstream Fairness9 Jul 2021
- 2021Dataset Bias Mitigation Through Analysis of CNN Training Scores28 Jun 2021
- 2021Fairness for Image Generation with Uncertain Sensitive Attributes23 Jun 2021
- 2021Fair Classification with Adversarial Perturbations10 Jun 2021
- 2021Hard Choices and Hard Limits for Artificial Intelligence4 May 2021
- 2021Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Information16 Feb 2021
- 2021Fairness-Aware PAC Learning from Corrupted Data11 Feb 2021
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2021Sample Selection for Fair and Robust Trainingcited by 48
- 2021Your fairness may vary: Pretrained language model fairness in toxic text classificationcited by 38
- 2021Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Informationcited by 33
- 2022Fairness Reprogrammingcited by 33
- 2021Fairness for Image Generation with Uncertain Sensitive Attributescited by 31
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-offcited by 26
- 2021Fair Classification with Adversarial Perturbationscited by 23
- 2021Fairness-Aware PAC Learning from Corrupted Datacited by 18
- 2021Multiaccurate Proxies for Downstream Fairnesscited by 17
- 2022Fair Ranking with Noisy Protected Attributescited by 17
- 2021Fair Sequential Selection Using Supervised Learning Modelscited by 16
12 most cited of 48 All 48 (JSON)
- 2026Beyond Aggregate Calibration: Decomposing Income-Conditional Recall Disparities in Automated Credit Default Prediction8 Aug 2026
- 2026Geometry of Relaxed Fair Regression: A Unified Framework for Aware and Unaware Settings27 May 2026
- 2026Rank-Constrained Adaptation for Reliable Real-World Performance6 Feb 2026
- 2025FedPF: Accurate Target Privacy Preserving Federated Learning Balancing Fairness and Utility30 Oct 2025
- 2025FairSAM: Fair Classification on Corrupted Image Data Through Sharpness-Aware Minimization29 Mar 2025
- 2025Fair Text Classification via Transferable Representations10 Mar 2025
- 2025Multiaccuracy and Multicalibration via Proxy Groups4 Mar 2025
- 2025FairUDT: Fairness-aware Uplift Decision Trees3 Feb 2025
- 2024Learning With Multi-Group Guarantees For Clusterable Subpopulations18 Oct 2024
- 2024Text-to-Image Representativity Fairness Evaluation Framework18 Oct 2024
- 2024Multi-Output Distributional Fairness via Post-Processing31 Aug 2024
- 2024Exploring Bias and Prediction Metrics to Characterise the Fairness of Machine Learning for Equity-Centered Public Health Decision-Making: A Narrative Review23 Aug 2024
12 newest of 48 All 48 (JSON)