Multiaccurate Proxies for Downstream Fairness
Not on the map. Why?
Abstract (arXiv)
We study the problem of training a model that must obey demographic fairness conditions when the sensitive features are not available at training time -- in other words, how can we train a model to be fair by race when we don't have data about race? We adopt a fairness pipeline perspective, in which an "upstream" learner that does have access to the sensitive features will learn a proxy model for these features from the other attributes. The goal of the proxy is to allow a general "downstream" learner -- with minimal assumptions on their prediction task -- to be able to use the proxy to train a model that is fair with respect to the true sensitive features. We show that obeying multiaccuracy constraints with respect to the downstream model class suffices for this purpose, provide sample- and oracle efficient-algorithms and generalization bounds for learning such proxies, and conduct an experimental evaluation. In general, multiaccuracy is much easier to satisfy than classification accuracy, and can be satisfied even when the sensitive features are hard to predict.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 19 of its 41 references that are in the map. First posted on arXiv 9 Jul 2021.
Builds on
19 of 41 references.
References · 19
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
- 2018A Reductions Approach to Fair Classificationcited by 585
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
- 2020Fairness without Demographics through Adversarially Reweighted Learningcited by 251
- 2018Multiaccuracy: Black-Box Post-Processing for Fairness in Classificationcited by 221
- 2020Minimax Pareto Fairness: A Multi Objective Perspectivecited by 152
- 2018Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobservedcited by 94
- 2019Assessing Algorithmic Fairness with Unobserved Protected Class Using Data Combinationcited by 79
- 2020Robust Optimization for Fairness with Noisy Protected Groupscited by 78
- 2018Differentially Private Fair Learningcited by 76
- 2020Moment Multicalibration for Uncertainty Estimationcited by 63
- 2019Equalized odds postprocessing under imperfect group informationcited by 48
7 more
- 2018Blind Justice: Fairness with Encrypted Sensitive Attributescited by 41
- 2018Downstream Effects of Affirmative Actioncited by 34
- 2021Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Informationcited by 33
- 2020Mitigating Bias in Set Selection with Noisy Protected Attributescited by 29
- 2020Individual Fairness in Pipelinescited by 22
- 2017Fair Pipelinescited by 21
- 2021Lexicographically Fair Learning: Algorithms and Generalizationcited by 4
Built on by
Citing papers per year: 2021: 2; 2022: 7; 2023: 4; 2024: 2; 2025: 1; 2026: 1.
17 papers.
Sort:
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2021The Rich Get Richer: Disparate Impact of Semi-Supervised Learningcited by 28
- 2021Simple and near-optimal algorithms for hidden stratification and multi-group learningcited by 26
- 2023Ground(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Makingcited by 25
- 2022Weak Proxies are Sufficient and Preferable for Fairness with Missing Sensitive Attributescited by 17
- 2022Multicalibrated Regression for Downstream Fairnesscited by 13
- 2022Comparative Learning: A Sample Complexity Theory for Two Hypothesis Classescited by 8
- 2024Fairness without Sensitive Attributes via Knowledge Sharingcited by 6
- 2023Fairness Under Demographic Scarce Regimecited by 4
- 2023Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learningcited by 4
- 2022Context matters for fairness -- a case study on the effect of spatial distribution shiftscited by 3
- 2022"You Can't Fix What You Can't Measure": Privately Measuring Demographic Performance Disparities in Federated Learningcited by 3
5 more
- 2022Distributionally Robust Data Joincited by 2
- 2025Multiaccuracy and Multicalibration via Proxy Groupscited by 1
- 2026Safe Fairness Guarantees Without Demographics in Classification: Spectral Uncertainty Set Perspectivecited by 1
- 2023Balanced Filtering via Disclosure-Controlled Proxiescited by 0
- 2024Dancing in the Shadows: Harnessing Ambiguity for Fairer Classifierscited by 0
- 2026Safe Fairness Guarantees Without Demographics in Classification: Spectral Uncertainty Set Perspective12 Feb 2026
- 2025Multiaccuracy and Multicalibration via Proxy Groups4 Mar 2025
- 2024Fairness without Sensitive Attributes via Knowledge Sharing27 Sep 2024
- 2024Dancing in the Shadows: Harnessing Ambiguity for Fairer Classifiers27 Jun 2024
- 2023Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learning30 Nov 2023
- 2023Fairness Under Demographic Scarce Regime24 Jul 2023
- 2023Balanced Filtering via Disclosure-Controlled Proxies26 Jun 2023
- 2023Ground(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Making13 Feb 2023
- 2022Comparative Learning: A Sample Complexity Theory for Two Hypothesis Classes16 Nov 2022
- 2022Weak Proxies are Sufficient and Preferable for Fairness with Missing Sensitive Attributes6 Oct 2022
- 2022Multicalibrated Regression for Downstream Fairness15 Sep 2022
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey14 Jul 2022
5 more
- 2022"You Can't Fix What You Can't Measure": Privately Measuring Demographic Performance Disparities in Federated Learning24 Jun 2022
- 2022Context matters for fairness -- a case study on the effect of spatial distribution shifts23 Jun 2022
- 2022Distributionally Robust Data Join11 Feb 2022
- 2021Simple and near-optimal algorithms for hidden stratification and multi-group learning22 Dec 2021
- 2021The Rich Get Richer: Disparate Impact of Semi-Supervised Learning12 Oct 2021
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
- 2021The Rich Get Richer: Disparate Impact of Semi-Supervised Learningcited by 28
- 2021Simple and near-optimal algorithms for hidden stratification and multi-group learningcited by 26
- 2023Ground(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Makingcited by 25
- 2022Weak Proxies are Sufficient and Preferable for Fairness with Missing Sensitive Attributescited by 17
- 2022Multicalibrated Regression for Downstream Fairnesscited by 13
- 2022Comparative Learning: A Sample Complexity Theory for Two Hypothesis Classescited by 8
- 2024Fairness without Sensitive Attributes via Knowledge Sharingcited by 6
- 2023Fairness Under Demographic Scarce Regimecited by 4
- 2023Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learningcited by 4
- 2022Context matters for fairness -- a case study on the effect of spatial distribution shiftscited by 3
- 2022"You Can't Fix What You Can't Measure": Privately Measuring Demographic Performance Disparities in Federated Learningcited by 3
12 most cited of 17 All 17 (JSON)
- 2026Safe Fairness Guarantees Without Demographics in Classification: Spectral Uncertainty Set Perspective12 Feb 2026
- 2025Multiaccuracy and Multicalibration via Proxy Groups4 Mar 2025
- 2024Fairness without Sensitive Attributes via Knowledge Sharing27 Sep 2024
- 2024Dancing in the Shadows: Harnessing Ambiguity for Fairer Classifiers27 Jun 2024
- 2023Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learning30 Nov 2023
- 2023Fairness Under Demographic Scarce Regime24 Jul 2023
- 2023Balanced Filtering via Disclosure-Controlled Proxies26 Jun 2023
- 2023Ground(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Making13 Feb 2023
- 2022Comparative Learning: A Sample Complexity Theory for Two Hypothesis Classes16 Nov 2022
- 2022Weak Proxies are Sufficient and Preferable for Fairness with Missing Sensitive Attributes6 Oct 2022
- 2022Multicalibrated Regression for Downstream Fairness15 Sep 2022
- 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey14 Jul 2022
12 newest of 17 All 17 (JSON)