Does enforcing fairness mitigate biases caused by subpopulation shift?
Not on the map. Why?
Abstract (arXiv)
Many instances of algorithmic bias are caused by subpopulation shifts. For example, ML models often perform worse on demographic groups that are underrepresented in the training data. In this paper, we study whether enforcing algorithmic fairness during training improves the performance of the trained model in the target domain. On one hand, we conceive scenarios in which enforcing fairness does not improve performance in the target domain. In fact, it may even harm performance. On the other hand, we derive necessary and sufficient conditions under which enforcing algorithmic fairness leads to the Bayes model in the target domain. We also illustrate the practical implications of our theoretical results in simulations and on real data.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 9; 2023: 7; 2024: 3; 2025: 3; 2026: 3.
25 papers.
Sort:
- 2022Improving the Fairness of Chest X-ray Classifierscited by 52
- 2023On the Independence of Association Bias and Empirical Fairness in Language Modelscited by 29
- 2022Subgroup Robustness Grows On Trees: An Empirical Baseline Investigationcited by 17
- 2023Improving Fair Training under Correlation Shiftscited by 14
- 2022Domain Adaptation meets Individual Fairness. And they get alongcited by 13
- 2022Certifying Some Distributional Fairness with Subpopulation Decompositioncited by 11
- 2022Input-agnostic Certified Group Fairness via Gaussian Parameter Smoothingcited by 11
- 2022Consistent Range Approximation for Fair Predictive Modelingcited by 7
- 2023Toward Operationalizing Pipeline-aware ML Fairness: A Research Agenda for Developing Practical Guidelines and Toolscited by 7
- 2022Metrizing Fairnesscited by 6
- 2023How Far Can Fairness Constraints Help Recover From Biased Data?cited by 5
- 2025Overcoming Fairness Trade-offs via Pre-processing: A Causal Perspectivecited by 5
13 more
- 2022Fairness in Forecasting of Observations of Linear Dynamical Systemscited by 4
- 2023f-FERM: A Scalable Framework for Robust Fair Empirical Risk Minimizationcited by 4
- 2023Domain Adaptive Decision Trees: Implications for Accuracy and Fairnesscited by 3
- 2024Is it Still Fair? A Comparative Evaluation of Fairness Algorithms through the Lens of Covariate Driftcited by 3
- 2022A Survey on Preserving Fairness Guarantees in Changing Environmentscited by 2
- 2024Microfoundation Inference for Strategic Predictioncited by 2
- 2025On Optimal Steering to Achieve Exact Fairnesscited by 2
- 2023On Comparing Fair Classifiers under Data Biascited by 1
- 2024A Note on Bias to Completecited by 1
- 2025Privilege Scorescited by 1
- 2026Fairness Under Group-Conditional Prior Probability Shift: Invariance, Drift, and Target-Aware Post-Processingcited by 1
- 2026Maximin Relative Improvement: Fair Learning as a Bargaining Problemcited by 0
- 2026Fix Representation (Optimally) Before Fairness: Finite-Sample Shrinkage Population Correction and the True Price of Fairness Under Subpopulation Shiftcited by 0
- 2026Fix Representation (Optimally) Before Fairness: Finite-Sample Shrinkage Population Correction and the True Price of Fairness Under Subpopulation Shift5 Feb 2026
- 2026Fairness Under Group-Conditional Prior Probability Shift: Invariance, Drift, and Target-Aware Post-Processing5 Feb 2026
- 2026Maximin Relative Improvement: Fair Learning as a Bargaining Problem4 Feb 2026
- 2025On Optimal Steering to Achieve Exact Fairness19 Sep 2025
- 2025Privilege Scores3 Feb 2025
- 2025Overcoming Fairness Trade-offs via Pre-processing: A Causal Perspective24 Jan 2025
- 2024Microfoundation Inference for Strategic Prediction13 Nov 2024
- 2024Is it Still Fair? A Comparative Evaluation of Fairness Algorithms through the Lens of Covariate Drift19 Sep 2024
- 2024A Note on Bias to Complete18 Feb 2024
- 2023How Far Can Fairness Constraints Help Recover From Biased Data?16 Dec 2023
- 2023f-FERM: A Scalable Framework for Robust Fair Empirical Risk Minimization6 Dec 2023
- 2023Toward Operationalizing Pipeline-aware ML Fairness: A Research Agenda for Developing Practical Guidelines and Tools29 Sep 2023
13 more
- 2023On the Independence of Association Bias and Empirical Fairness in Language Models20 Apr 2023
- 2023Domain Adaptive Decision Trees: Implications for Accuracy and Fairness27 Feb 2023
- 2023On Comparing Fair Classifiers under Data Bias12 Feb 2023
- 2023Improving Fair Training under Correlation Shifts5 Feb 2023
- 2022Consistent Range Approximation for Fair Predictive Modeling21 Dec 2022
- 2022Subgroup Robustness Grows On Trees: An Empirical Baseline Investigation23 Nov 2022
- 2022A Survey on Preserving Fairness Guarantees in Changing Environments14 Nov 2022
- 2022Fairness in Forecasting of Observations of Linear Dynamical Systems12 Sep 2022
- 2022Input-agnostic Certified Group Fairness via Gaussian Parameter Smoothing22 Jun 2022
- 2022Certifying Some Distributional Fairness with Subpopulation Decomposition31 May 2022
- 2022Metrizing Fairness30 May 2022
- 2022Domain Adaptation meets Individual Fairness. And they get along1 May 2022
- 2022Improving the Fairness of Chest X-ray Classifiers23 Mar 2022
- 2022Improving the Fairness of Chest X-ray Classifierscited by 52
- 2023On the Independence of Association Bias and Empirical Fairness in Language Modelscited by 29
- 2022Subgroup Robustness Grows On Trees: An Empirical Baseline Investigationcited by 17
- 2023Improving Fair Training under Correlation Shiftscited by 14
- 2022Domain Adaptation meets Individual Fairness. And they get alongcited by 13
- 2022Certifying Some Distributional Fairness with Subpopulation Decompositioncited by 11
- 2022Input-agnostic Certified Group Fairness via Gaussian Parameter Smoothingcited by 11
- 2022Consistent Range Approximation for Fair Predictive Modelingcited by 7
- 2023Toward Operationalizing Pipeline-aware ML Fairness: A Research Agenda for Developing Practical Guidelines and Toolscited by 7
- 2022Metrizing Fairnesscited by 6
- 2023How Far Can Fairness Constraints Help Recover From Biased Data?cited by 5
- 2025Overcoming Fairness Trade-offs via Pre-processing: A Causal Perspectivecited by 5
12 most cited of 25 All 25 (JSON)
- 2026Fix Representation (Optimally) Before Fairness: Finite-Sample Shrinkage Population Correction and the True Price of Fairness Under Subpopulation Shift5 Feb 2026
- 2026Fairness Under Group-Conditional Prior Probability Shift: Invariance, Drift, and Target-Aware Post-Processing5 Feb 2026
- 2026Maximin Relative Improvement: Fair Learning as a Bargaining Problem4 Feb 2026
- 2025On Optimal Steering to Achieve Exact Fairness19 Sep 2025
- 2025Privilege Scores3 Feb 2025
- 2025Overcoming Fairness Trade-offs via Pre-processing: A Causal Perspective24 Jan 2025
- 2024Microfoundation Inference for Strategic Prediction13 Nov 2024
- 2024Is it Still Fair? A Comparative Evaluation of Fairness Algorithms through the Lens of Covariate Drift19 Sep 2024
- 2024A Note on Bias to Complete18 Feb 2024
- 2023How Far Can Fairness Constraints Help Recover From Biased Data?16 Dec 2023
- 2023f-FERM: A Scalable Framework for Robust Fair Empirical Risk Minimization6 Dec 2023
- 2023Toward Operationalizing Pipeline-aware ML Fairness: A Research Agenda for Developing Practical Guidelines and Tools29 Sep 2023
12 newest of 25 All 25 (JSON)