Fairness Under Group-Conditional Prior Probability Shift: Invariance, Drift, and Target-Aware Post-Processing
Not on the map. Why?
Abstract (arXiv)
Machine learning systems are often trained and evaluated for fairness on historical data, yet deployed in environments where conditions have shifted. A particularly common form of shift occurs when the prevalence of positive outcomes changes differently across demographic groups--for example, when disease rates rise faster in one population than another, or when economic conditions affect loan default rates unequally. We study group-conditional prior probability shift (GPPS), where the label prevalence P(Y=1mid A=a) may change between training and deployment while the feature-generation process P(Xmid Y,A) remains stable. Our analysis yields three main contributions. First, we prove a fundamental dichotomy: fairness criteria based on error rates (equalized odds) are structurally invariant under GPPS, while acceptance-rate criteria (demographic parity) can drift--and we prove this drift is unavoidable for non-trivial classifiers (shift-robust impossibility). Second, we show that target-domain risk and fairness metrics are identifiable without target labels: the invariance of ROC quantities under GPPS enables consistent estimation from source labels and unlabeled target data alone, with finite-sample guarantees. Third, we propose TAP-GPPS, a label-free post-processing algorithm that estimates prevalences from unlabeled data, corrects posteriors, and selects thresholds to satisfy demographic parity in the target domain. Experiments validate our theoretical predictions and demonstrate that TAP-GPPS achieves target fairness with minimal utility loss.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 31 references that are in the map. First posted on arXiv 5 Feb 2026.
Builds on
14 of 31 references.
References · 14
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2014Certifying and removing disparate impactcited by 715
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2017On Fairness and Calibrationcited by 406
- 2017Algorithmic decision making and the cost of fairnesscited by 402
- 2018Detecting and Correcting for Label Shift with Black Box Predictorscited by 364
- 2020Robust Fairness under Covariate Shiftcited by 58
- 2022Fairness Transferability Subject to Bounded Distribution Shiftcited by 28
- 2020Does enforcing fairness mitigate biases caused by subpopulation shift?cited by 25
2 more
Built on by
Citing papers per year: 2026: 1.
1 paper.