mlsanityData to 7 Oct 2026

Fix Representation (Optimally) Before Fairness: Finite-Sample Shrinkage Population Correction and the True Price of Fairness Under Subpopulation Shift

arXiv 2602.05707 ↗First posted 5 Feb 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine learning practitioners frequently observe tension between predictive accuracy and group fairness constraints -- yet sometimes fairness interventions appear to improve accuracy. We show that both phenomena can be artifacts of training data that misrepresents subgroup proportions. Under subpopulation shift (stable within-group distributions, shifted group proportions), we establish: (i) full importance-weighted correction is asymptotically unbiased but finite-sample suboptimal; (ii) the optimal finite-sample correction is a shrinkage reweighting that interpolates between target and training mixtures; (iii) apparent "fairness helps accuracy" can arise from comparing fairness methods to an improperly-weighted baseline. We provide an actionable evaluation protocol: fix representation (optimally) before fairness -- compare fairness interventions against a shrinkage-corrected baseline to isolate the true, irreducible price of fairness. Experiments on synthetic and real-world benchmarks (Adult, COMPAS) validate our theoretical predictions and demonstrate that this protocol eliminates spurious tradeoffs, revealing the genuine fairness-utility frontier.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 28 references that are in the map. First posted on arXiv 5 Feb 2026.

Builds on

13 of 28 references.

References · 13

  1. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  2. 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
  3. 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
  4. 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
  5. 2017On Fairness and Calibrationcited by 406
  6. 2018Detecting and Correcting for Label Shift with Black Box Predictorscited by 364
  7. 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 363
  8. 2018What is the Effect of Importance Weighting in Deep Learning?cited by 250
  9. 2020Robust Fairness under Covariate Shiftcited by 58
  10. 2019Recovering from Biased Data: Can Fairness Constraints Improve Accuracy?cited by 50
  11. 2020Does enforcing fairness mitigate biases caused by subpopulation shift?cited by 25
  12. 2019Robust Importance Weighting for Covariate Shiftcited by 14
1 more
  1. 2024Optimizing importance weighting in the presence of sub-population shiftscited by 3

Built on by

Not cited yet.