mlsanityData to 7 Oct 2026

Fair Regression under Sample Selection Bias

arXiv 2110.04372 ↗First posted 8 Oct 2021cs.LG cs.AI cs.CYcited by 3

Not on the map. Why?

Abstract (arXiv)

Recent research on fair regression focused on developing new fairness notions and approximation methods as target variables and even the sensitive attribute are continuous in the regression setting. However, all previous fair regression research assumed the training data and testing data are drawn from the same distributions. This assumption is often violated in real world due to the sample selection bias between the training and testing data. In this paper, we develop a framework for fair regression under sample selection bias when dependent variable values of a set of samples from the training data are missing as a result of another hidden process. Our framework adopts the classic Heckman model for bias correction and the Lagrange duality to achieve fairness in regression based on a variety of fairness notions. Heckman model describes the sample selection process and uses a derived variable called the Inverse Mills Ratio (IMR) to correct sample selection bias. We use fairness inequality and equality constraints to describe a variety of fairness notions and apply the Lagrange duality theory to transform the primal problem into the dual convex optimization. For the two popular fairness notions, mean difference and mean squared error difference, we derive explicit formulas without iterative optimization, and for Pearson correlation, we derive its conditions of achieving strong duality. We conduct experiments on three real-world datasets and the experimental results demonstrate the approach's effectiveness in terms of both utility and fairness metrics.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 18 of its 38 references that are in the map. First posted on arXiv 8 Oct 2021.

Builds on

18 of 38 references.

References · 18

  1. 2021Convex optimizationcited by 2,479
  2. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  3. 2018A Reductions Approach to Fair Classificationcited by 585
  4. 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
  5. 2019Fair Regression: Quantitative Definitions and Reduction-based Algorithmscited by 168
  6. 2017A Convex Framework for Fair Regressioncited by 147
  7. 2019Identifying and Correcting Label Bias in Machine Learningcited by 146
  8. 2020Fair Regression with Wasserstein Barycenterscited by 99
  9. 2020Fairness-aware Agnostic Federated Learningcited by 87
  10. 2019Pairwise Fairness for Ranking and Regressioncited by 58
  11. 2018Residual Unfairness in Fair Machine Learning from Prejudiced Datacited by 49
  12. 2020A Distributionally Robust Approach to Fair Classificationcited by 43
6 more
  1. 2019Transfer of Machine Learning Fairness across Domainscited by 36
  2. 2018A General Framework for Fair Regressioncited by 13
  3. 2020Fast Fair Regression via Efficient Approximations of Mutual Informationcited by 10
  4. 2020Unfairness Discovery and Prevention For Few-Shot Regressioncited by 10
  5. 2019Statistical Learning from Biased Training Samplescited by 4
  6. 2020Projection to Fairness in Statistical Learningcited by 3

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 1.

3 papers.