A Pre-processing Method for Fairness in Ranking
Not on the map. Why?
Abstract (arXiv)
Fair ranking problems arise in many decision-making processes that often necessitate a trade-off between accuracy and fairness. Many existing studies have proposed correction methods such as adding fairness constraints to a ranking model's loss. However, the challenge of correcting the data bias for fair ranking remains, and the trade-off of the ranking models leaves room for improvement. In this paper, we propose a fair ranking framework that evaluates the order of training data in a pairwise manner as well as various fairness measurements in ranking. This study is the first proposal of a pre-processing method that solves fair ranking problems using the pairwise ordering method with our best knowledge. The fair pairwise ordering method is prominent in training the fair ranking models because it ensures that the resulting ranking likely becomes parity across groups. As far as the fairness measurements in ranking are represented as a linear constraint of the ranking models, we proved that the minimization of loss function subject to the constraints is reduced to the closed solution of the minimization problem augmented by weights to training data. This closed solution inspires us to present a practical and stable algorithm that iterates the optimization of weights and model parameters. The empirical results over real-world datasets demonstrated that our method outperforms the existing methods in the trade-off between accuracy and fairness over real-world datasets and various fairness measurements.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 17 of its 38 references that are in the map. First posted on arXiv 29 Oct 2021.
Builds on
17 of 38 references.
References · 17
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2018Fairness of Exposure in Rankingscited by 189
- 2019Identifying and Correcting Label Bias in Machine Learningcited by 146
- 2019Fairness in Recommendation Ranking through Pairwise Comparisonscited by 127
- 2013Introducing LETOR 4.0 Datasetscited by 120
- 2017FA*IR: A Fair Top-k Ranking Algorithmcited by 113
- 2018Optimization with Non-Differentiable Constraints with Applications to Fairness, Recall, Churn, and Other Goalscited by 103
- 2017Ranking with Fairness Constraintscited by 78
- 2019Policy Learning for Fairness in Rankingcited by 74
- 2021Fairness in Rankings and Recommendations: An Overviewcited by 62
- 2019Pairwise Fairness for Ranking and Regressioncited by 58
5 more
- 2018Two-Player Games for Efficient Non-Convex Constrained Optimizationcited by 55
- 2018Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent Constraintscited by 53
- 2018Reducing Disparate Exposure in Ranking: A Learning To Rank Approachcited by 33
- 2021Fairness in Ranking: A Surveycited by 33
- 2019Policy-Gradient Training of Fair and Unbiased Ranking Functionscited by 16
Built on by
Citing papers per year: 2022: 1; 2023: 2.
3 papers.
- 2022Fairness in Recommendation: Foundations, Methods and Applicationscited by 27
- 2023FairRec: Fairness Testing for Deep Recommender Systemscited by 3
- 2023The Role of Relevance in Fair Rankingcited by 3
- 2023The Role of Relevance in Fair Ranking9 May 2023
- 2023FairRec: Fairness Testing for Deep Recommender Systems14 Apr 2023
- 2022Fairness in Recommendation: Foundations, Methods and Applications26 May 2022