A Control Function Framework for Mitigating Position Bias in Learning to Rank Systems
Not on the map. Why?
Abstract (arXiv)
Learning-to-rank (LTR) systems commonly depend on implicit feedback, such as user clicks, because it is easy to collect and can serve as a valuable signal of user preferences. However, directly optimizing ranking models using implicit feedback data often yields suboptimal performance because such data is inherently skewed by systematic biases. Among these biases, position bias is particularly pervasive: items ranked higher tend to receive disproportionately more interactions, regardless of their actual relevance. To address this, we introduce a novel two-stage framework based on control functions. In the first stage, we utilize exogenous variation from the residuals of the ranking process, which are then incorporated into a second stage click model to account for position-dependent distortions. In contrast to existing methods, our approach avoids explicit propensity estimation, supports nonlinear ranking models, and can be flexibly incorporated into any state-of-the-art ranking algorithm for position bias correction. We also propose a debiasing strategy for validation clicks that enables reliable hyperparameter tuning in the absence of unbiased validation data. Empirical results show that our method outperforms state-of-the-art position bias correction methods on both benchmark and real-world industrial datasets.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 17 of its 66 references that are in the map. First posted on arXiv 8 Jun 2025.
Builds on
17 of 66 references.
References · 17
- 2016Unbiased Learning-to-Rank with Biased Feedbackcited by 155
- 2013Introducing LETOR 4.0 Datasetscited by 120
- 2018Unbiased Learning to Rank with Unbiased Propensity Estimationcited by 61
- 2015Optimal Regret Analysis of Thompson Sampling in Stochastic Multi-armed Bandit Problem with Multiple Playscited by 38
- 2020Correcting for Selection Bias in Learning-to-rank Systemscited by 35
- 2018Estimating Position Bias without Intrusive Interventionscited by 31
- 2022Doubly Robust Off-Policy Evaluation for Ranking Policies under the Cascade Behavior Modelcited by 30
- 2022Doubly-Robust Estimation for Correcting Position-Bias in Click Feedback for Unbiased Learning to Rankcited by 17
- 2024Distributionally Robust Graph-based Recommendation Systemcited by 17
- 2018Intervention Harvesting for Context-Dependent Examination-Bias Estimationcited by 14
- 2022A Large Scale Search Dataset for Unbiased Learning to Rankcited by 13
- 2024Graph Representation Learning via Causal Diffusion for Out-of-Distribution Recommendationcited by 11
5 more
- 2024Unbiased Learning to Rank Meets Reality: Lessons from Baidu's Large-Scale Search Datasetcited by 10
- 2022Towards Disentangling Relevance and Bias in Unbiased Learning to Rankcited by 9
- 2022Model-based Unbiased Learning to Rankcited by 5
- 2020Counterfactual Learning to Rank using Heterogeneous Treatment Effect Estimationcited by 4
- 2022Approximated Doubly Robust Search Relevance Estimationcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.