Additive Control Variates Dominate Self-Normalisation in Off-Policy Evaluation
Not on the map. Why?
Abstract (arXiv)
Off-policy evaluation (OPE) is essential for assessing ranking and recommendation systems without costly online interventions. Self-Normalised Inverse Propensity Scoring (SNIPS) is a standard tool for variance reduction in OPE, leveraging a multiplicative control variate. Recent advances in off-policy learning suggest that additive control variates (baseline corrections) may offer superior performance, yet theoretical guarantees for evaluation are lacking. This paper provides a definitive answer: we prove that β^star-IPS, an estimator with an optimal additive baseline, asymptotically dominates SNIPS in Mean Squared Error. By analytically decomposing the variance gap, we show that SNIPS is asymptotically equivalent to using a specific -- but generally sub-optimal -- additive baseline. Our results theoretically justify shifting from self-normalisation to optimal baseline corrections for both ranking and recommendation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 31 references that are in the map. First posted on arXiv 16 Feb 2026.
Builds on
12 of 31 references.
References · 12
- 2016Off-policy evaluation for slate recommendationcited by 102
- 2018Offline A/B testing for Recommender Systemscited by 94
- 2018Offline Evaluation of Ranking Policies with Click Modelscited by 32
- 2021Evaluating the Robustness of Off-Policy Evaluationcited by 32
- 2021Control Variates for Slate Off-Policy Evaluationcited by 13
- 2023On (Normalised) Discounted Cumulative Gain as an Off-Policy Evaluation Metric for Top-n Recommendationcited by 13
- 2024Optimal Baseline Corrections for Off-Policy Contextual Banditscited by 13
- 2023Safe Deployment for Counterfactual Learning to Rank with Exposure-Based Risk Minimizationcited by 11
- 2023Ad-load Balancing via Off-policy Learning in a Content Marketplacecited by 11
- 2024Multi-Objective Recommendation via Multivariate Policy Learningcited by 10
- 2023Practical Bandits: An Industry Perspectivecited by 9
- 2024Delta-rm OPE: Off-Policy Estimation with Pairs of Policiescited by 9
Built on by
Citing papers per year: 2026: 2.
2 papers.