Balanced Off-Policy Evaluation for Personalized Pricing
Not on the map. Why?
Abstract (arXiv)
We consider a personalized pricing problem in which we have data consisting of feature information, historical pricing decisions, and binary realized demand. The goal is to perform off-policy evaluation for a new personalized pricing policy that maps features to prices. Methods based on inverse propensity weighting (including doubly robust methods) for off-policy evaluation may perform poorly when the logging policy has little exploration or is deterministic, which is common in pricing applications. Building on the balanced policy evaluation framework of Kallus (2018), we propose a new approach tailored to pricing applications. The key idea is to compute an estimate that minimizes the worst-case mean squared error or maximizes a worst-case lower bound on policy performance, where in both cases the worst-case is taken with respect to a set of possible revenue functions. We establish theoretical convergence guarantees and empirically demonstrate the advantage of our approach using a real-world pricing dataset.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 13 of its 49 references that are in the map. First posted on arXiv 24 Feb 2023.
Builds on
13 of 49 references.
References · 13
- 2016Data-Efficient Off-Policy Policy Evaluation for Reinforcement Learningcited by 285
- 2018Optimistic mirror descent in saddle-point problems: Going the extra (gradient) milecited by 132
- 2016Optimal and Adaptive Off-policy Evaluation in Contextual Banditscited by 111
- 2020Off-policy Bandits with Deficient Supportcited by 60
- 2018Policy Evaluation and Optimization with Continuous Treatmentscited by 57
- 2017Balanced Policy Evaluation and Learningcited by 51
- 2019Semi-Parametric Efficient Policy Learning with Continuous Actionscited by 26
- 2019More Efficient Policy Learning via Optimal Retargetingcited by 23
- 2020Deep Jump Learning for Off-Policy Evaluation in Continuous Treatment Settingscited by 14
- 2019Balanced off-policy evaluation in general action spacescited by 11
- 2020Uncertainty Quantification for Demand Prediction in Contextual Dynamic Pricingcited by 7
- 2021Loss Functions for Discrete Contextual Pricing with Observational Datacited by 6
1 more
- 2020Comment: Entropy Learning for Dynamic Treatment Regimescited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 0; 2026: 1.
5 papers.
- 2024Towards Foundation-model-based Multiagent System to Accelerate AI for Social Impactcited by 9
- 2024The Bandit Whisperer: Communication Learning for Restless Banditscited by 5
- 2023Confounding-Robust Policy Improvement with Human-AI Teamscited by 4
- 2023Statistically Efficient Variance Reduction with Double Policy Estimation for Off-Policy Evaluation in Sequence-Modeled Reinforcement Learningcited by 0
- 2026The Evidence Ladder for Reinforcement Learning in Healthcare: From Retrospective Policies to Trusted Interventionscited by 0
- 2026The Evidence Ladder for Reinforcement Learning in Healthcare: From Retrospective Policies to Trusted Interventions20 Sep 2026
- 2024Towards Foundation-model-based Multiagent System to Accelerate AI for Social Impact10 Dec 2024
- 2024The Bandit Whisperer: Communication Learning for Restless Bandits11 Aug 2024
- 2023Confounding-Robust Policy Improvement with Human-AI Teams13 Oct 2023
- 2023Statistically Efficient Variance Reduction with Double Policy Estimation for Off-Policy Evaluation in Sequence-Modeled Reinforcement Learning28 Aug 2023