A Primal-Dual Online Learning Approach for Dynamic Pricing of Sequentially Displayed Complementary Items under Sale Constraints
Not on the map. Why?
Abstract (arXiv)
We address the challenging problem of dynamically pricing complementary items that are sequentially displayed to customers. An illustrative example is the online sale of flight tickets, where customers navigate through multiple web pages. Initially, they view the ticket cost, followed by ancillary expenses such as insurance and additional luggage fees. Coherent pricing policies for complementary items are essential because optimizing the pricing of each item individually is ineffective. Our scenario also involves a sales constraint, which specifies a minimum number of items to sell, and uncertainty regarding customer demand curves. To tackle this problem, we originally formulate it as a Markov Decision Process with constraints. Leveraging online learning tools, we design a primal-dual online optimization algorithm. We empirically evaluate our approach using synthetic settings randomly generated from real-world data, covering various configurations from stationary to non-stationary, and compare its performance in terms of constraints violation and regret against well-known baselines optimizing each state singularly.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 13 of its 32 references that are in the map. First posted on arXiv 8 Jul 2024.
Builds on
13 of 32 references.
References · 13
- 2019Online Learning: A Modern Introduction Using Convex Optimizationcited by 407
- 2020Exploration-Exploitation in Constrained MDPscited by 146
- 2019Learning Adversarial MDPs with Bandit Feedback and Unknown Transitioncited by 84
- 2019Online Convex Optimization in Adversarial Markov Decision Processescited by 79
- 2020Constrained Upper Confidence Reinforcement Learningcited by 46
- 2020Upper Confidence Primal-Dual Reinforcement Learning for CMDP with Adversarial Losscited by 46
- 2024Learning Adversarial MDPs with Stochastic Hard Constraintscited by 15
- 2017Online Learning in Weakly Coupled Markov Decision Processes: A Convergence Time Studycited by 14
- 2023A Best-of-Both-Worlds Algorithm for Constrained MDPs with Long-Term Constraintscited by 9
- 2024Markov Persuasion Processes: Learning to Persuade from Scratchcited by 8
- 2019Dynamic Pricing on E-commerce Platform with Deep Reinforcement Learning: A Field Experimentcited by 6
- 2024Learning Constrained Markov Decision Processes With Non-stationary Rewards and Constraintscited by 5
1 more
- 2018Thompson Sampling for Dynamic Pricingcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Online Dynamic Pricing of Complementary Productscited by 0
- 2025Online Dynamic Pricing of Complementary Products27 Nov 2025