Stop Relying on No-Choice and Do not Repeat the Moves: Optimal, Efficient and Practical Algorithms for Assortment Optimization
Not on the map. Why?
Abstract (arXiv)
We address the problem of active online assortment optimization problem with preference feedback, which is a framework for modeling user choices and subsetwise utility maximization. The framework is useful in various real-world applications including ad placement, online retail, recommender systems, fine-tuning language models, amongst many. The problem, although has been studied in the past, lacks an intuitive and practical solution approach with simultaneously efficient algorithm and optimal regret guarantee. E.g., popularly used assortment selection algorithms often require the presence of a `strong reference' which is always included in the choice sets, further they are also designed to offer the same assortments repeatedly until the reference item gets selected -- all such requirements are quite unrealistic for practical applications. In this paper, we designed efficient algorithms for the problem of regret minimization in assortment selection with Plackett Luce (PL) based user choices. We designed a novel concentration guarantee for estimating the score parameters of the PL model using `Pairwise Rank-Breaking', which builds the foundation of our proposed algorithms. Moreover, our methods are practical, provably optimal, and devoid of the aforementioned limitations of the existing methods. Empirical evaluations corroborate our findings and outperform the existing baselines.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 29 Feb 2024.
Builds on
21 of 36 references.
References · 21
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2018Preference-based Online Learning with Dueling Bandits: A Surveycited by 100
- 2014Reducing Dueling Bandits to Cardinal Banditscited by 62
- 2017MNL-Bandit: A Dynamic Learning Approach to Assortment Selectioncited by 50
- 2015Copeland Dueling Banditscited by 36
- 2017Multi-dueling Bandits with Dependent Armscited by 35
- 2022Stochastic Contextual Dueling Bandits under Linear Stochastic Transitivity Modelscited by 35
- 2021On the Theory of Reinforcement Learning with Once-per-Episode Feedbackcited by 32
- 2018PAC Battling Bandits in the Plackett-Luce Modelcited by 27
- 2018Active Ranking with Subset-wise Preferencescited by 21
- 2019Combinatorial Bandits with Relative Feedbackcited by 19
9 more
- 2018PAC Ranking from Pairwise and Listwise Queries: Lower Bounds and Upper Boundscited by 17
- 2016Multi-Dueling Bandits and Their Application to Online Ranker Evaluationcited by 16
- 2018Multinomial Logit Bandit with Linear Utility Functionscited by 15
- 2017A Nearly Instance Optimal Algorithm for Top-k Ranking under the Multinomial Logit Modelcited by 12
- 2016Data-driven Rank Breaking for Efficient Rank Aggregationcited by 10
- 2017A Note on a Tight Lower Bound for MNL-Bandit Assortment Selection Modelscited by 7
- 2016Competitive analysis of the top-K ranking problemcited by 6
- 2016Assortment optimisation under a general discrete choice model: A tight analysis of revenue-ordered assortmentscited by 5
- 2017Assortment Optimization under a Single Transition Modelcited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.