Learning an Optimal Assortment Policy under Observational Data
Not on the map. Why?
Abstract (arXiv)
We study the fundamental problem of offline assortment optimization under the Multinomial Logit (MNL) model, where sellers must determine the optimal subset of the products to offer based solely on historical customer choice data. While most existing approaches to learning-based assortment optimization focus on the online learning of the optimal assortment through repeated interactions with customers, such exploration can be costly or even impractical in many real-world settings. In this paper, we consider the offline learning paradigm and investigate the minimal data requirements for efficient offline assortment optimization. To this end, we introduce Pessimistic Rank-Breaking (PRB), an algorithm that combines rank-breaking with pessimistic estimation. We prove that PRB is nearly minimax optimal by establishing the tight suboptimality upper bound and a nearly matching lower bound. This further shows that "optimal item coverage" - where each item in the optimal assortment appears sufficiently often in the historical data - is both sufficient and necessary for efficient offline learning. This significantly relaxes the previous requirement of observing the complete optimal assortment in the data. Our results provide fundamental insights into the data requirements for offline assortment optimization under the MNL model.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 52 references that are in the map. First posted on arXiv 10 Feb 2025.
Builds on
25 of 52 references.
References · 25
- 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
- 2020MOPO: Model-based Offline Policy Optimizationcited by 630
- 2020Is Pessimism Provably Efficient for Offline RL?cited by 362
- 2021Bridging Offline Reinforcement Learning and Imitation Learning: A Tale of Pessimismcited by 275
- 2021Bellman-consistent Pessimism for Offline Reinforcement Learningcited by 267
- 2021Pessimistic Model-based Offline Reinforcement Learning under Partial Coveragecited by 160
- 2022Offline Reinforcement Learning with Realizability and Single-policy Concentrabilitycited by 122
- 2022Pessimistic Q-Learning for Offline Reinforcement Learning: Towards Optimal Sample Complexitycited by 84
- 2022Nearly Minimax Optimal Offline Reinforcement Learning with Linear Function Approximation: Single-Agent MDP and Markov Gamecited by 53
- 2023Double Pessimism is Provably Efficient for Distributionally Robust Offline Reinforcement Learning: Generic Algorithm and Robust Partial Coveragecited by 51
- 2017MNL-Bandit: A Dynamic Learning Approach to Assortment Selectioncited by 50
- 2022Pessimistic Minimax Value Iteration: Provably Efficient Equilibrium Learning from Offline Datasetscited by 42
13 more
- 2017Thompson Sampling for the MNL-Banditcited by 35
- 2022Optimal Conservative Offline RL with General Function Approximation via Augmented Lagrangiancited by 29
- 2022Pessimism in the Face of Confounders: Provably Efficient Offline Reinforcement Learning in Partially Observable Markov Decision Processescited by 26
- 2018Active Ranking with Subset-wise Preferencescited by 21
- 2021Multinomial Logit Contextual Bandits: Provable Optimality and Practicalitycited by 21
- 2021Dynamic pricing and assortment under a contextual MNL demandcited by 20
- 2024Nearly Minimax Optimal Regret for Multinomial Logistic Banditcited by 20
- 2018Multinomial Logit Bandit with Linear Utility Functionscited by 15
- 2017Assortment Optimization under Unknown MultiNomial Logit Choice Modelscited by 5
- 2023PASTA: Pessimistic Assortment Optimizationcited by 3
- 2024Stop Relying on No-Choice and Do not Repeat the Moves: Optimal, Efficient and Practical Algorithms for Assortment Optimizationcited by 3
- 2021MNL-Bandit with Knapsacks: a near-optimal algorithmcited by 2
- 2024A Re-solving Heuristic for Dynamic Assortment Optimization with Knapsack Constraintscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
- 2025PASTA: A Unified Framework for Offline Assortment Learningcited by 1
- 2026Diffusion-Based Data-Driven Assortment Optimizationcited by 0
- 2026Diffusion-Based Data-Driven Assortment Optimization11 Aug 2026
- 2025PASTA: A Unified Framework for Offline Assortment Learning2 Oct 2025