mlsanityData to 14 Oct 2026

On Pareto Optimality for Parametric Choice Bandits

arXiv 2501.19277 ↗First posted 31 Jan 2025stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We study online assortment optimization under stochastic choice when a decision maker simultaneously values cumulative revenue performance and the quality of post-hoc inference on revenue contrasts. We analyze a forced-exploration optimism-in-the-face-of-uncertainty (OFU) scheme that combines two regularized maximum-likelihood estimators: one based on all observations for sequential decision making, and one based only on exploration rounds for inference. Our general theory is developed under predictable score proxies and per-round action-dependent curvature domination. Under these conditions we establish a self-normalized concentration inequality, a likelihood-based ellipsoidal confidence-set theorem, and a regret bound for approximate optimistic actions that explicitly accounts for optimization error. For the multinomial logit (MNL) model we derive explicit score and curvature proxies and show that a balanced spaced singleton-exploration schedule yields realized coordinate coverage, implying regret Otilde(nT + T/√nT) and revenue-contrast error Otilde(1/√nT) up to fixed problem-dependent factors. A hard two-assortment subclass yields a matching lower bound at the product level. Consequently, within the polynomial exploration family nT asymp Tα, the regret and inference rates become Otilde(T^maxα,1-α/2) and Otilde(T-α/2), respectively; hence α∈[2/3,1) is the rate-wise Pareto-undominated interval and α=2/3 is the unique balancing point that minimizes the regret exponent. Finally, for the Exponomial Choice and Nested Logit models we state verifiable sufficient conditions that would instantiate the general framework.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 23 references that are in the map. First posted on arXiv 31 Jan 2025.

Builds on

9 of 23 references.

References · 9

  1. 2019Confidence Intervals for Policy Evaluation in Adaptive Experimentscited by 95
  2. 2017MNL-Bandit: A Dynamic Learning Approach to Assortment Selectioncited by 50
  3. 2017Thompson Sampling for the MNL-Banditcited by 35
  4. 2023Semiparametric Efficient Inference in Adaptive Experimentscited by 23
  5. 2021Multinomial Logit Contextual Bandits: Provable Optimality and Practicalitycited by 21
  6. 2021Dynamic pricing and assortment under a contextual MNL demandcited by 20
  7. 2024Nearly Minimax Optimal Regret for Multinomial Logistic Banditcited by 20
  8. 2021Achieving the Pareto Frontier of Regret Minimization and Best Arm Identification in Multi-Armed Banditscited by 13
  9. 2024Optimizing Adaptive Experiments: A Unified Approach to Regret Minimization and Best-Arm Identificationcited by 12

Built on by

Not cited yet.