Best Arm Identification in Generalized Linear Bandits via Hybrid Feedback
Not on the map. Why?
Abstract (arXiv)
We study fixed-confidence best arm identification in generalized linear bandits under a hybrid feedback model: at each round, the learner may query either (i) absolute reward feedback from a single arm or (ii) relative (dueling) feedback from an arm pair, both governed by generalized linear models. We introduce a likelihood-ratio--based confidence sequence that unifies heterogeneous generalized linear observations and yields an explicit ellipsoidal confidence set under a self-concordance assumption. Building on this confidence set, we propose a hybrid Track-and-Stop algorithm that adaptively allocates queries by tracking a minimax-optimal design over a joint action space of arms and pairs. We establish δ-correctness and provide high-probability upper bounds on the stopping time. We further extend the framework to a cost-aware setting that accounts for heterogeneous acquisition costs across feedback modalities. Empirical experiments demonstrate that the proposed algorithms significantly improve sample efficiency over baseline methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 32 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
17 of 32 references.
References · 17
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2014On the Complexity of Best Arm Identification in Multi-Armed Bandit Modelscited by 280
- 2016Optimal Best Arm Identification with Fixed Confidencecited by 233
- 2014Best-Arm Identification in Linear Banditscited by 98
- 2020Optimal Best-arm Identification in Linear Banditscited by 70
- 2020Gamification of Pure Exploration for Linear Banditscited by 61
- 2019Conversational Contextual Bandit: Algorithm and Applicationcited by 35
- 2020Improved Confidence Bounds for the Linear Logistic Model and Applications to Linear Banditscited by 31
- 2020Self-Concordant Analysis of Generalized Linear Bandits with Forgettingcited by 29
- 2024A Unified Confidence Sequence for Generalized Linear Models, with Applications to Banditscited by 27
- 2019Best Arm Identification in Generalized Linear Banditscited by 18
5 more
- 2025Confidence Sequences for Generalized Linear Models via Regret Analysiscited by 9
- 2025Confidence Estimation via Sequential Likelihood Mixingcited by 6
- 2024Conversational Dueling Bandits in Generalized Linear Modelscited by 5
- 2024Near Optimal Pure Exploration in Logistic Banditscited by 2
- 2025Fusing Reward and Dueling Feedback in Stochastic Banditscited by 1
Built on by
Not cited yet.