Multiple-Play Bandits in the Position-Based Model
Not on the map. Why?
Abstract (arXiv)
Sequentially learning to place items in multi-position displays or lists is a task that can be cast into the multiple-play semi-bandit setting. However, a major concern in this context is when the system cannot decide whether the user feedback for each item is actually exploitable. Indeed, much of the content may have been simply ignored by the user. The present work proposes to exploit available information regarding the display position bias under the so-called Position-based click model (PBM). We first discuss how this model differs from the Cascade model and its variants considered in several recent works on multiple-play bandits. We then provide a novel regret lower bound for this model as well as computationally efficient algorithms that display good empirical and theoretical performance.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 7; 2023: 5; 2024: 6; 2025: 6; 2026: 3.
28 papers.
Sort:
By area:
- 2022Doubly-Robust Estimation for Correcting Position-Bias in Click Feedback for Unbiased Learning to Rankcited by 18
- 2026A Survey on LLM-based Conversational User Simulationcited by 18
- 2024Optimal Design for Human Preference Elicitationcited by 17
- 2024Multi-Armed Bandits with Interferencecited by 10
- 2025Active Learning for Direct Preference Optimizationcited by 10
- 2024Online Experimental Design With Estimation-Regret Trade-off Under Network Interferencecited by 9
- 2021Robust Generalization and Safe Query-Specialization in Counterfactual Learning to Rankcited by 6
- 2022Multiple-Play Stochastic Bandits with Shareable Finite-Capacity Armscited by 6
- 2023Adversarial Attacks on Online Learning to Rank with Click Feedbackcited by 6
- 2023Adversarial Attacks on Online Learning to Rank with Stochastic Click Modelscited by 6
- 2025Graph-Dependent Regret Bounds in Multi-Armed Bandits with Interferencecited by 5
- 2022Probabilistic Permutation Graph Search: Black-Box Optimization for Fairness in Rankingcited by 4
16 more
- 2024Cascading Reinforcement Learningcited by 4
- 2022Simultaneously Learning Stochastic and Adversarial Bandits under the Position-Based Modelcited by 2
- 2022Contextual bandits with concave rewards, and an application to fair rankingcited by 2
- 2023Bandit Learning to Rank with Position-Based Click Models: Personalized and Equal Treatmentscited by 2
- 2022Ranking In Generalized Linear Banditscited by 1
- 2023Overcoming Prior Misspecification in Online Learning to Rankcited by 1
- 2024Misalignment, Learning, and Ranking: Harnessing Users Limited Attentioncited by 1
- 2025Design-Based Bandits Under Network Interference: Trade-Off Between Regret and Statistical Inferencecited by 1
- 2022UniRank: Unimodal Bandit Algorithm for Online Rankingcited by 0
- 2023Exploration of Unranked Items in Safe Online Learning to Re-Rankcited by 0
- 2024Adaptively Learning to Select-Rank in Online Platformscited by 0
- 2025Observation-Free Attacks on Online Learning to Rankcited by 0
- 2025Online Learning to Rank under Corruption: A Robust Cascading Bandits Approachcited by 0
- 2025Multiple-play Stochastic Bandits with Prioritized Arm Capacity Sharingcited by 0
- 2026Contextual Slate GLM Bandits with Limited Adaptivitycited by 0
- 2026Ranking Bandits for Carousel Interfaces with Observable Browsing Depthcited by 0
- 2026Ranking Bandits for Carousel Interfaces with Observable Browsing Depth4 Oct 2026
- 2026Contextual Slate GLM Bandits with Limited Adaptivity30 Jun 2026
- 2026A Survey on LLM-based Conversational User Simulation27 Apr 2026
- 2025Multiple-play Stochastic Bandits with Prioritized Arm Capacity Sharing25 Dec 2025
- 2025Online Learning to Rank under Corruption: A Robust Cascading Bandits Approach4 Nov 2025
- 2025Design-Based Bandits Under Network Interference: Trade-Off Between Regret and Statistical Inference9 Oct 2025
- 2025Observation-Free Attacks on Online Learning to Rank26 Sep 2025
- 2025Graph-Dependent Regret Bounds in Multi-Armed Bandits with Interference10 Mar 2025
- 2025Active Learning for Direct Preference Optimization3 Mar 2025
- 2024Online Experimental Design With Estimation-Regret Trade-off Under Network Interference4 Dec 2024
- 2024Adaptively Learning to Select-Rank in Online Platforms7 Jun 2024
- 2024Optimal Design for Human Preference Elicitation22 Apr 2024
16 more
- 2024Misalignment, Learning, and Ranking: Harnessing Users Limited Attention21 Feb 2024
- 2024Multi-Armed Bandits with Interference2 Feb 2024
- 2024Cascading Reinforcement Learning17 Jan 2024
- 2023Bandit Learning to Rank with Position-Based Click Models: Personalized and Equal Treatments8 Nov 2023
- 2023Adversarial Attacks on Online Learning to Rank with Stochastic Click Models30 May 2023
- 2023Adversarial Attacks on Online Learning to Rank with Click Feedback26 May 2023
- 2023Exploration of Unranked Items in Safe Online Learning to Re-Rank2 May 2023
- 2023Overcoming Prior Misspecification in Online Learning to Rank25 Jan 2023
- 2022Contextual bandits with concave rewards, and an application to fair ranking18 Oct 2022
- 2022UniRank: Unimodal Bandit Algorithm for Online Ranking2 Aug 2022
- 2022Simultaneously Learning Stochastic and Adversarial Bandits under the Position-Based Model12 Jul 2022
- 2022Ranking In Generalized Linear Bandits30 Jun 2022
- 2022Multiple-Play Stochastic Bandits with Shareable Finite-Capacity Arms17 Jun 2022
- 2022Probabilistic Permutation Graph Search: Black-Box Optimization for Fairness in Ranking28 Apr 2022
- 2022Doubly-Robust Estimation for Correcting Position-Bias in Click Feedback for Unbiased Learning to Rank31 Mar 2022
- 2021Robust Generalization and Safe Query-Specialization in Counterfactual Learning to Rank11 Feb 2021
- 2025Active Learning for Direct Preference Optimizationcited by 10
- 2025Active Learning for Direct Preference Optimization3 Mar 2025
- 2024Cascading Reinforcement Learningcited by 4
- 2024Cascading Reinforcement Learning17 Jan 2024
- 2022Doubly-Robust Estimation for Correcting Position-Bias in Click Feedback for Unbiased Learning to Rankcited by 18
- 2026A Survey on LLM-based Conversational User Simulationcited by 18
- 2024Optimal Design for Human Preference Elicitationcited by 17
- 2024Multi-Armed Bandits with Interferencecited by 10
- 2024Online Experimental Design With Estimation-Regret Trade-off Under Network Interferencecited by 9
- 2021Robust Generalization and Safe Query-Specialization in Counterfactual Learning to Rankcited by 6
- 2022Multiple-Play Stochastic Bandits with Shareable Finite-Capacity Armscited by 6
- 2023Adversarial Attacks on Online Learning to Rank with Click Feedbackcited by 6
- 2023Adversarial Attacks on Online Learning to Rank with Stochastic Click Modelscited by 6
- 2025Graph-Dependent Regret Bounds in Multi-Armed Bandits with Interferencecited by 5
- 2022Probabilistic Permutation Graph Search: Black-Box Optimization for Fairness in Rankingcited by 4
- 2022Simultaneously Learning Stochastic and Adversarial Bandits under the Position-Based Modelcited by 2
12 most cited of 26 All 26 (JSON)
- 2026Ranking Bandits for Carousel Interfaces with Observable Browsing Depth4 Oct 2026
- 2026Contextual Slate GLM Bandits with Limited Adaptivity30 Jun 2026
- 2026A Survey on LLM-based Conversational User Simulation27 Apr 2026
- 2025Multiple-play Stochastic Bandits with Prioritized Arm Capacity Sharing25 Dec 2025
- 2025Online Learning to Rank under Corruption: A Robust Cascading Bandits Approach4 Nov 2025
- 2025Design-Based Bandits Under Network Interference: Trade-Off Between Regret and Statistical Inference9 Oct 2025
- 2025Observation-Free Attacks on Online Learning to Rank26 Sep 2025
- 2025Graph-Dependent Regret Bounds in Multi-Armed Bandits with Interference10 Mar 2025
- 2024Online Experimental Design With Estimation-Regret Trade-off Under Network Interference4 Dec 2024
- 2024Adaptively Learning to Select-Rank in Online Platforms7 Jun 2024
- 2024Optimal Design for Human Preference Elicitation22 Apr 2024
- 2024Misalignment, Learning, and Ranking: Harnessing Users Limited Attention21 Feb 2024
12 newest of 26 All 26 (JSON)