Optimal Algorithm for Bayesian Incentive-Compatible Exploration
Not on the map. Why?
Abstract (arXiv)
We consider a social planner faced with a stream of myopic selfish agents. The goal of the social planner is to maximize the social welfare, however, it is limited to using only information asymmetry (regarding previous outcomes) and cannot use any monetary incentives. The planner recommends actions to agents, but her recommendations need to be Bayesian Incentive Compatible to be followed by the agents. Our main result is an optimal algorithm for the planner, in the case that the actions realizations are deterministic and have limited support, making significant important progress on this open problem. Our optimal protocol has two interesting features. First, it always completes the exploration of a priori more beneficial actions before exploring a priori less beneficial actions. Second, the randomization in the protocol is correlated across agents and actions (and not independent at each decision time).
Key facts. Cited by 6 papers in the map (data through 13 Oct 2026). First posted on arXiv 24 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 1; 2025: 1; 2026: 1.
6 papers.
- 2021Exploration and Incentives in Reinforcement Learningcited by 11
- 2022Modeling Attrition in Recommender Systems with Departing Banditscited by 11
- 2024Incentivized Exploration of Non-Stationary Stochastic Banditscited by 3
- 2025Incentivized Lipschitz Banditscited by 2
- 2023Incentivized Collaboration in Active Learningcited by 0
- 2026On Incentivized Exploration beyond Bayesianism and Full-Informationcited by 0
- 2026On Incentivized Exploration beyond Bayesianism and Full-Information14 Jul 2026
- 2025Incentivized Lipschitz Bandits26 Aug 2025
- 2024Incentivized Exploration of Non-Stationary Stochastic Bandits16 Mar 2024
- 2023Incentivized Collaboration in Active Learning1 Nov 2023
- 2022Modeling Attrition in Recommender Systems with Departing Bandits25 Mar 2022
- 2021Exploration and Incentives in Reinforcement Learning28 Feb 2021