Learning to Persuade on the Fly: Robustness Against Ignorance
Not on the map. Why?
Abstract (arXiv)
Motivated by information sharing in online platforms, we study repeated persuasion between a sender and a stream of receivers where at each time, the sender observes a payoff-relevant state drawn independently and identically from an unknown distribution, and shares state information with the receivers who each choose an action. The sender seeks to persuade the receivers into taking actions aligned with the sender's preference by selectively sharing state information. However, in contrast to the standard models, neither the sender nor the receivers know the distribution, and the sender has to persuade while learning the distribution on the fly. We study the sender's learning problem of making persuasive action recommendations to achieve low regret against the optimal persuasion mechanism with the knowledge of the distribution. To do this, we first propose and motivate a persuasiveness criterion for the unknown distribution setting that centers robustness as a requirement in the face of uncertainty. Our main result is an algorithm that, with high probability, is robustly-persuasive and achieves O(√Tlog T) regret, where T is the horizon length. Intuitively, at each time our algorithm maintains a set of candidate distributions, and chooses a signaling mechanism that is simultaneously persuasive for all of them. Core to our proof is a tight analysis about the cost of robust persuasion, which may be of independent interest. We further prove that this regret order is optimal (up to logarithmic terms) by showing that no algorithm can achieve regret better than Omega(√T).
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 20 of its 57 references that are in the map. First posted on arXiv 19 Feb 2021.
Builds on
20 of 57 references.
References · 20
- 2017Strategic Classification from Revealed Preferencescited by 128
- 2017Online Convex Optimization with Stochastic Constraintscited by 95
- 2019Linear Stochastic Bandits Under Safety Constraintscited by 90
- 2014Bandits with concave rewards and convex knapsackscited by 83
- 2018What Doubling Tricks Can and Can't Do for Multi-Armed Banditscited by 71
- 2020Stochastic Bandits with Linear Constraintscited by 68
- 2017Online Convex Optimization with Time-Varying Constraintscited by 56
- 2015Bayesian Incentive-Compatible Bandit Explorationcited by 53
- 2018Online convex optimization for cumulative constraintscited by 47
- 2016Bayesian Exploration: Incentivizing Exploration in Bayesian Gamescited by 37
- 2019Safe Linear Thompson Sampling with Side Informationcited by 37
- 2020Stage-wise Conservative Linear Banditscited by 28
8 more
- 2019Safe Linear Stochastic Banditscited by 27
- 2015Algorithmic Bayesian Persuasioncited by 21
- 2020Mechanisms for a No-Regret Agent: Beyond the Common Priorcited by 18
- 2019Safe Convex Learning under Uncertain Constraintscited by 17
- 2016Algorithmic Persuasion with No Externalitiescited by 9
- 2013Prior-Independent Mechanisms for Schedulingcited by 2
- 2019Information Design in Spatial Resource Competitioncited by 2
- 2019The Secretary Recommendation Problemcited by 1
Built on by
Citing papers per year: 2022: 3; 2023: 5; 2024: 2; 2025: 0; 2026: 2.
12 papers.
- 2022Sequential Information Design: Markov Persuasion Process and Its Efficient Reinforcement Learningcited by 18
- 2023No-Regret Learning in Bilateral Trade via Global Budget Balancecited by 17
- 2022Incentivizing Combinatorial Bandit Explorationcited by 9
- 2022Sequential Information Design: Learning to Persuade in the Darkcited by 9
- 2023Information Design in Multi-Agent Reinforcement Learningcited by 9
- 2024Markov Persuasion Processes: Learning to Persuade from Scratchcited by 8
- 2023Persuading a Behavioral Agent: Approximately Best Responding and Learningcited by 7
- 2023Learning to Incentivize Information Acquisition: Proper Scoring Rules Meet Principal-Agent Modelcited by 7
- 2024Generalized Principal-Agent Problem with a Learning Agentcited by 6
- 2023Algorithmic Persuasion Through Simulationcited by 4
- 2026On Incentivized Exploration beyond Bayesianism and Full-Informationcited by 0
- 2026Learning to Price with Persuasioncited by 0
- 2026Learning to Price with Persuasion17 Aug 2026
- 2026On Incentivized Exploration beyond Bayesianism and Full-Information14 Jul 2026
- 2024Generalized Principal-Agent Problem with a Learning Agent15 Feb 2024
- 2024Markov Persuasion Processes: Learning to Persuade from Scratch5 Feb 2024
- 2023Algorithmic Persuasion Through Simulation29 Nov 2023
- 2023No-Regret Learning in Bilateral Trade via Global Budget Balance18 Oct 2023
- 2023Information Design in Multi-Agent Reinforcement Learning8 May 2023
- 2023Learning to Incentivize Information Acquisition: Proper Scoring Rules Meet Principal-Agent Model15 Mar 2023
- 2023Persuading a Behavioral Agent: Approximately Best Responding and Learning7 Feb 2023
- 2022Sequential Information Design: Learning to Persuade in the Dark8 Sep 2022
- 2022Incentivizing Combinatorial Bandit Exploration1 Jun 2022
- 2022Sequential Information Design: Markov Persuasion Process and Its Efficient Reinforcement Learning22 Feb 2022