Differential Privacy for Multi-armed Bandits: What Is It and What Is Its Cost?
Not on the map. Why?
Abstract (arXiv)
Based on differential privacy (DP) framework, we introduce and unify privacy definitions for the multi-armed bandit algorithms. We represent the framework with a unified graphical model and use it to connect privacy definitions. We derive and contrast lower bounds on the regret of bandit algorithms satisfying these definitions. We leverage a unified proving technique to achieve all the lower bounds. We show that for all of them, the learner's regret is increased by a multiplicative factor dependent on the privacy level ε. We observe that the dependency is weaker when we do not require local differential privacy for the rewards.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 6; 2023: 4; 2024: 3; 2025: 3; 2026: 2.
27 papers.
Sort:
By area:
- 2021Optimal Order Simple Regret for Gaussian Process Banditscited by 54
- 2021Generalized Linear Bandits with Local Differential Privacycited by 29
- 2022When Privacy Meets Partial Information: A Refined Analysis of Differentially Private Banditscited by 28
- 2021Optimal Rates of (Locally) Differentially Private Heavy-tailed Multi-Armed Banditscited by 25
- 2022Differentially Private Reinforcement Learning with Linear Function Approximationcited by 22
- 2022Offline Reinforcement Learning with Differential Privacycited by 20
- 2021Privacy Amplification via Shuffling for Linear Contextual Banditscited by 17
- 2022Near-Optimal Differentially Private Reinforcement Learningcited by 16
- 2021Locally Differentially Private Reinforcement Learning for Linear Mixture Markov Decision Processescited by 13
- 2021No-Regret Algorithms for Private Gaussian Process Bandit Optimizationcited by 11
- 2021Privacy-Preserving Communication-Efficient Federated Multi-Armed Banditscited by 11
- 2023Concentrated Differential Privacy for Banditscited by 10
15 more
- 2021Adaptive Control of Differentially Private Linear Quadratic Systemscited by 7
- 2023On the Complexity of Differentially Private Best-Arm Identification with Fixed Confidencecited by 6
- 2022Dynamic Global Sensitivity for Differentially Private Contextual Banditscited by 5
- 2024Replicability is Asymptotically Free in Multi-armed Banditscited by 2
- 2025DP-NCB: Privacy Preserving Fair Banditscited by 2
- 2021Cascading Bandit under Differential Privacycited by 1
- 2022Anonymous Bandits for Multi-User Systemscited by 1
- 2024Differentially Private Deep Model-Based Reinforcement Learningcited by 1
- 2024FLIPHAT: Joint Differential Privacy for High Dimensional Sparse Linear Banditscited by 1
- 2025Faster Rates for Private Adversarial Banditscited by 1
- 2023Robust and differentially private stochastic linear banditscited by 0
- 2023Thompson Sampling under Bernoulli Rewards with Local Differential Privacycited by 0
- 2025Optimal Regret of Bernoulli Bandits under Global Differential Privacycited by 0
- 2026Randomized Least Squares Value Iteration itself is Joint Differentially Privatecited by 0
- 2026Minimax Quantile Lower Bounds for Interactive Statistical Decision Making with Privacycited by 0
- 2026Minimax Quantile Lower Bounds for Interactive Statistical Decision Making with Privacy22 Jun 2026
- 2026Randomized Least Squares Value Iteration itself is Joint Differentially Private1 Jun 2026
- 2025DP-NCB: Privacy Preserving Fair Bandits5 Aug 2025
- 2025Faster Rates for Private Adversarial Bandits27 May 2025
- 2025Optimal Regret of Bernoulli Bandits under Global Differential Privacy8 May 2025
- 2024FLIPHAT: Joint Differential Privacy for High Dimensional Sparse Linear Bandits22 May 2024
- 2024Replicability is Asymptotically Free in Multi-armed Bandits12 Feb 2024
- 2024Differentially Private Deep Model-Based Reinforcement Learning8 Feb 2024
- 2023On the Complexity of Differentially Private Best-Arm Identification with Fixed Confidence5 Sep 2023
- 2023Concentrated Differential Privacy for Bandits1 Sep 2023
- 2023Thompson Sampling under Bernoulli Rewards with Local Differential Privacy3 Jul 2023
- 2023Robust and differentially private stochastic linear bandits23 Apr 2023
15 more
- 2022Near-Optimal Differentially Private Reinforcement Learning9 Dec 2022
- 2022Anonymous Bandits for Multi-User Systems21 Oct 2022
- 2022When Privacy Meets Partial Information: A Refined Analysis of Differentially Private Bandits6 Sep 2022
- 2022Dynamic Global Sensitivity for Differentially Private Contextual Bandits30 Aug 2022
- 2022Offline Reinforcement Learning with Differential Privacy2 Jun 2022
- 2022Differentially Private Reinforcement Learning with Linear Function Approximation18 Jan 2022
- 2021Privacy Amplification via Shuffling for Linear Contextual Bandits11 Dec 2021
- 2021Privacy-Preserving Communication-Efficient Federated Multi-Armed Bandits2 Nov 2021
- 2021Locally Differentially Private Reinforcement Learning for Linear Mixture Markov Decision Processes19 Oct 2021
- 2021Adaptive Control of Differentially Private Linear Quadratic Systems26 Aug 2021
- 2021Optimal Order Simple Regret for Gaussian Process Bandits20 Aug 2021
- 2021Generalized Linear Bandits with Local Differential Privacy7 Jun 2021
- 2021Optimal Rates of (Locally) Differentially Private Heavy-tailed Multi-Armed Bandits4 Jun 2021
- 2021Cascading Bandit under Differential Privacy24 May 2021
- 2021No-Regret Algorithms for Private Gaussian Process Bandit Optimization24 Feb 2021
- 2021Optimal Order Simple Regret for Gaussian Process Banditscited by 54
- 2021Generalized Linear Bandits with Local Differential Privacycited by 29
- 2022When Privacy Meets Partial Information: A Refined Analysis of Differentially Private Banditscited by 28
- 2021Optimal Rates of (Locally) Differentially Private Heavy-tailed Multi-Armed Banditscited by 25
- 2022Differentially Private Reinforcement Learning with Linear Function Approximationcited by 22
- 2021Privacy Amplification via Shuffling for Linear Contextual Banditscited by 17
- 2022Near-Optimal Differentially Private Reinforcement Learningcited by 16
- 2021Locally Differentially Private Reinforcement Learning for Linear Mixture Markov Decision Processescited by 13
- 2021No-Regret Algorithms for Private Gaussian Process Bandit Optimizationcited by 11
- 2021Privacy-Preserving Communication-Efficient Federated Multi-Armed Banditscited by 11
- 2023Concentrated Differential Privacy for Banditscited by 10
- 2021Adaptive Control of Differentially Private Linear Quadratic Systemscited by 7
12 most cited of 24 All 24 (JSON)
- 2026Minimax Quantile Lower Bounds for Interactive Statistical Decision Making with Privacy22 Jun 2026
- 2025DP-NCB: Privacy Preserving Fair Bandits5 Aug 2025
- 2025Faster Rates for Private Adversarial Bandits27 May 2025
- 2025Optimal Regret of Bernoulli Bandits under Global Differential Privacy8 May 2025
- 2024FLIPHAT: Joint Differential Privacy for High Dimensional Sparse Linear Bandits22 May 2024
- 2024Replicability is Asymptotically Free in Multi-armed Bandits12 Feb 2024
- 2023On the Complexity of Differentially Private Best-Arm Identification with Fixed Confidence5 Sep 2023
- 2023Concentrated Differential Privacy for Bandits1 Sep 2023
- 2023Thompson Sampling under Bernoulli Rewards with Local Differential Privacy3 Jul 2023
- 2023Robust and differentially private stochastic linear bandits23 Apr 2023
- 2022Near-Optimal Differentially Private Reinforcement Learning9 Dec 2022
- 2022Anonymous Bandits for Multi-User Systems21 Oct 2022
12 newest of 24 All 24 (JSON)