Algorithms for Differentially Private Multi-Armed Bandits
Not on the map. Why?
Abstract (arXiv)
We present differentially private algorithms for the stochastic Multi-Armed Bandit (MAB) problem. This is a problem for applications such as adaptive clinical trials, experiment design, and user-targeted advertising where private information is connected to individual rewards. Our major contribution is to show that there exist (ε, δ) differentially private variants of Upper Confidence Bound algorithms which have optimal regret, O(ε-1 + log T). This is a significant improvement over previous results, which only achieve poly-log regret O(ε-2 log2 T), because of our use of a novel interval-based mechanism. We also substantially improve the bounds of previous family of algorithms which use a continual release mechanism. Experiments clearly validate our theoretical bounds.
Key facts. Cited by 45 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 9; 2023: 5; 2024: 10; 2025: 6; 2026: 4.
45 papers.
Sort:
By area:
- 2022When Privacy Meets Partial Information: A Refined Analysis of Differentially Private Banditscited by 28
- 2023DPZero: Private Fine-Tuning of Language Models without Backpropagationcited by 26
- 2021Optimal Rates of (Locally) Differentially Private Heavy-tailed Multi-Armed Banditscited by 25
- 2021Differentially Private Multi-Armed Bandits in the Shuffle Modelcited by 24
- 2021Differentially Private Regret Minimization in Episodic Markov Decision Processescited by 23
- 2022Differentially Private Reinforcement Learning with Linear Function Approximationcited by 22
- 2022Distributed Differential Privacy in Multi-Armed Banditscited by 14
- 2024Trustworthy Distributed AI Systems: Robustness, Privacy, and Governancecited by 14
- 2023Federated Linear Contextual Bandits with User-level Differential Privacycited by 12
- 2021No-Regret Algorithms for Private Gaussian Process Bandit Optimizationcited by 11
- 2021Privacy-Preserving Communication-Efficient Federated Multi-Armed Banditscited by 11
- 2021Differentially Private Exploration in Reinforcement Learning with Linear Representationcited by 11
33 more
- 2021Littlestone Classes are Privately Online Learnablecited by 10
- 2022Private and Byzantine-Proof Cooperative Decision-Makingcited by 10
- 2023Concentrated Differential Privacy for Banditscited by 10
- 2022Differentially Private Linear Bandits with Partial Distributed Feedbackcited by 8
- 2021Adaptive Control of Differentially Private Linear Quadratic Systemscited by 7
- 2022Differentially Private Temporal Difference Learning with Stochastic Nonconvex-Strongly-Concave Optimizationcited by 7
- 2023On the Complexity of Differentially Private Best-Arm Identification with Fixed Confidencecited by 6
- 2022Federated X-Armed Banditcited by 5
- 2022Dynamic Global Sensitivity for Differentially Private Contextual Banditscited by 5
- 2024Thompson Sampling Itself is Differentially Privatecited by 4
- 2021Near-Optimal Algorithms for Differentially Private Online Learning in a Stochastic Environmentcited by 2
- 2024Fixed-Budget Differentially Private Best Arm Identificationcited by 2
- 2025DP-NCB: Privacy Preserving Fair Banditscited by 2
- 2021Cascading Bandit under Differential Privacycited by 1
- 2022Anonymous Bandits for Multi-User Systemscited by 1
- 2024Privacy Preserving Adaptive Experiment Designcited by 1
- 2024Fairness and Privacy Guarantees in Federated Contextual Banditscited by 1
- 2024Differentially Private Deep Model-Based Reinforcement Learningcited by 1
- 2024FLIPHAT: Joint Differential Privacy for High Dimensional Sparse Linear Banditscited by 1
- 2024Privacy Preserving Reinforcement Learning for Population Processescited by 1
- 2024Federated Online Prediction from Experts with Differential Privacy: Separations and Regret Speed-upscited by 1
- 2024Near-Optimal Reinforcement Learning with Shuffle Differential Privacycited by 1
- 2025Differentially Private Hyperparameter Tuning using Local Bayesian Optimizationcited by 1
- 2025Faster Rates for Private Adversarial Banditscited by 1
- 2025Deceptive Exploration in Multi-armed Banditscited by 1
- 2021Encrypted Linear Contextual Banditcited by 0
- 2023Local Differential Privacy for Sequential Decision Making in a Changing Environmentcited by 0
- 2025The Safety-Privacy Tradeoff in Linear Banditscited by 0
- 2025Beyond ATE: Multi-Criteria Design for A/B Testingcited by 0
- 2026CHRONOS: Temporally-Aware Multi-Agent Coordination for Evolving Data Marketplacescited by 0
- 2026Randomized Least Squares Value Iteration itself is Joint Differentially Privatecited by 0
- 2026Minimax Quantile Lower Bounds for Interactive Statistical Decision Making with Privacycited by 0
- 2026Plausible Deniability Guarantees for Whistleblowerscited by 0
- 2026Plausible Deniability Guarantees for Whistleblowers15 Jul 2026
- 2026Minimax Quantile Lower Bounds for Interactive Statistical Decision Making with Privacy22 Jun 2026
- 2026Randomized Least Squares Value Iteration itself is Joint Differentially Private1 Jun 2026
- 2026CHRONOS: Temporally-Aware Multi-Agent Coordination for Evolving Data Marketplaces22 May 2026
- 2025Deceptive Exploration in Multi-armed Bandits9 Oct 2025
- 2025Beyond ATE: Multi-Criteria Design for A/B Testing6 Sep 2025
- 2025DP-NCB: Privacy Preserving Fair Bandits5 Aug 2025
- 2025Faster Rates for Private Adversarial Bandits27 May 2025
- 2025The Safety-Privacy Tradeoff in Linear Bandits23 Apr 2025
- 2025Differentially Private Hyperparameter Tuning using Local Bayesian Optimization9 Feb 2025
- 2024Near-Optimal Reinforcement Learning with Shuffle Differential Privacy18 Nov 2024
- 2024Federated Online Prediction from Experts with Differential Privacy: Separations and Regret Speed-ups27 Sep 2024
33 more
- 2024Thompson Sampling Itself is Differentially Private20 Jul 2024
- 2024Privacy Preserving Reinforcement Learning for Population Processes25 Jun 2024
- 2024FLIPHAT: Joint Differential Privacy for High Dimensional Sparse Linear Bandits22 May 2024
- 2024Differentially Private Deep Model-Based Reinforcement Learning8 Feb 2024
- 2024Fairness and Privacy Guarantees in Federated Contextual Bandits5 Feb 2024
- 2024Trustworthy Distributed AI Systems: Robustness, Privacy, and Governance2 Feb 2024
- 2024Fixed-Budget Differentially Private Best Arm Identification17 Jan 2024
- 2024Privacy Preserving Adaptive Experiment Design16 Jan 2024
- 2023DPZero: Private Fine-Tuning of Language Models without Backpropagation14 Oct 2023
- 2023On the Complexity of Differentially Private Best-Arm Identification with Fixed Confidence5 Sep 2023
- 2023Concentrated Differential Privacy for Bandits1 Sep 2023
- 2023Federated Linear Contextual Bandits with User-level Differential Privacy8 Jun 2023
- 2023Local Differential Privacy for Sequential Decision Making in a Changing Environment2 Jan 2023
- 2022Anonymous Bandits for Multi-User Systems21 Oct 2022
- 2022When Privacy Meets Partial Information: A Refined Analysis of Differentially Private Bandits6 Sep 2022
- 2022Dynamic Global Sensitivity for Differentially Private Contextual Bandits30 Aug 2022
- 2022Differentially Private Linear Bandits with Partial Distributed Feedback12 Jul 2022
- 2022Distributed Differential Privacy in Multi-Armed Bandits12 Jun 2022
- 2022Federated X-Armed Bandit30 May 2022
- 2022Private and Byzantine-Proof Cooperative Decision-Making27 May 2022
- 2022Differentially Private Temporal Difference Learning with Stochastic Nonconvex-Strongly-Concave Optimization25 Jan 2022
- 2022Differentially Private Reinforcement Learning with Linear Function Approximation18 Jan 2022
- 2021Differentially Private Regret Minimization in Episodic Markov Decision Processes20 Dec 2021
- 2021Differentially Private Exploration in Reinforcement Learning with Linear Representation2 Dec 2021
- 2021Privacy-Preserving Communication-Efficient Federated Multi-Armed Bandits2 Nov 2021
- 2021Adaptive Control of Differentially Private Linear Quadratic Systems26 Aug 2021
- 2021Littlestone Classes are Privately Online Learnable25 Jun 2021
- 2021Differentially Private Multi-Armed Bandits in the Shuffle Model5 Jun 2021
- 2021Optimal Rates of (Locally) Differentially Private Heavy-tailed Multi-Armed Bandits4 Jun 2021
- 2021Cascading Bandit under Differential Privacy24 May 2021
- 2021Encrypted Linear Contextual Bandit17 Mar 2021
- 2021No-Regret Algorithms for Private Gaussian Process Bandit Optimization24 Feb 2021
- 2021Near-Optimal Algorithms for Differentially Private Online Learning in a Stochastic Environment16 Feb 2021
- 2022When Privacy Meets Partial Information: A Refined Analysis of Differentially Private Banditscited by 28
- 2023DPZero: Private Fine-Tuning of Language Models without Backpropagationcited by 26
- 2021Optimal Rates of (Locally) Differentially Private Heavy-tailed Multi-Armed Banditscited by 25
- 2021Differentially Private Multi-Armed Bandits in the Shuffle Modelcited by 24
- 2021Differentially Private Regret Minimization in Episodic Markov Decision Processescited by 23
- 2022Differentially Private Reinforcement Learning with Linear Function Approximationcited by 22
- 2022Distributed Differential Privacy in Multi-Armed Banditscited by 14
- 2024Trustworthy Distributed AI Systems: Robustness, Privacy, and Governancecited by 14
- 2023Federated Linear Contextual Bandits with User-level Differential Privacycited by 12
- 2021No-Regret Algorithms for Private Gaussian Process Bandit Optimizationcited by 11
- 2021Privacy-Preserving Communication-Efficient Federated Multi-Armed Banditscited by 11
- 2021Differentially Private Exploration in Reinforcement Learning with Linear Representationcited by 11
12 most cited of 41 All 41 (JSON)
- 2026Plausible Deniability Guarantees for Whistleblowers15 Jul 2026
- 2026Minimax Quantile Lower Bounds for Interactive Statistical Decision Making with Privacy22 Jun 2026
- 2026CHRONOS: Temporally-Aware Multi-Agent Coordination for Evolving Data Marketplaces22 May 2026
- 2025Deceptive Exploration in Multi-armed Bandits9 Oct 2025
- 2025Beyond ATE: Multi-Criteria Design for A/B Testing6 Sep 2025
- 2025DP-NCB: Privacy Preserving Fair Bandits5 Aug 2025
- 2025Faster Rates for Private Adversarial Bandits27 May 2025
- 2025The Safety-Privacy Tradeoff in Linear Bandits23 Apr 2025
- 2025Differentially Private Hyperparameter Tuning using Local Bayesian Optimization9 Feb 2025
- 2024Federated Online Prediction from Experts with Differential Privacy: Separations and Regret Speed-ups27 Sep 2024
- 2024Thompson Sampling Itself is Differentially Private20 Jul 2024
- 2024FLIPHAT: Joint Differential Privacy for High Dimensional Sparse Linear Bandits22 May 2024
12 newest of 41 All 41 (JSON)