Multi-Armed Bandits with Local Differential Privacy
Not on the map. Why?
Abstract (arXiv)
This paper investigates the problem of regret minimization for multi-armed bandit (MAB) problems with local differential privacy (LDP) guarantee. In stochastic bandit systems, the rewards may refer to the users' activities, which may involve private information and the users may not want the agent to know. However, in many cases, the agent needs to know these activities to provide better services such as recommendations and news feeds. To handle this dilemma, we adopt differential privacy and study the regret upper and lower bounds for MAB algorithms with a given LDP guarantee. In this paper, we prove a lower bound and propose algorithms whose regret upper bounds match the lower bound up to constant factors. Numerical experiments also confirm our conclusions.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 6; 2023: 7; 2024: 6; 2025: 7; 2026: 2.
37 papers.
Sort:
By area:
- 2021Optimal Order Simple Regret for Gaussian Process Banditscited by 52
- 2021Generalized Linear Bandits with Local Differential Privacycited by 29
- 2022Shuffle Private Linear Contextual Banditscited by 27
- 2021Optimal Rates of (Locally) Differentially Private Heavy-tailed Multi-Armed Banditscited by 25
- 2021Differentially Private Multi-Armed Bandits in the Shuffle Modelcited by 24
- 2021Differentially Private Regret Minimization in Episodic Markov Decision Processescited by 23
- 2022Differentially Private Reinforcement Learning with Linear Function Approximationcited by 22
- 2022Differentially Private Stochastic Linear Bandits: (Almost) for Freecited by 19
- 2021Privacy Amplification via Shuffling for Linear Contextual Banditscited by 17
- 2022Distributed Differential Privacy in Multi-Armed Banditscited by 14
- 2023On Differentially Private Federated Linear Contextual Banditscited by 14
- 2021Differential Privacy in Personalized Pricing with Nonparametric Demand Modelscited by 13
25 more
- 2023Federated Linear Contextual Bandits with User-level Differential Privacycited by 12
- 2021Privacy-Preserving Communication-Efficient Federated Multi-Armed Banditscited by 11
- 2022Differentially Private Linear Bandits with Partial Distributed Feedbackcited by 8
- 2023On Private and Robust Banditscited by 6
- 2022Dynamic Global Sensitivity for Differentially Private Contextual Banditscited by 5
- 2023Differentially Private Episodic Reinforcement Learning with Heavy-tailed Rewardscited by 4
- 2025SquarechiPO: Differentially Private and Robust chi2-Preference Optimization in Offline Direct Alignmentcited by 3
- 2025On the Sample Complexity of Differentially Private Policy Optimizationcited by 3
- 2025Improved Bounds for Private and Robust Alignmentcited by 3
- 2023Concurrent Shuffle Differential Privacy Under Continual Observationcited by 2
- 2025DP-NCB: Privacy Preserving Fair Banditscited by 2
- 2021Cascading Bandit under Differential Privacycited by 1
- 2024Privacy Preserving Adaptive Experiment Designcited by 1
- 2024Privacy Preserving Reinforcement Learning for Population Processescited by 1
- 2024Federated Online Prediction from Experts with Differential Privacy: Separations and Regret Speed-upscited by 1
- 2024QuACK: A Multipurpose Queuing Algorithm for Cooperative k-Armed Banditscited by 1
- 2024Near-Optimal Reinforcement Learning with Shuffle Differential Privacycited by 1
- 2025Faster Rates for Private Adversarial Banditscited by 1
- 2023Thompson Sampling under Bernoulli Rewards with Local Differential Privacycited by 0
- 2023Beyond Random Noise: Insights on Anonymization Strategies from a Latent Bandit Studycited by 0
- 2024Differentially Private High Dimensional Banditscited by 0
- 2025Locally Differentially Private Thresholding Banditscited by 0
- 2025Beyond ATE: Multi-Criteria Design for A/B Testingcited by 0
- 2026Unlearning Offline Stochastic Multi-Armed Banditscited by 0
- 2026Minimax Quantile Lower Bounds for Interactive Statistical Decision Making with Privacycited by 0
- 2026Minimax Quantile Lower Bounds for Interactive Statistical Decision Making with Privacy22 Jun 2026
- 2026Unlearning Offline Stochastic Multi-Armed Bandits1 May 2026
- 2025Improved Bounds for Private and Robust Alignment29 Dec 2025
- 2025On the Sample Complexity of Differentially Private Policy Optimization24 Oct 2025
- 2025Beyond ATE: Multi-Criteria Design for A/B Testing6 Sep 2025
- 2025DP-NCB: Privacy Preserving Fair Bandits5 Aug 2025
- 2025Locally Differentially Private Thresholding Bandits30 Jul 2025
- 2025Faster Rates for Private Adversarial Bandits27 May 2025
- 2025SquarechiPO: Differentially Private and Robust chi2-Preference Optimization in Offline Direct Alignment27 May 2025
- 2024Near-Optimal Reinforcement Learning with Shuffle Differential Privacy18 Nov 2024
- 2024QuACK: A Multipurpose Queuing Algorithm for Cooperative k-Armed Bandits31 Oct 2024
- 2024Federated Online Prediction from Experts with Differential Privacy: Separations and Regret Speed-ups27 Sep 2024
25 more
- 2024Privacy Preserving Reinforcement Learning for Population Processes25 Jun 2024
- 2024Differentially Private High Dimensional Bandits6 Feb 2024
- 2024Privacy Preserving Adaptive Experiment Design16 Jan 2024
- 2023Beyond Random Noise: Insights on Anonymization Strategies from a Latent Bandit Study30 Sep 2023
- 2023Thompson Sampling under Bernoulli Rewards with Local Differential Privacy3 Jul 2023
- 2023Federated Linear Contextual Bandits with User-level Differential Privacy8 Jun 2023
- 2023Differentially Private Episodic Reinforcement Learning with Heavy-tailed Rewards1 Jun 2023
- 2023On Differentially Private Federated Linear Contextual Bandits27 Feb 2023
- 2023On Private and Robust Bandits6 Feb 2023
- 2023Concurrent Shuffle Differential Privacy Under Continual Observation29 Jan 2023
- 2022Dynamic Global Sensitivity for Differentially Private Contextual Bandits30 Aug 2022
- 2022Differentially Private Linear Bandits with Partial Distributed Feedback12 Jul 2022
- 2022Differentially Private Stochastic Linear Bandits: (Almost) for Free7 Jul 2022
- 2022Distributed Differential Privacy in Multi-Armed Bandits12 Jun 2022
- 2022Shuffle Private Linear Contextual Bandits11 Feb 2022
- 2022Differentially Private Reinforcement Learning with Linear Function Approximation18 Jan 2022
- 2021Differentially Private Regret Minimization in Episodic Markov Decision Processes20 Dec 2021
- 2021Privacy Amplification via Shuffling for Linear Contextual Bandits11 Dec 2021
- 2021Privacy-Preserving Communication-Efficient Federated Multi-Armed Bandits2 Nov 2021
- 2021Differential Privacy in Personalized Pricing with Nonparametric Demand Models10 Sep 2021
- 2021Optimal Order Simple Regret for Gaussian Process Bandits20 Aug 2021
- 2021Generalized Linear Bandits with Local Differential Privacy7 Jun 2021
- 2021Differentially Private Multi-Armed Bandits in the Shuffle Model5 Jun 2021
- 2021Optimal Rates of (Locally) Differentially Private Heavy-tailed Multi-Armed Bandits4 Jun 2021
- 2021Cascading Bandit under Differential Privacy24 May 2021
- 2026Unlearning Offline Stochastic Multi-Armed Banditscited by 0
- 2026Unlearning Offline Stochastic Multi-Armed Bandits1 May 2026
- 2021Optimal Order Simple Regret for Gaussian Process Banditscited by 52
- 2021Generalized Linear Bandits with Local Differential Privacycited by 29
- 2022Shuffle Private Linear Contextual Banditscited by 27
- 2021Optimal Rates of (Locally) Differentially Private Heavy-tailed Multi-Armed Banditscited by 25
- 2021Differentially Private Multi-Armed Bandits in the Shuffle Modelcited by 24
- 2021Differentially Private Regret Minimization in Episodic Markov Decision Processescited by 23
- 2022Differentially Private Reinforcement Learning with Linear Function Approximationcited by 22
- 2022Differentially Private Stochastic Linear Bandits: (Almost) for Freecited by 19
- 2021Privacy Amplification via Shuffling for Linear Contextual Banditscited by 17
- 2022Distributed Differential Privacy in Multi-Armed Banditscited by 14
- 2023On Differentially Private Federated Linear Contextual Banditscited by 14
- 2021Differential Privacy in Personalized Pricing with Nonparametric Demand Modelscited by 13
12 most cited of 34 All 34 (JSON)
- 2026Minimax Quantile Lower Bounds for Interactive Statistical Decision Making with Privacy22 Jun 2026
- 2025On the Sample Complexity of Differentially Private Policy Optimization24 Oct 2025
- 2025Beyond ATE: Multi-Criteria Design for A/B Testing6 Sep 2025
- 2025DP-NCB: Privacy Preserving Fair Bandits5 Aug 2025
- 2025Locally Differentially Private Thresholding Bandits30 Jul 2025
- 2025Faster Rates for Private Adversarial Bandits27 May 2025
- 2024Near-Optimal Reinforcement Learning with Shuffle Differential Privacy18 Nov 2024
- 2024QuACK: A Multipurpose Queuing Algorithm for Cooperative k-Armed Bandits31 Oct 2024
- 2024Federated Online Prediction from Experts with Differential Privacy: Separations and Regret Speed-ups27 Sep 2024
- 2024Privacy Preserving Reinforcement Learning for Population Processes25 Jun 2024
- 2024Differentially Private High Dimensional Bandits6 Feb 2024
- 2024Privacy Preserving Adaptive Experiment Design16 Jan 2024
12 newest of 34 All 34 (JSON)