On Distributed Cooperative Decision-Making in Multiarmed Bandits
Not on the map. Why?
Abstract (arXiv)
We study the explore-exploit tradeoff in distributed cooperative decision-making using the context of the multiarmed bandit (MAB) problem. For the distributed cooperative MAB problem, we design the cooperative UCB algorithm that comprises two interleaved distributed processes: (i) running consensus algorithms for estimation of rewards, and (ii) upper-confidence-bound-based heuristics for selection of arms. We rigorously analyze the performance of the cooperative UCB algorithm and characterize the influence of communication graph structure on the decision-making performance of the group.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Dec 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 7; 2023: 7; 2024: 4; 2025: 3; 2026: 3.
33 papers.
Sort:
By area:
- 2021Federated Multi-armed Bandits with Personalizationcited by 62
- 2021Federated Linear Contextual Banditscited by 61
- 2021Federated Multi-Armed Banditscited by 59
- 2022A Simple and Provably Efficient Algorithm for Asynchronous Federated Contextual Linear Banditscited by 28
- 2021Provably Efficient Cooperative Multi-Agent Reinforcement Learning with Function Approximationcited by 23
- 2022A survey on multi-player banditscited by 19
- 2021One More Step Towards Reality: Cooperative Bandits with Imperfect Communicationcited by 15
- 2022Distributed Contextual Linear Bandits with Minimax Optimal Communication Costcited by 13
- 2023Decentralized Randomly Distributed Multi-agent Multi-armed Bandit with Heterogeneous Rewardscited by 11
- 2022Private and Byzantine-Proof Cooperative Decision-Makingcited by 10
- 2021Multi-player Multi-armed Bandits with Collision-Dependent Reward Distributionscited by 8
- 2021When to Call Your Neighbor? Strategic Communication in Cooperative Stochastic Banditscited by 8
21 more
- 2022Distributed Linear Bandits under Communication Constraintscited by 8
- 2024Linear Contextual Bandits with Interferencecited by 8
- 2022Federated Multi-Armed Bandits Under Byzantine Attackscited by 6
- 2022Collaborative Learning in Kernel-based Bandits for Distributed Userscited by 6
- 2021Cooperative Stochastic Multi-agent Multi-armed Bandits Robust to Adversarial Corruptionscited by 5
- 2021Decentralized Upper Confidence Bound Algorithms for Homogeneous Multi-Agent Multi-Armed Banditscited by 3
- 2023Incentivized Communication for Federated Banditscited by 3
- 2023Byzantine-Resilient Decentralized Multi-Armed Banditscited by 3
- 2025Multiplayer Information Asymmetric Bandits in Metric Spacescited by 3
- 2025Multiplayer Information Asymmetric Contextual Banditscited by 3
- 2024Incentivized Truthful Communication for Federated Banditscited by 2
- 2023Regret Lower Bounds in Multi-agent Multi-armed Banditcited by 1
- 2023Harnessing the Power of Federated Learning in Federated Contextual Banditscited by 1
- 2024Decentralized Blockchain-based Robust Multi-agent Multi-armed Banditcited by 1
- 2026Laplacian Kernelized Banditcited by 1
- 2026Multi-Objective Multi-Agent Bandits: From Learning Efficiency to Fairness Optimizationcited by 1
- 2023Constant or logarithmic regret in asynchronous multiplayer banditscited by 0
- 2023Distributed Optimization via Kernelized Multi-armed Banditscited by 0
- 2024Order-Optimal Regret in Distributed Kernel Bandits using Uniform Sampling with Shared Randomnesscited by 0
- 2025Distributed Multi-Agent Bandits Over ErdHos-R'enyi Random Networkscited by 0
- 2026Bandit Learning in General Open Multi-agent Systemscited by 0
- 2026Multi-Objective Multi-Agent Bandits: From Learning Efficiency to Fairness Optimization7 May 2026
- 2026Bandit Learning in General Open Multi-agent Systems7 May 2026
- 2026Laplacian Kernelized Bandit1 Jan 2026
- 2025Distributed Multi-Agent Bandits Over ErdHos-R'enyi Random Networks26 Oct 2025
- 2025Multiplayer Information Asymmetric Contextual Bandits11 Mar 2025
- 2025Multiplayer Information Asymmetric Bandits in Metric Spaces11 Mar 2025
- 2024Linear Contextual Bandits with Interference24 Sep 2024
- 2024Order-Optimal Regret in Distributed Kernel Bandits using Uniform Sampling with Shared Randomness20 Feb 2024
- 2024Incentivized Truthful Communication for Federated Bandits7 Feb 2024
- 2024Decentralized Blockchain-based Robust Multi-agent Multi-armed Bandit6 Feb 2024
- 2023Harnessing the Power of Federated Learning in Federated Contextual Bandits26 Dec 2023
- 2023Distributed Optimization via Kernelized Multi-armed Bandits7 Dec 2023
21 more
- 2023Byzantine-Resilient Decentralized Multi-Armed Bandits11 Oct 2023
- 2023Incentivized Communication for Federated Bandits21 Sep 2023
- 2023Regret Lower Bounds in Multi-agent Multi-armed Bandit15 Aug 2023
- 2023Decentralized Randomly Distributed Multi-agent Multi-armed Bandit with Heterogeneous Rewards8 Jun 2023
- 2023Constant or logarithmic regret in asynchronous multiplayer bandits31 May 2023
- 2022A survey on multi-player bandits29 Nov 2022
- 2022Distributed Linear Bandits under Communication Constraints4 Nov 2022
- 2022Collaborative Learning in Kernel-based Bandits for Distributed Users16 Jul 2022
- 2022A Simple and Provably Efficient Algorithm for Asynchronous Federated Contextual Linear Bandits7 Jul 2022
- 2022Private and Byzantine-Proof Cooperative Decision-Making27 May 2022
- 2022Distributed Contextual Linear Bandits with Minimax Optimal Communication Cost26 May 2022
- 2022Federated Multi-Armed Bandits Under Byzantine Attacks9 May 2022
- 2021One More Step Towards Reality: Cooperative Bandits with Imperfect Communication24 Nov 2021
- 2021Decentralized Upper Confidence Bound Algorithms for Homogeneous Multi-Agent Multi-Armed Bandits22 Nov 2021
- 2021Federated Linear Contextual Bandits27 Oct 2021
- 2021When to Call Your Neighbor? Strategic Communication in Cooperative Stochastic Bandits8 Oct 2021
- 2021Multi-player Multi-armed Bandits with Collision-Dependent Reward Distributions25 Jun 2021
- 2021Cooperative Stochastic Multi-agent Multi-armed Bandits Robust to Adversarial Corruptions8 Jun 2021
- 2021Provably Efficient Cooperative Multi-Agent Reinforcement Learning with Function Approximation8 Mar 2021
- 2021Federated Multi-armed Bandits with Personalization25 Feb 2021
- 2021Federated Multi-Armed Bandits28 Jan 2021
- 2024Linear Contextual Bandits with Interferencecited by 8
- 2024Linear Contextual Bandits with Interference24 Sep 2024
- 2025Multiplayer Information Asymmetric Contextual Banditscited by 3
- 2025Multiplayer Information Asymmetric Contextual Bandits11 Mar 2025
- 2021Federated Multi-armed Bandits with Personalizationcited by 62
- 2021Federated Linear Contextual Banditscited by 61
- 2021Federated Multi-Armed Banditscited by 59
- 2022A Simple and Provably Efficient Algorithm for Asynchronous Federated Contextual Linear Banditscited by 28
- 2021Provably Efficient Cooperative Multi-Agent Reinforcement Learning with Function Approximationcited by 23
- 2022A survey on multi-player banditscited by 19
- 2021One More Step Towards Reality: Cooperative Bandits with Imperfect Communicationcited by 15
- 2022Distributed Contextual Linear Bandits with Minimax Optimal Communication Costcited by 13
- 2023Decentralized Randomly Distributed Multi-agent Multi-armed Bandit with Heterogeneous Rewardscited by 11
- 2022Private and Byzantine-Proof Cooperative Decision-Makingcited by 10
- 2021Multi-player Multi-armed Bandits with Collision-Dependent Reward Distributionscited by 8
- 2021When to Call Your Neighbor? Strategic Communication in Cooperative Stochastic Banditscited by 8
12 most cited of 31 All 31 (JSON)
- 2026Multi-Objective Multi-Agent Bandits: From Learning Efficiency to Fairness Optimization7 May 2026
- 2026Bandit Learning in General Open Multi-agent Systems7 May 2026
- 2026Laplacian Kernelized Bandit1 Jan 2026
- 2025Distributed Multi-Agent Bandits Over ErdHos-R'enyi Random Networks26 Oct 2025
- 2025Multiplayer Information Asymmetric Bandits in Metric Spaces11 Mar 2025
- 2024Order-Optimal Regret in Distributed Kernel Bandits using Uniform Sampling with Shared Randomness20 Feb 2024
- 2024Incentivized Truthful Communication for Federated Bandits7 Feb 2024
- 2024Decentralized Blockchain-based Robust Multi-agent Multi-armed Bandit6 Feb 2024
- 2023Harnessing the Power of Federated Learning in Federated Contextual Bandits26 Dec 2023
- 2023Distributed Optimization via Kernelized Multi-armed Bandits7 Dec 2023
- 2023Byzantine-Resilient Decentralized Multi-Armed Bandits11 Oct 2023
- 2023Incentivized Communication for Federated Bandits21 Sep 2023
12 newest of 31 All 31 (JSON)