Distributed Linear Bandits under Communication Constraints
Not on the map. Why?
Abstract (arXiv)
We consider distributed linear bandits where M agents learn collaboratively to minimize the overall cumulative regret incurred by all agents. Information exchange is facilitated by a central server, and both the uplink and downlink communications are carried over channels with fixed capacity, which limits the amount of information that can be transmitted in each use of the channels. We investigate the regret-communication trade-off by (i) establishing information-theoretic lower bounds on the required communications (in terms of bits) for achieving a sublinear regret order; (ii) developing an efficient algorithm that achieves the minimum sublinear regret order offered by centralized learning using the minimum order of communications dictated by the information-theoretic lower bounds. For sparse linear bandits, we show a variant of the proposed algorithm offers better regret-communication trade-off by leveraging the sparsity of the problem.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 33 of its 67 references that are in the map. First posted on arXiv 4 Nov 2022.
Builds on
33 of 67 references.
References · 33
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
- 2019FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantizationcited by 349
- 2020Federated Learning with Compression: Unified Analysis and Sharp Guaranteescited by 159
- 2016Distributed Mean Estimation with Limited Communicationcited by 134
- 2019A Short Note on Concentration Inequalities for Random Vectors with SubGaussian Normcited by 105
- 2021Federated Multi-armed Bandits with Personalizationcited by 62
- 2020High-Dimensional Sparse Linear Banditscited by 61
- 2021Federated Linear Contextual Banditscited by 61
- 2021Adaptive Quantization of Model Updates for Communication-Efficient Federated Learningcited by 60
- 2020Federated Bandit: A Gossiping Approachcited by 55
- 2020Impact of Representation Learning in Linear Banditscited by 51
21 more
- 2016Distributed Clustering of Linear Bandits in Peer to Peer Networkscited by 50
- 2019Social Learning in Multi Agent Multi Armed Banditscited by 48
- 2013Distributed Exploration in Multi-Armed Banditscited by 46
- 2019Collaborative Learning with Limited Interaction: Tight Bounds for Distributed Exploration in Multi-Armed Banditscited by 40
- 2021DAdaQuant: Doubly-adaptive quantization for communication-efficient Federated Learningcited by 40
- 2020The Gossiping Insert-Eliminate Algorithm for Multi-Agent Banditscited by 37
- 2015On Distributed Cooperative Decision-Making in Multiarmed Banditscited by 33
- 2019Communication-Efficient Distributed Learning via Lazily Aggregated Quantized Gradientscited by 32
- 2021Multi-Agent Multi-Armed Bandits with Limited Communicationcited by 29
- 2020Communication-Efficient Distributed Deep Learning: A Comprehensive Surveycited by 25
- 2022Towards Efficient Communications in Federated Learning: A Contemporary Surveycited by 24
- 2021Exploiting Heterogeneity in Robust Federated Best-Arm Identificationcited by 20
- 2021Solving Multi-Arm Bandit Using a Few Bits of Communicationcited by 16
- 2022Distributed Contextual Linear Bandits with Minimax Optimal Communication Costcited by 13
- 2018Game of Thrones: Fully Distributed Learning for Multi-Player Banditscited by 12
- 2020Nearly Dimension-Independent Sparse Linear Bandit over Small Action Spaces via Best Subset Selectioncited by 12
- 2014Optimality guarantees for distributed statistical estimationcited by 9
- 2022Linear Stochastic Bandits over a Bit-Constrained Channelcited by 9
- 2020Multi-Agent Low-Dimensional Linear Banditscited by 8
- 2022The Role of Interactivity in Structured Estimationcited by 7
- 2021Adaptive Clustering and Personalization in Multi-Agent Stochastic Linear Banditscited by 4
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 1; 2026: 2.
8 papers.
- 2024The Sample-Communication Complexity Trade-off in Federated Q-Learningcited by 8
- 2023A Communication-Efficient Adaptive Algorithm for Federated Learning under Cumulative Regretcited by 7
- 2023Federated Linear Bandits with Finite Adversarial Actionscited by 3
- 2023Harnessing the Power of Federated Learning in Federated Contextual Banditscited by 1
- 2025Characterizing the Accuracy-Communication-Privacy Trade-off in Distributed Stochastic Convex Optimizationcited by 1
- 2026Batched Stochastic Linear Bandits with 1-Bit Communication Constraintscited by 1
- 2024Order-Optimal Regret in Distributed Kernel Bandits using Uniform Sampling with Shared Randomnesscited by 0
- 2026Remote Action Generation: Remote Control with Minimal Communicationcited by 0
- 2026Batched Stochastic Linear Bandits with 1-Bit Communication Constraints29 May 2026
- 2026Remote Action Generation: Remote Control with Minimal Communication3 May 2026
- 2025Characterizing the Accuracy-Communication-Privacy Trade-off in Distributed Stochastic Convex Optimization6 Jan 2025
- 2024The Sample-Communication Complexity Trade-off in Federated Q-Learning30 Aug 2024
- 2024Order-Optimal Regret in Distributed Kernel Bandits using Uniform Sampling with Shared Randomness20 Feb 2024
- 2023Harnessing the Power of Federated Learning in Federated Contextual Bandits26 Dec 2023
- 2023Federated Linear Bandits with Finite Adversarial Actions2 Nov 2023
- 2023A Communication-Efficient Adaptive Algorithm for Federated Learning under Cumulative Regret21 Jan 2023