Scalable Average Consensus with Compressed Communications
Not on the map. Why?
Abstract (arXiv)
We propose a new decentralized average consensus algorithm with compressed communication that scales linearly with the network size n. We prove that the proposed method converges to the average of the initial values held locally by the agents of a network when agents are allowed to communicate with compressed messages. The proposed algorithm works for a broad class of compression operators (possibly biased), where agents interact over arbitrary static, undirected, and connected networks. We further present numerical experiments that confirm our theoretical results and illustrate the scalability and communication efficiency of our algorithm.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 14 of its 31 references that are in the map. First posted on arXiv 14 Sep 2021.
Builds on
14 of 31 references.
References · 14
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2021A Field Guide to Federated Optimizationcited by 312
- 2019Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communicationcited by 218
- 2016Achieving Geometric Convergence for Distributed Optimization over Time-Varying Graphscited by 149
- 2016QSGD: Communication-Efficient SGD via Gradient Quantization and Encodingcited by 147
- 2020On Biased Compression for Distributed Learningcited by 140
- 2020A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!cited by 41
- 2015Fast Convergence Rates for Distributed Non-Bayesian Learningcited by 26
- 2020Quantized Decentralized Stochastic Learning over Directed Graphscited by 24
- 2021Innovation Compression for Communication-efficient Distributed Optimization with Linear Convergencecited by 12
- 2021Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networkscited by 10
- 2021Communication-efficient Distributed Cooperative Learning with Compressed Beliefscited by 4
Built on by
Citing papers per year: 2022: 3.
3 papers.