mlsanityData to 7 Oct 2026

Scalable Average Consensus with Compressed Communications

arXiv 2109.06996 ↗First posted 14 Sep 2021math.OC cs.DC cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

We propose a new decentralized average consensus algorithm with compressed communication that scales linearly with the network size n. We prove that the proposed method converges to the average of the initial values held locally by the agents of a network when agents are allowed to communicate with compressed messages. The proposed algorithm works for a broad class of compression operators (possibly biased), where agents interact over arbitrary static, undirected, and connected networks. We further present numerical experiments that confirm our theoretical results and illustrate the scalability and communication efficiency of our algorithm.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 14 of its 31 references that are in the map. First posted on arXiv 14 Sep 2021.

Builds on

14 of 31 references.

References · 14

  1. 2019Advances and Open Problems in Federated Learningcited by 3,021
  2. 2021A Field Guide to Federated Optimizationcited by 312
  3. 2019Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communicationcited by 218
  4. 2016Achieving Geometric Convergence for Distributed Optimization over Time-Varying Graphscited by 149
  5. 2016QSGD: Communication-Efficient SGD via Gradient Quantization and Encodingcited by 147
  6. 2020On Biased Compression for Distributed Learningcited by 140
  7. 2020A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!cited by 41
  8. 2015Fast Convergence Rates for Distributed Non-Bayesian Learningcited by 26
  9. 2020Quantized Decentralized Stochastic Learning over Directed Graphscited by 24
  10. 2021Innovation Compression for Communication-efficient Distributed Optimization with Linear Convergencecited by 12
  11. 2021Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networkscited by 10
  12. 2021Communication-efficient Distributed Cooperative Learning with Compressed Beliefscited by 4
2 more
  1. 2018Graph-Theoretic Analysis of Belief System Dynamics under Logic Constraintscited by 3
  2. 2013Average Consensus on Arbitrary Strongly Connected Digraphs with Time-Varying Topologiescited by 1

Built on by

Cited by year

Citing papers per year: 2022: 3.

3 papers.