mlsanityData to 14 Oct 2026

Decentralized Parameter-Free Online Learning with Compressed Gossip

arXiv 2605.27831 ↗First posted 27 May 2026cs.LG eess.SP math.OCcited by 0

Not on the map. Why?

Abstract (arXiv)

We study decentralized online convex optimization when agents communicate over a graph and messages may be compressed. Classical decentralized online methods typically require learning-rate choices that depend on the horizon, comparator scale, or other problem parameters, while compressed communication introduces additional disagreement that must be controlled. We propose DECO-EF (DEcentralized COin-betting with Error Feedback), a decentralized parameter-free online learning algorithm that combines coin-betting predictions with compressed difference-based gossip. Each agent maintains a clean accumulated state and a compressed tracker, and communicates only compressed state differences during gossip steps. The method is parameter-free in the online-learning sense: it does not tune to the horizon, the comparator norm, or the learning rate. We prove expected comparator-adaptive network-regret bounds for DECO-EF under compressed communication. To the best of our knowledge, this gives the first expected sublinear network-regret guarantees for parameter-free decentralized online learning under compressed communication.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

24 of 38 references.

References · 24

  1. 2019Advances and Open Problems in Federated Learningcited by 3,046
  2. 2019Introduction to Online Convex Optimizationcited by 803
  3. 2019Online Learning: A Modern Introduction Using Convex Optimizationcited by 417
  4. 2018Sparsified SGD with Memorycited by 376
  5. 2019Error Feedback Fixes SignSGD and other Gradient Compression Schemescited by 310
  6. 2019PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimizationcited by 238
  7. 2019Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communicationcited by 221
  8. 2016Coin Betting and Parameter-Free Online Learningcited by 133
  9. 2021EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedbackcited by 133
  10. 2017Network Topology and Communication-Computation Tradeoffs in Decentralized Optimizationcited by 122
  11. 2019Decentralized Deep Learning with Arbitrary Communication Compressioncited by 111
  12. 2014Unconstrained Online Linear Learning in Hilbert Spaces: Minimax Algorithms and Normal Approximationscited by 46
12 more
  1. 2020A Better Alternative to Error Feedback for Communication-Efficient Distributed Learningcited by 43
  2. 2019Cooperative Online Learning: Keeping your Neighbors Updatedcited by 22
  3. 2020Multi-Agent Online Optimization with Delays: Asynchronicity, Adaptivity, and Optimismcited by 22
  4. 2017Online Convex Optimization with Unconstrained Domains and Lossescited by 14
  5. 2020Comparator-adaptive Convex Banditscited by 11
  6. 2023Asynchronous Federated Learning with Bidirectional Quantized Communications and Buffered Aggregationcited by 10
  7. 2023Gossiped and Quantized Online Multi-Kernel Learningcited by 6
  8. 2021Distributed Online Learning for Joint Regret with Communication Constraintscited by 5
  9. 2021Cooperative Online Learning with Feedback Graphscited by 4
  10. 2024Distributed Online Optimization with Stochastic Agent Availabilitycited by 3
  11. 2024Communication Compression for Distributed Learning without Control Variatescited by 2
  12. 2025Decentralized Parameter-Free Online Learningcited by 1

Built on by

Not cited yet.