mlsanityData to 14 Oct 2026

Distributed Perceptron under Bounded Staleness, Partial Participation, and Noisy Communication

arXiv 2601.10705 ↗First posted 15 Jan 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We study a semi-asynchronous client-server perceptron trained via iterative parameter mixing (IPM-style averaging): clients run local perceptron updates and a server forms a global model by aggregating the updates that arrive in each communication round. The setting captures three system effects in federated and distributed deployments: (i) stale updates due to delayed model delivery and delayed application of client computations (two-sided version lag), (ii) partial participation (intermittent client availability), and (iii) imperfect communication on both downlink and uplink, modeled as effective zero-mean additive noise with bounded second moment. We introduce a server-side aggregation rule called staleness-bucket aggregation with padding that deterministically enforces a prescribed staleness profile over update ages without assuming any stochastic model for delays or participation. Under margin separability and bounded data radius, we prove a finite-horizon expected bound on the cumulative weighted number of perceptron mistakes over a given number of server rounds: the impact of delay appears only through the mean enforced staleness, whereas communication noise contributes an additional term that grows on the order of the square root of the horizon with the total noise energy. In the noiseless case, we show how a finite expected mistake budget yields an explicit finite-round stabilization bound under a mild fresh-participation condition.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 21 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

11 of 21 references.

References · 11

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  2. 2018Local SGD Converges Fast and Communicates Littlecited by 605
  3. 2019Asynchronous Federated Optimizationcited by 267
  4. 2018Federated Learning via Over-the-Air Computationcited by 219
  5. 2021Federated Learning with Buffered Asynchronous Aggregationcited by 190
  6. 2019Federated Learning over Wireless Fading Channelscited by 183
  7. 2013Online Learning under Delayed Feedbackcited by 141
  8. 2022Sharper Convergence Guarantees for Asynchronous SGD for Distributed and Federated Learningcited by 79
  9. 2022Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delayscited by 63
  10. 2020Design and Analysis of Uplink and Downlink Communications for Federated Learningcited by 48
  11. 2015ARock: an Algorithmic Framework for Asynchronous Parallel Coordinate Updatescited by 21

Built on by

Not cited yet.