mlsanityData to 7 Oct 2026

Resilient Decentralized Wireless Federated Learning via Gradient Tracking with AdamW

arXiv 2608.25535 ↗First posted 26 Aug 2026cs.LG cs.DC cs.NIcited by 0

Not on the map. Why?

Abstract (arXiv)

Wireless Internet-of-Things (IoT) edge networks require decentralized learning (DecL) methods that can operate reliably under both heterogeneous local data and communication-constrained wireless links. However, existing decentralized optimization schemes often incur substantial communication overhead and degraded performance when transmissions are constrained by strict airtime budgets, fading channels, and packet losses. This paper proposes QEF-GT-AdamW, a communication-efficient and outage-resilient algorithm for DecL over wireless communication (WCom) networks. The proposed method combines gradient tracking to mitigate the effect of non-IID data, AdamW-based adaptive optimization to improve training stability, and dual-stream biased quantization with error feedback to reduce communication payloads for both model and tracking exchanges. To address unreliable broadcast communication, the proposed framework further employs a local fallback strategy when scheduled packets are not successfully received. We explicitly model the effect of bandwidth, transmit power, airtime constraints, and fading channels on DecL performance, and establish convergence guarantees for the proposed algorithm under compressed and unreliable wireless communication. Experimental results on heterogeneous MNIST and CIFAR-10 settings show that QEF-GT-AdamW consistently improves robustness and convergence performance over representative DecL baselines while achieving favorable accuracy-communication trade-offs under limited wireless resources.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 22 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

13 of 22 references.

References · 13

  1. 2019Error Feedback Fixes SignSGD and other Gradient Compression Schemescited by 306
  2. 2020Personalized Cross-Silo Federated Learning on Non-IID Datacited by 282
  3. 2019Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communicationcited by 218
  4. 2022FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correctioncited by 181
  5. 2022Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challengescited by 137
  6. 2021EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedbackcited by 131
  7. 2018Distributed Stochastic Gradient Tracking Methodscited by 106
  8. 2013Distributed optimization over time-varying directed graphscited by 77
  9. 2022An Improved Analysis of Gradient Tracking for Decentralized Machine Learningcited by 68
  10. 2018Push-Pull Gradient Methods for Distributed Optimization in Networkscited by 45
  11. 2021Distributed Methods with Compressed Communication for Solving Variational Inequalities, with Theoretical Guaranteescited by 15
  12. 2020GTAdam: Gradient Tracking with Adaptive Momentum for Distributed Online Optimizationcited by 9
1 more
  1. 2023Communication-Efficient Design for Quantized Decentralized Federated Learningcited by 6

Built on by

Not cited yet.