Asynchronous Decentralized Learning over Unreliable Wireless Networks
Not on the map. Why?
Abstract (arXiv)
Decentralized learning enables edge users to collaboratively train models by exchanging information via device-to-device communication, yet prior works have been limited to wireless networks with fixed topologies and reliable workers. In this work, we propose an asynchronous decentralized stochastic gradient descent (DSGD) algorithm, which is robust to the inherent computation and communication failures occurring at the wireless network edge. We theoretically analyze its performance and establish a non-asymptotic convergence guarantee. Experimental results corroborate our analysis, demonstrating the benefits of asynchronicity and outdated gradient information reuse in decentralized learning over unreliable wireless networks.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 9 of its 14 references that are in the map. First posted on arXiv 2 Feb 2022.
Builds on
9 of 14 references.
References · 9
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2020A Unified Theory of Decentralized SGD with Changing Topology and Local Updatescited by 361
- 2019Decentralized Deep Learning with Arbitrary Communication Compressioncited by 109
- 2018Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGDcited by 68
- 2021Federated Learning over Wireless Device-to-Device Networks: Algorithms and Convergence Analysiscited by 51
- 2020Decentralized Federated Learning via SGD over Wireless D2D Networkscited by 32
- 2021Over-the-Air Decentralized Federated Learningcited by 18
- 2020Decentralized SGD with Over-the-Air Computationcited by 16
- 2021Decentralized optimization with non-identical sampling in presence of stragglerscited by 1
Built on by
Citing papers per year: 2022: 4; 2023: 2; 2024: 3; 2025: 1; 2026: 3.
13 papers.
Sort:
- 2022Communication-Efficient Distributionally Robust Decentralized Learningcited by 10
- 2022Non-Coherent Over-the-Air Decentralized Gradient Descentcited by 9
- 2024Boosting Asynchronous Decentralized Learning with Model Fragmentationcited by 6
- 2024Decentralized Federated Learning Over Imperfect Communication Channelscited by 5
- 2024DRACO: Decentralized Asynchronous Federated Learning over Row-Stochastic Wireless Networkscited by 5
- 2023Decentralized Learning over Wireless Networks: The Effect of Broadcast with Random Accesscited by 3
- 2023Federated Learning: A Cutting-Edge Survey of the Latest Advancements and Applicationscited by 3
- 2025Argus: Federated Non-convex Bilevel Learning over 6G Space-Air-Ground Integrated Networkcited by 2
- 2022UAV-Aided Decentralized Learning over Mesh Networkscited by 1
- 2022UAV-Aided Multi-Community Federated Learningcited by 1
- 2026Interference-Robust Non-Coherent Over-the-Air Computation for Decentralized Optimizationcited by 0
- 2026Decentralised Federated Learning over Temporal Networks: The Role of Heterogeneitiescited by 0
1 more
- 2026Decentralized Gradient Descent: Bottleneck Regimes and Budget Complexity13 Jul 2026
- 2026Decentralised Federated Learning over Temporal Networks: The Role of Heterogeneities3 Jul 2026
- 2026Interference-Robust Non-Coherent Over-the-Air Computation for Decentralized Optimization12 Feb 2026
- 2025Argus: Federated Non-convex Bilevel Learning over 6G Space-Air-Ground Integrated Network14 May 2025
- 2024Boosting Asynchronous Decentralized Learning with Model Fragmentation16 Oct 2024
- 2024DRACO: Decentralized Asynchronous Federated Learning over Row-Stochastic Wireless Networks19 Jun 2024
- 2024Decentralized Federated Learning Over Imperfect Communication Channels21 May 2024
- 2023Federated Learning: A Cutting-Edge Survey of the Latest Advancements and Applications8 Oct 2023
- 2023Decentralized Learning over Wireless Networks: The Effect of Broadcast with Random Access12 May 2023
- 2022Non-Coherent Over-the-Air Decentralized Gradient Descent19 Nov 2022
- 2022UAV-Aided Multi-Community Federated Learning4 Jun 2022
- 2022Communication-Efficient Distributionally Robust Decentralized Learning31 May 2022
1 more
- 2022UAV-Aided Decentralized Learning over Mesh Networks2 Mar 2022
- 2022Communication-Efficient Distributionally Robust Decentralized Learningcited by 10
- 2022Non-Coherent Over-the-Air Decentralized Gradient Descentcited by 9
- 2024Boosting Asynchronous Decentralized Learning with Model Fragmentationcited by 6
- 2024Decentralized Federated Learning Over Imperfect Communication Channelscited by 5
- 2024DRACO: Decentralized Asynchronous Federated Learning over Row-Stochastic Wireless Networkscited by 5
- 2023Decentralized Learning over Wireless Networks: The Effect of Broadcast with Random Accesscited by 3
- 2023Federated Learning: A Cutting-Edge Survey of the Latest Advancements and Applicationscited by 3
- 2025Argus: Federated Non-convex Bilevel Learning over 6G Space-Air-Ground Integrated Networkcited by 2
- 2022UAV-Aided Decentralized Learning over Mesh Networkscited by 1
- 2022UAV-Aided Multi-Community Federated Learningcited by 1
- 2026Interference-Robust Non-Coherent Over-the-Air Computation for Decentralized Optimizationcited by 0
- 2026Decentralised Federated Learning over Temporal Networks: The Role of Heterogeneitiescited by 0
12 most cited of 13 All 13 (JSON)
- 2026Decentralized Gradient Descent: Bottleneck Regimes and Budget Complexity13 Jul 2026
- 2026Decentralised Federated Learning over Temporal Networks: The Role of Heterogeneities3 Jul 2026
- 2026Interference-Robust Non-Coherent Over-the-Air Computation for Decentralized Optimization12 Feb 2026
- 2025Argus: Federated Non-convex Bilevel Learning over 6G Space-Air-Ground Integrated Network14 May 2025
- 2024Boosting Asynchronous Decentralized Learning with Model Fragmentation16 Oct 2024
- 2024DRACO: Decentralized Asynchronous Federated Learning over Row-Stochastic Wireless Networks19 Jun 2024
- 2024Decentralized Federated Learning Over Imperfect Communication Channels21 May 2024
- 2023Federated Learning: A Cutting-Edge Survey of the Latest Advancements and Applications8 Oct 2023
- 2023Decentralized Learning over Wireless Networks: The Effect of Broadcast with Random Access12 May 2023
- 2022Non-Coherent Over-the-Air Decentralized Gradient Descent19 Nov 2022
- 2022UAV-Aided Multi-Community Federated Learning4 Jun 2022
- 2022Communication-Efficient Distributionally Robust Decentralized Learning31 May 2022
12 newest of 13 All 13 (JSON)