On Analog Gradient Descent Learning over Multiple Access Fading Channels
Not on the map. Why?
Abstract (arXiv)
We consider a distributed learning problem over multiple access channel (MAC) using a large wireless network. The computation is made by the network edge and is based on received data from a large number of distributed nodes which transmit over a noisy fading MAC. The objective function is a sum of the nodes' local loss functions. This problem has attracted a growing interest in distributed sensing systems, and more recently in federated learning. We develop a novel Gradient-Based Multiple Access (GBMA) algorithm to solve the distributed learning problem over MAC. Specifically, the nodes transmit an analog function of the local gradient using common shaping waveforms and the network edge receives a superposition of the analog transmitted signals used for updating the estimate. GBMA does not require power control or beamforming to cancel the fading effect as in other algorithms, and operates directly with noisy distorted gradients. We analyze the performance of GBMA theoretically, and prove that it can approach the convergence rate of the centralized gradient descent (GD) algorithm in large networks. Specifically, we establish a finite-sample bound of the error for both convex and strongly convex loss functions with Lipschitz gradient. Furthermore, we provide energy scaling laws for approaching the centralized convergence rate as the number of nodes increases. Finally, experimental results support the theoretical findings, and demonstrate strong performance of GBMA using synthetic and real data.
Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 9; 2023: 15; 2024: 11; 2025: 5; 2026: 5.
61 papers.
Sort:
- 2021Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applicationscited by 96
- 2021Federated Learning: A Signal Processing Perspectivecited by 49
- 2021Time-Correlated Sparsification for Communication-Efficient Federated Learningcited by 25
- 2021Privacy Amplification for Federated Learning via User Sampling and Wireless Aggregationcited by 22
- 2023Over-The-Air Federated Learning: Status Quo, Open Challenges, and Future Directionscited by 21
- 2022A Survey on Over-the-Air Computationcited by 19
- 2021Over-the-Air Decentralized Federated Learningcited by 18
- 2021Accelerated Gradient Descent Learning over Multiple Access Fading Channelscited by 14
- 2024A Survey on Integrated Sensing, Communication, and Computationcited by 12
- 2021Federated Learning over Wireless Networks: A Band-limited Coordinated Descent Approachcited by 11
- 2022Over-the-Air Federated Learning via Second-Order Optimizationcited by 11
- 2021Temporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge Learningcited by 10
38 more
- 2023Over-the-Air Federated Learning and Optimizationcited by 10
- 2022Non-Coherent Over-the-Air Decentralized Gradient Descentcited by 9
- 2021Communication-Efficient Split Learning Based on Analog Communication and Over the Air Aggregationcited by 8
- 2022Over-the-Air Federated Learning with Joint Adaptive Computation and Power Controlcited by 8
- 2023Client Selection for Generalization in Accelerated Federated Learning: A Multi-Armed Bandit Approachcited by 8
- 2024Federated Learning via Lattice Joint Source-Channel Codingcited by 6
- 2021Robust Federated Learning via Over-The-Air Computationcited by 5
- 2022Differentially Private Federated Learning via Reconfigurable Intelligent Surfacecited by 5
- 2023Communication and Energy Efficient Wireless Federated Learning with Intrinsic Privacycited by 5
- 2024Compute-Update Federated Learning: A Lattice Coding Approach Over-the-Aircited by 5
- 2024Over-the-Air Federated Learning via Weighted Aggregationcited by 5
- 2022Over-The-Air Federated Learning under Byzantine Attackscited by 4
- 2023Riemannian Low-Rank Model Compression for Federated Learning with Over-the-Air Aggregationcited by 4
- 2023AirFL-Mem: Improving Communication-Learning Trade-Off by Long-Term Memorycited by 4
- 2024Rendering Wireless Environments Useful for Gradient Estimators: A Zero-Order Stochastic Federated Learning Methodcited by 4
- 2024Adaptive Federated Learning Over the Aircited by 4
- 2024NCAirFL: CSI-Free Over-the-Air Federated Learning Based on Non-Coherent Detectioncited by 4
- 2021Over-the-Air Statistical Estimationcited by 3
- 2021Federated Learning with Downlink Device Selectioncited by 3
- 2021Learning, Computing, and Trustworthiness in Intelligent IoT Environments: Performance-Energy Tradeoffscited by 3
- 2023Personalizing Federated Learning with Over-the-Air Computationscited by 3
- 2024Pre-Training and Personalized Fine-Tuning via Over-the-Air Federated Meta-Learning: Convergence-Generalization Trade-Offscited by 3
- 2024Robust Federated Learning Over the Air: Combating Heavy-Tailed Noise with Median Anchored Clippingcited by 3
- 2025Over-the-Air Federated Learning: Rethinking Edge AI Through Signal Processingcited by 3
- 2021Adaptive Scheduling for Machine Learning Tasks over Networkscited by 2
- 2021Fundamental limits of over-the-air optimization: Are analog schemes optimal?cited by 2
- 2022Over-The-Air Federated Learning Over Scalable Cell-free Massive MIMOcited by 2
- 2023Sparse Training for Federated Learning with Regularized Error Correctioncited by 2
- 2021Over-the-Air Federated Learning with Retransmissions (Extended Version)cited by 1
- 2022Matching Pursuit Based Scheduling for Over-the-Air Federated Learningcited by 1
- 2023Accelerating Wireless Federated Learning via Nesterov's Momentum and Distributed Principle Component Analysiscited by 1
- 2023Differentially Private Wireless Federated Learning Using Orthogonal Sequencescited by 1
- 2024GP-FL: Model-Based Hessian Estimation for Second-Order Over-the-Air Federated Learningcited by 1
- 2025PAUSE: Low-Latency and Privacy-Aware Active User Selection for Federated Learningcited by 1
- 2025Rethinking Federated Learning Over the Air: The Blessing of Scaling Upcited by 1
- 2026Age-Aware Edge-Blind Federated Learning via Over-the-Air Aggregationcited by 1
- 2022Random Orthogonalization for Federated Learning in Massive MIMO Systemscited by 0
- 2023Semi-Asynchronous Federated Edge Learning Mechanism via Over-the-air Computationcited by 0
50 most cited of 61 All 61 (JSON)
- 2026AirGC-CD: Gaussian-Circulant Precoding for Exactly Debiasable PAPR Reduction in Over-the-Air Federated Learning19 Sep 2026
- 2026Non-Coherent Over-the-Air Federated Learning: Protocol, Convergence, and Device Scheduling8 Sep 2026
- 2026Polar Code Based Federated Learning: Convergence Analysis and Resource Allocation14 Aug 2026
- 2026Channel-Adaptive Robust Aggregation for Over-the-Air Federated Learning in Heterogeneous Networks5 Jul 2026
- 2026Age-Aware Edge-Blind Federated Learning via Over-the-Air Aggregation2 Feb 2026
- 2025Timely Parameter Updating in Over-the-Air Federated Learning22 Dec 2025
- 2025Over-the-Air Federated Learning: Rethinking Edge AI Through Signal Processing3 Dec 2025
- 2025Rethinking Federated Learning Over the Air: The Blessing of Scaling Up25 Aug 2025
- 2025Free Privacy Protection for Wireless Federated Learning: Enjoy It or Suffer from It?15 Jun 2025
- 2025PAUSE: Low-Latency and Privacy-Aware Active User Selection for Federated Learning17 Mar 2025
- 2024GP-FL: Model-Based Hessian Estimation for Second-Order Over-the-Air Federated Learning5 Dec 2024
- 2024NCAirFL: CSI-Free Over-the-Air Federated Learning Based on Non-Coherent Detection20 Nov 2024
38 more
- 2024Robust Federated Learning Over the Air: Combating Heavy-Tailed Noise with Median Anchored Clipping23 Sep 2024
- 2024Over-the-Air Federated Learning via Weighted Aggregation12 Sep 2024
- 2024Compute-Update Federated Learning: A Lattice Coding Approach Over-the-Air10 Sep 2024
- 2024A Survey on Integrated Sensing, Communication, and Computation15 Aug 2024
- 2024Pre-Training and Personalized Fine-Tuning via Over-the-Air Federated Meta-Learning: Convergence-Generalization Trade-Offs17 Jun 2024
- 2024An Autoencoder-Based Constellation Design for AirComp in Wireless Federated Learning15 Apr 2024
- 2024Adaptive Federated Learning Over the Air11 Mar 2024
- 2024Federated Learning via Lattice Joint Source-Channel Coding1 Mar 2024
- 2024Rendering Wireless Environments Useful for Gradient Estimators: A Zero-Order Stochastic Federated Learning Method30 Jan 2024
- 2023Sparse Training for Federated Learning with Regularized Error Correction21 Dec 2023
- 2023A Masked Pruning Approach for Dimensionality Reduction in Communication-Efficient Federated Learning Systems6 Dec 2023
- 2023AirFL-Mem: Improving Communication-Learning Trade-Off by Long-Term Memory25 Oct 2023
- 2023Over-the-air Federated Policy Gradient25 Oct 2023
- 2023Over-the-Air Federated Learning and Optimization16 Oct 2023
- 2023Federated Linear Bandit Learning via Over-the-Air Computation25 Aug 2023
- 2023Over-the-Air Computation Aided Federated Learning with the Aggregation of Normalized Gradient17 Aug 2023
- 2023Over-The-Air Federated Learning: Status Quo, Open Challenges, and Future Directions3 Jul 2023
- 2023Differentially Private Wireless Federated Learning Using Orthogonal Sequences14 Jun 2023
- 2023Riemannian Low-Rank Model Compression for Federated Learning with Over-the-Air Aggregation4 Jun 2023
- 2023Semi-Asynchronous Federated Edge Learning Mechanism via Over-the-air Computation6 May 2023
- 2023Communication and Energy Efficient Wireless Federated Learning with Intrinsic Privacy15 Apr 2023
- 2023Accelerating Wireless Federated Learning via Nesterov's Momentum and Distributed Principle Component Analysis31 Mar 2023
- 2023Client Selection for Generalization in Accelerated Federated Learning: A Multi-Armed Bandit Approach18 Mar 2023
- 2023Personalizing Federated Learning with Over-the-Air Computations24 Feb 2023
- 2022Over-The-Air Federated Learning Over Scalable Cell-free Massive MIMO13 Dec 2022
- 2022Non-Coherent Over-the-Air Decentralized Gradient Descent19 Nov 2022
- 2022A Survey on Over-the-Air Computation20 Oct 2022
- 2022Random Orthogonalization for Federated Learning in Massive MIMO Systems18 Oct 2022
- 2022Matching Pursuit Based Scheduling for Over-the-Air Federated Learning14 Jun 2022
- 2022Over-the-Air Federated Learning with Joint Adaptive Computation and Power Control12 May 2022
- 2022Over-The-Air Federated Learning under Byzantine Attacks5 May 2022
- 2022Differentially Private Federated Learning via Reconfigurable Intelligent Surface31 Mar 2022
- 2022Over-the-Air Federated Learning via Second-Order Optimization29 Mar 2022
- 2021Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications24 Nov 2021
- 2021Over-the-Air Federated Learning with Retransmissions (Extended Version)19 Nov 2021
- 2021Robust Federated Learning via Over-The-Air Computation1 Nov 2021
- 2021Learning, Computing, and Trustworthiness in Intelligent IoT Environments: Performance-Energy Tradeoffs4 Oct 2021
- 2021Fundamental limits of over-the-air optimization: Are analog schemes optimal?11 Sep 2021
50 newest of 61 All 61 (JSON)
- 2021Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applicationscited by 96
- 2021Federated Learning: A Signal Processing Perspectivecited by 49
- 2021Time-Correlated Sparsification for Communication-Efficient Federated Learningcited by 25
- 2021Privacy Amplification for Federated Learning via User Sampling and Wireless Aggregationcited by 22
- 2023Over-The-Air Federated Learning: Status Quo, Open Challenges, and Future Directionscited by 21
- 2022A Survey on Over-the-Air Computationcited by 19
- 2021Over-the-Air Decentralized Federated Learningcited by 18
- 2021Accelerated Gradient Descent Learning over Multiple Access Fading Channelscited by 14
- 2024A Survey on Integrated Sensing, Communication, and Computationcited by 12
- 2021Federated Learning over Wireless Networks: A Band-limited Coordinated Descent Approachcited by 11
- 2022Over-the-Air Federated Learning via Second-Order Optimizationcited by 11
- 2021Temporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge Learningcited by 10
12 most cited of 61 All 61 (JSON)
- 2026AirGC-CD: Gaussian-Circulant Precoding for Exactly Debiasable PAPR Reduction in Over-the-Air Federated Learning19 Sep 2026
- 2026Non-Coherent Over-the-Air Federated Learning: Protocol, Convergence, and Device Scheduling8 Sep 2026
- 2026Polar Code Based Federated Learning: Convergence Analysis and Resource Allocation14 Aug 2026
- 2026Channel-Adaptive Robust Aggregation for Over-the-Air Federated Learning in Heterogeneous Networks5 Jul 2026
- 2026Age-Aware Edge-Blind Federated Learning via Over-the-Air Aggregation2 Feb 2026
- 2025Timely Parameter Updating in Over-the-Air Federated Learning22 Dec 2025
- 2025Over-the-Air Federated Learning: Rethinking Edge AI Through Signal Processing3 Dec 2025
- 2025Rethinking Federated Learning Over the Air: The Blessing of Scaling Up25 Aug 2025
- 2025Free Privacy Protection for Wireless Federated Learning: Enjoy It or Suffer from It?15 Jun 2025
- 2025PAUSE: Low-Latency and Privacy-Aware Active User Selection for Federated Learning17 Mar 2025
- 2024GP-FL: Model-Based Hessian Estimation for Second-Order Over-the-Air Federated Learning5 Dec 2024
- 2024NCAirFL: CSI-Free Over-the-Air Federated Learning Based on Non-Coherent Detection20 Nov 2024
12 newest of 61 All 61 (JSON)