Random Orthogonalization for Federated Learning in Massive MIMO Systems
Not on the map. Why?
Abstract (arXiv)
We propose a novel communication design, termed random orthogonalization, for federated learning (FL) in a massive multiple-input and multiple-output (MIMO) wireless system. The key novelty of random orthogonalization comes from the tight coupling of FL and two unique characteristics of massive MIMO -- channel hardening and favorable propagation. As a result, random orthogonalization can achieve natural over-the-air model aggregation without requiring transmitter side channel state information (CSI) for the uplink phase of FL, while significantly reducing the channel estimation overhead at the receiver. We extend this principle to the downlink communication phase and develop a simple but highly effective model broadcast method for FL. We also relax the massive MIMO assumption by proposing an enhanced random orthogonalization design for both uplink and downlink FL communications, that does not rely on channel hardening or favorable propagation. Theoretical analyses with respect to both communication and machine learning performance are carried out. In particular, an explicit relationship among the convergence rate, the number of clients, and the number of antennas is established. Experimental results validate the effectiveness and efficiency of random orthogonalization for FL in massive MIMO.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 62 references that are in the map. First posted on arXiv 18 Oct 2022.
Builds on
37 of 62 references.
References · 37
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
- 2019On the Convergence of FedAvg on Non-IID Datacited by 1,229
- 2018Local SGD Converges Fast and Communicates Littlecited by 605
- 2018Federated Learning via Over-the-Air Computationcited by 219
- 2018Broadband Analog Aggregation for Low-Latency Federated Edge Learning (Extended Version)cited by 191
- 2019Federated Learning over Wireless Fading Channelscited by 183
- 2019Federated Learning for Wireless Communications: Motivation, Opportunities and Challengescited by 129
- 2020One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysiscited by 112
- 2018Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithmscited by 106
- 2020Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspectivecited by 103
25 more
- 2020Convergence Time Optimization for Federated Learning over Wireless Networkscited by 81
- 2020Over-the-Air Federated Learning from Heterogeneous Datacited by 73
- 2015Perturbed Iterate Analysis for Asynchronous Stochastic Optimizationcited by 67
- 2019On Analog Gradient Descent Learning over Multiple Access Fading Channelscited by 62
- 2020Federated Learning With Quantized Global Model Updatescited by 55
- 2020Design and Analysis of Uplink and Downlink Communications for Federated Learningcited by 48
- 2020Blind Federated Edge Learningcited by 43
- 2021Dynamic Scheduling for Over-the-Air Federated Edge Learning with Energy Constraintscited by 36
- 2019High-Dimensional Stochastic Gradient Quantization for Communication-Efficient Edge Learningcited by 32
- 2021Learning Rate Optimization for Federated Learning Exploiting Over-the-air Computationcited by 29
- 2019Cell-Free Massive MIMO for Wireless Federated Learningcited by 25
- 2021Convergence Analysis and System Design for Federated Learning over Wireless Networkscited by 25
- 2020Fast Convergence Algorithm for Analog Federated Learningcited by 17
- 2021Federated Learning over Energy Harvesting Wireless Networkscited by 17
- 2021Adaptive Transmission Scheduling in Wireless Networks for Asynchronous Federated Learningcited by 15
- 2021Federated Learning over Wireless IoT Networks with Optimized Communication and Resourcescited by 13
- 2020Federated Learning for Task and Resource Allocation in Wireless High Altitude Balloon Networkscited by 11
- 2021Joint Client Scheduling and Resource Allocation under Channel Uncertainty in Federated Learningcited by 10
- 2022FedVQCS: Federated Learning via Vector Quantized Compressed Sensingcited by 9
- 2021Over-the-Air Federated Multi-Task Learning Over MIMO Multiple Access Channelscited by 8
- 2022Over-the-Air Federated Learning with Energy Harvesting Devicescited by 8
- 2021User Scheduling for Federated Learning Through Over-the-Air Computationcited by 7
- 2022Time-Correlated Sparsification for Efficient Over-the-Air Model Aggregation in Wireless Federated Learningcited by 7
- 2020Adaptive Subcarrier, Parameter, and Power Allocation for Partitioned Edge Learning Over Broadband Channelscited by 5
- 2020A Compressive Sensing Approach for Federated Learning over Massive MIMO Communication Systemscited by 2
Built on by
Not cited yet.