FedFT: Improving Communication Performance for Federated Learning with Frequency Space Transformation
Not on the map. Why?
Abstract (arXiv)
Communication efficiency is a widely recognised research problem in Federated Learning (FL), with recent work focused on developing techniques for efficient compression, distribution and aggregation of model parameters between clients and the server. Particularly within distributed systems, it is important to balance the need for computational cost and communication efficiency. However, existing methods are often constrained to specific applications and are less generalisable. In this paper, we introduce FedFT (federated frequency-space transformation), a simple yet effective methodology for communicating model parameters in a FL setting. FedFT uses Discrete Cosine Transform (DCT) to represent model parameters in frequency space, enabling efficient compression and reducing communication overhead. FedFT is compatible with various existing FL methodologies and neural architectures, and its linear property eliminates the need for multiple transformations during federated aggregation. This methodology is vital for distributed solutions, tackling essential challenges like data privacy, interoperability, and energy efficiency inherent to these environments. We demonstrate the generalisability of the FedFT methodology on four datasets using comparative studies with three state-of-the-art FL baselines (FedAvg, FedProx, FedSim). Our results demonstrate that using FedFT to represent the differences in model parameters between communication rounds in frequency space results in a more compact representation compared to representing the entire model in frequency space. This leads to a reduction in communication overhead, while keeping accuracy levels comparable and in some cases even improving it. Our results suggest that this reduction can range from 5% to 30% per client, depending on dataset.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 42 references that are in the map. First posted on arXiv 8 Sep 2024.
Builds on
18 of 42 references.
References · 18
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
- 2019Towards Federated Learning at Scale: System Designcited by 832
- 2018LEAF: A Benchmark for Federated Settingscited by 792
- 2018Federated Learning for Mobile Keyboard Predictioncited by 572
- 2019Robust and Communication-Efficient Federated Learning from Non-IID Datacited by 419
- 2019FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantizationcited by 356
- 2021Federated Learning for Internet of Things: A Comprehensive Surveycited by 252
- 2019Model Pruning Enables Efficient Federated Learning on Edge Devicescited by 222
- 2019FedHealth: A Federated Transfer Learning Framework for Wearable Healthcarecited by 182
- 2018Expanding the Reach of Federated Learning by Reducing Client Resource Requirementscited by 163
6 more
- 2021FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learningcited by 141
- 2021Federated Learning for Open Bankingcited by 141
- 2019Federated Learning for Emoji Prediction in a Mobile Keyboardcited by 118
- 2018Federated Learning for Keyword Spottingcited by 95
- 2022Towards Efficient Communications in Federated Learning: A Contemporary Surveycited by 24
- 2019Hyper-Sphere Quantization: Communication-Efficient SGD for Federated Learningcited by 18
Built on by
Citing papers per year: 2026: 1.
1 paper.