mlsanityData to 14 Oct 2026

REFT: Resource-Efficient Federated Training Framework for Heterogeneous and Resource-Constrained Environments

arXiv 2308.13662 ↗First posted 25 Aug 2023cs.LG cs.DCcited by 0

Not on the map. Why?

Abstract (arXiv)

Federated Learning (FL) plays a critical role in distributed systems. In these systems, data privacy and confidentiality hold paramount importance, particularly within edge-based data processing systems such as IoT devices deployed in smart homes. FL emerges as a privacy-enforcing sub-domain of machine learning that enables model training on client devices, eliminating the necessity to share private data with a central server. While existing research has predominantly addressed challenges pertaining to data heterogeneity, there remains a current gap in addressing issues such as varying device capabilities and efficient communication. These unaddressed issues raise a number of implications in resource-constrained environments. In particular, the practical implementation of FL-based IoT or edge systems is extremely inefficient. In this paper, we propose "Resource-Efficient Federated Training Framework for Heterogeneous and Resource-Constrained Environments (REFT)," a novel approach specifically devised to address these challenges in resource-limited devices. Our proposed method uses Variable Pruning to optimize resource utilization by adapting pruning strategies to the computational capabilities of each client. Furthermore, our proposed REFT technique employs knowledge distillation to minimize the need for continuous bidirectional client-server communication. This achieves a significant reduction in communication bandwidth, thereby enhancing the overall resource efficiency. We conduct experiments for an image classification task, and the results demonstrate the effectiveness of our approach in resource-limited settings. Our technique not only preserves data privacy and performance standards but also accommodates heterogeneous model architectures, facilitating the participation of a broader array of diverse client devices in the training process, all while consuming minimal bandwidth.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 25 Aug 2023.

Builds on

28 of 40 references.

References · 28

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  3. 2022Generative Adversarial Networkscited by 5,627
  4. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  5. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  6. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  7. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
  8. 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
  9. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,077
  10. 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
  11. 2020Ensemble Distillation for Robust Model Fusion in Federated Learningcited by 682
  12. 2020Federated Learning with Matched Averagingcited by 564
16 more
  1. 2019Similarity-Preserving Knowledge Distillationcited by 516
  2. 2019Agnostic Federated Learningcited by 456
  3. 2019Robust and Communication-Efficient Federated Learning from Non-IID Datacited by 419
  4. 2019Fair Resource Allocation in Federated Learningcited by 394
  5. 2019Bayesian Nonparametric Federated Learning of Neural Networkscited by 387
  6. 2019FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantizationcited by 356
  7. 2020Personalized Federated Learning: A Meta-Learning Approachcited by 312
  8. 2019Model Pruning Enables Efficient Federated Learning on Edge Devicescited by 222
  9. 2019Energy Efficient Federated Learning Over Wireless Communication Networkscited by 181
  10. 2019Zero-shot Knowledge Transfer via Adversarial Belief Matchingcited by 129
  11. 2020Federated Visual Classification with Real-World Data Distributioncited by 128
  12. 2019One-Shot Federated Learningcited by 125
  13. 2019Zero-Shot Knowledge Distillation in Deep Networkscited by 121
  14. 2022Preserving Privacy in Federated Learning with Ensemble Cross-Domain Knowledge Distillationcited by 45
  15. 2019Play and Prune: Adaptive Filter Pruning for Deep Model Compressioncited by 15
  16. 2018FLOPs as a Direct Optimization Objective for Learning Sparse Neural Networkscited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Federated Learning: A Survey on Privacy-Preserving Collaborative Intelligence
  2. 2024BEFL: Balancing Energy Consumption in Federated Learning for Mobile Edge IoT
  3. 2025Energy and Memory-Efficient Federated Learning With Ordered Layer Freezing
  4. 2026Reliable Federated TinyML Deployment for IoT Security
  5. 2024Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing
  6. 2025Energy-Efficient Quantized Federated Learning for Resource-constrained IoT devices
  7. 2026RIFLE: Robust Distillation-based FL for Deep Model Deployment on Resource-Constrained IoT Networks
  8. 2022Federated Learning: Balancing the Thin Line Between Data Intelligence and Privacy