mlsanityData to 7 Oct 2026

FedProf: Selective Federated Learning with Representation Profiling

arXiv 2102.01733 ↗First posted 2 Feb 2021cs.LG cs.DCcited by 0

Not on the map. Why?

Abstract (arXiv)

Federated Learning (FL) has shown great potential as a privacy-preserving solution to learning from decentralized data that are only accessible to end devices (i.e., clients). In many scenarios, however, a large proportion of the clients are probably in possession of low-quality data that are biased, noisy or even irrelevant. As a result, they could significantly slow down the convergence of the global model we aim to build and also compromise its quality. In light of this, we propose FedProf, a novel algorithm for optimizing FL under such circumstances without breaching data privacy. The key of our approach is a distributional representation profiling and matching scheme that uses the global model to dynamically profile data representations and allows for low-cost, lightweight representation matching. Based on the scheme we adaptively score each client and adjust its participation probability so as to mitigate the impact of low-value clients on the training process. We have conducted extensive experiments on public datasets using various FL settings. The results show that the selective behaviour of our algorithm leads to a significant reduction in the number of communication rounds and the amount of time (up to 2.4x speedup) for the global model to converge and also provides accuracy gain.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 66 references that are in the map. First posted on arXiv 2 Feb 2021.

Builds on

37 of 66 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  3. 2019Advances and Open Problems in Federated Learningcited by 3,021
  4. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  5. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  6. 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
  7. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,239
  8. 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
  9. 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,132
  10. 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 897
  11. 2018How To Backdoor Federated Learningcited by 745
  12. 2018Federated Learning for Mobile Keyboard Predictioncited by 565
25 more
  1. 2019Local Model Poisoning Attacks to Byzantine-Robust Federated Learningcited by 479
  2. 2019Agnostic Federated Learningcited by 451
  3. 2018Adaptive Federated Learning in Resource Constrained Edge Computing Systemscited by 408
  4. 2018Sparsified SGD with Memorycited by 373
  5. 2020Adaptive Personalized Federated Learningcited by 353
  6. 2018Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edgecited by 347
  7. 2018Analyzing Federated Learning through an Adversarial Lenscited by 346
  8. 2018Insights on representational similarity in neural networks with canonical correlationcited by 318
  9. 2020Data Poisoning Attacks Against Federated Learning Systemscited by 266
  10. 2020Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategiescited by 196
  11. 2021Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learningcited by 192
  12. 2019Federated Learning for Wireless Communications: Motivation, Opportunities and Challengescited by 128
  13. 2020Optimal Client Sampling for Federated Learningcited by 123
  14. 2016Asynchronous Stochastic Gradient Descent with Delay Compensationcited by 98
  15. 2018Federated Learning for Keyword Spottingcited by 95
  16. 2020TiFL: A Tier-based Federated Learning Systemcited by 95
  17. 2019SAFA: a Semi-Asynchronous Protocol for Fast Federated Learning with Low Overheadcited by 82
  18. 2020Convergence Time Optimization for Federated Learning over Wireless Networkscited by 81
  19. 2018Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimizationcited by 76
  20. 2020Rethinking Data Augmentation for Image Super-resolution: A Comprehensive Analysis and a New Strategycited by 66
  21. 2019Active Federated Learningcited by 63
  22. 2020Multi-Participant Multi-Class Vertical Federated Learningcited by 47
  23. 2019Device Scheduling with Fast Convergence for Wireless Federated Learningcited by 46
  24. 2020Fed-Focal Loss for imbalanced data classification in Federated Learningcited by 26
  25. 2020Accelerating Federated Learning over Reliability-Agnostic Clients in Mobile Edge Computing Systemscited by 17

Built on by

Not cited yet.