mlsanityData to 7 Oct 2026

Influence-Oriented Personalized Federated Learning

arXiv 2410.03315 ↗First posted 4 Oct 2024cs.LG cs.AI cs.DCcited by 6

Not on the map. Why?

Abstract (arXiv)

Federated learning (FL) is a machine learning paradigm where clients with different behaviors and preferences can learn collaboratively without compromising data privacy. Typical FL methods often rely on fixed weighting for parameter aggregation, thereby neglecting the mutual influence among clients. In practice, clients with similar preferences or backgrounds may provide more useful knowledge to each other, which can be leveraged to improve local performance. However, how to quantify such cross-client influence and how to exploit it for personalized aggregation remain underexplored. To address this gap, we propose an influence-oriented Federated learning framework which quantitatively measures Client-level and Class-level Influence to realize adaptive parameter aggregation for each client (FedC^2I for short). Our core idea is to explicitly model the inter-client influence within an FL system via the well-crafted influence vector and influence matrix. Specifically, FedC^2I incorporate influence vectors to quantify client-level influence, enables clients to selectively acquire knowledge from others, and guides the aggregation of feature representation layers. Meanwhile, the influence matrix captures class-level influence in a more fine-grained manner to achieve personalized classifier aggregation. We evaluate the performance of FedC^2I against existing federated learning methods under non-IID settings, and the results demonstrate the superiority of our method in terms of effectiveness, robustness, and interpretability.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 38 of its 56 references that are in the map. First posted on arXiv 4 Oct 2024.

Builds on

38 of 56 references.

References · 38

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  3. 2019Advances and Open Problems in Federated Learningcited by 3,021
  4. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  5. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  6. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
  7. 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
  8. 2018Federated Learning with Non-IID Datacited by 1,099
  9. 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 897
  10. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
  11. 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 565
  12. 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
26 more
  1. 2021Exploiting Shared Representations for Personalized Federated Learningcited by 537
  2. 2019Federated Learning with Personalization Layerscited by 533
  3. 2020An Efficient Framework for Clustered Federated Learningcited by 505
  4. 2019Clustered Federated Learning: Model-Agnostic Distributed Multi-Task Optimization under Privacy Constraintscited by 499
  5. 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 454
  6. 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 349
  7. 2018Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edgecited by 347
  8. 2020Think Locally, Act Globally: Federated Learning with Local and Global Representationscited by 322
  9. 2020Personalized Federated Learning: A Meta-Learning Approachcited by 309
  10. 2020Learning to Generate Novel Domains for Domain Generalizationcited by 296
  11. 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 279
  12. 2019Improving Federated Learning Personalization via Model Agnostic Meta Learningcited by 264
  13. 2018Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Datacited by 242
  14. 2021No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Datacited by 241
  15. 2020Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategiescited by 196
  16. 2018Representer Point Selection for Explaining Deep Neural Networkscited by 187
  17. 2021FedBABU: Towards Enhanced Representation for Federated Image Classificationcited by 180
  18. 2020Privacy and Robustness in Federated Learning: Attacks and Defensescited by 163
  19. 2021Multi-Center Federated Learning: Clients Clustering for Better Personalizationcited by 112
  20. 2019Measure Contribution of Participants in Federated Learningcited by 78
  21. 2020KD3A: Unsupervised Multi-Source Decentralized Domain Adaptation via Knowledge Distillationcited by 50
  22. 2020Communication-Efficient Federated Learning via Optimal Client Samplingcited by 39
  23. 2022CD2-pFed: Cyclic Distillation-guided Channel Decoupling for Model Personalization in Federated Learningcited by 34
  24. 2022Disentangled Federated Learning for Tackling Attributes Skew via Invariant Aggregation and Diversity Transferringcited by 28
  25. 2022Shielding Federated Learning: Robust Aggregation with Adaptive Client Selectioncited by 18
  26. 2020Toward Understanding the Influence of Individual Clients in Federated Learningcited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.