mlsanityData to 7 Oct 2026

Recent Advances on Federated Learning: A Systematic Survey

arXiv 2301.01299 ↗First posted 3 Jan 2023cs.LGcited by 40

Not on the map. Why?

Abstract (arXiv)

Federated learning has emerged as an effective paradigm to achieve privacy-preserving collaborative learning among different parties. Compared to traditional centralized learning that requires collecting data from each party, in federated learning, only the locally trained models or computed gradients are exchanged, without exposing any data information. As a result, it is able to protect privacy to some extent. In recent years, federated learning has become more and more prevalent and there have been many surveys for summarizing related methods in this hot research topic. However, most of them focus on a specific perspective or lack the latest research progress. In this paper, we provide a systematic survey on federated learning, aiming to review the recent advanced federated methods and applications from different aspects. Specifically, this paper includes four major contributions. First, we present a new taxonomy of federated learning in terms of the pipeline and challenges in federated scenarios. Second, we summarize federated learning methods into several categories and briefly introduce the state-of-the-art methods under these categories. Third, we overview some prevalent federated learning frameworks and introduce their features. Finally, some potential deficiencies of current methods and several future directions are discussed.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 132 of its 182 references that are in the map. First posted on arXiv 3 Jan 2023.

Builds on

132 of 182 references.

References · 132

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  7. 2019Advances and Open Problems in Federated Learningcited by 3,021
  8. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  9. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
  10. 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
  11. 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
  12. 2014How transferable are features in deep neural networks?cited by 1,216
38 more
  1. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
  2. 2018Federated Learning with Non-IID Datacited by 1,099
  3. 2019Deep Leakage from Gradientscited by 1,004
  4. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
  5. 2018How To Backdoor Federated Learningcited by 745
  6. 2019Large Scale Incremental Learningcited by 727
  7. 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 707
  8. 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 698
  9. 2020Ensemble Distillation for Robust Model Fusion in Federated Learningcited by 678
  10. 2017Federated Multi-Task Learningcited by 669
  11. 2020Ditto: Fair and Robust Federated Learning Through Personalizationcited by 665
  12. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
  13. 2020Personalized Federated Learning with Moreau Envelopescited by 612
  14. 2018End-to-End Incremental Learningcited by 596
  15. 2018Federated Learning for Mobile Keyboard Predictioncited by 565
  16. 2020Federated Learning with Matched Averagingcited by 564
  17. 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
  18. 2017Learning multiple visual domains with residual adapterscited by 553
  19. 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 528
  20. 2020An Efficient Framework for Clustered Federated Learningcited by 505
  21. 2019Clustered Federated Learning: Model-Agnostic Distributed Multi-Task Optimization under Privacy Constraintscited by 499
  22. 2019Local Model Poisoning Attacks to Byzantine-Robust Federated Learningcited by 479
  23. 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 454
  24. 2017Differentially Private Federated Learning: A Client Level Perspectivecited by 451
  25. 2019Agnostic Federated Learningcited by 451
  26. 2020Flower: A Friendly Federated Learning Research Frameworkcited by 449
  27. 2019Federated Machine Learning: Concept and Applicationscited by 409
  28. 2019Federated Learning in Mobile Edge Networks: A Comprehensive Surveycited by 407
  29. 2014Understanding Deep Image Representations by Inverting Themcited by 399
  30. 2019Bayesian Nonparametric Federated Learning of Neural Networkscited by 385
  31. 2019A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protectioncited by 371
  32. 2020iDLG: Improved Deep Leakage from Gradientscited by 367
  33. 2018Analyzing Federated Learning through an Adversarial Lenscited by 346
  34. 2020HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clientscited by 334
  35. 2017Deep Models Under the GAN: Information Leakage from Collaborative Deep Learningcited by 326
  36. 2021See through Gradients: Image Batch Recovery via GradInversioncited by 320
  37. 2020Personalized Federated Learning: A Meta-Learning Approachcited by 309
  38. 2020Attack of the Tails: Yes, You Really Can Backdoor Federated Learningcited by 307

50 most cited of 132 All 132 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 11; 2025: 16; 2026: 11.

40 papers.

Sort:

By area:

  1. 2024Advances and Open Challenges in Federated Foundation Modelscited by 33
  2. 2024Rehearsal-Free Continual Federated Learning with Synergistic Synaptic Intelligencecited by 15
  3. 2025Federated Continual Learning: Concepts, Challenges, and Solutionscited by 13
  4. 2025Research on Large Language Model Cross-Cloud Privacy Protection and Collaborative Training based on Federated Learningcited by 11
  5. 2024On TinyML and Cybersecurity: Electric Vehicle Charging Infrastructure Use Casecited by 9
  6. 2024Enhancing Federated Domain Adaptation with Multi-Domain Prototype-Based Federated Fine-Tuningcited by 6
  7. 2023An Empirical Study of Federated Learning on IoT-Edge Devices: Resource Allocation and Heterogeneitycited by 5
  8. 2024Proximity-based Self-Federated Learningcited by 5
  9. 2023RHFedMTL: Resource-Aware Hierarchical Federated Multi-Task Learningcited by 4
  10. 2024Leveraging Foundation Models for Efficient Federated Learning in Resource-restricted Edge Networkscited by 2
  11. 2024Learnable Sparse Customization in Heterogeneous Edge Computingcited by 2
  12. 2025A survey on Clustered Federated Learning: Taxonomy, Analysis and Applicationscited by 2
28 more
  1. 2025CLLoRA: An Approach to Measure the Effects of the Context Length for LLM Fine-Tuningcited by 2
  2. 2025Federated Learning from Molecules to Processes: A Perspectivecited by 2
  3. 2024Federated Learning with Uncertainty and Personalization via Efficient Second-order Optimizationcited by 1
  4. 2025Securing Genomic Data Against Inference Attacks in Federated Learning Environmentscited by 1
  5. 2025Federated Timeline Synthesis: Scalable and Private Methodology For Model Training and Deploymentcited by 1
  6. 2025Foundational Models and Federated Learning: Survey, Taxonomy, Challenges and Practical Insightscited by 1
  7. 2025FedTeddi: Temporal Drift and Divergence Aware Scheduling for Timely Federated Edge Learningcited by 1
  8. 2025pFedBBN: A Personalized Federated Test-Time Adaptation with Balanced Batch Normalization for Class-Imbalanced Datacited by 1
  9. 2026DeepFedNAS: Efficient Hardware-Aware Architecture Adaptation for Heterogeneous IoT Federations via Pareto-Guided Supernet Trainingcited by 1
  10. 2026C2FL: Clustered Continual Federated Learning under Spatial and Temporal Driftcited by 1
  11. 2024A Hybrid Federated Kernel Regularized Least Squares Algorithmcited by 0
  12. 2024Towards Robust Federated Image Classification: An Empirical Study of Weight Selection Strategies in Manufacturingcited by 0
  13. 2024Certifiably Robust Model Evaluation in Federated Learning under Meta-Distributional Shiftscited by 0
  14. 2025BTFL: A Bayesian-based Test-Time Generalization Method for Internal and External Data Distributions in Federated learningcited by 0
  15. 2025Moss: Proxy Model-based Full-Weight Aggregation in Federated Learning with Heterogeneous Modelscited by 0
  16. 2025Federated Spectral Graph Transformers Meet Neural Ordinary Differential Equations for Non-IID Graphscited by 0
  17. 2025Overcoming Challenges of Partial Client Participation in Federated Learning : A Comprehensive Reviewcited by 0
  18. 2025Accessible Gesture-Driven Augmented Reality Interaction Systemcited by 0
  19. 2025Gains: Fine-grained Federated Domain Adaptation in Open Setcited by 0
  20. 2026Mechanism Design for Federated Learning with Non-Monotonic Network Effectscited by 0
  21. 2026SecureGate: Learning When to Reveal PII Safely via Token-Gated Dual-Adapters for Federated LLMscited by 0
  22. 2026Federated Learning for Cross-Modality Medical Image Segmentation via Augmentation-Driven Generalizationcited by 0
  23. 2026Structure-Aware Distributed Backdoor Attacks in Federated Learningcited by 0
  24. 2026On the Fragility of Data Attribution When Learning Is Distributedcited by 0
  25. 2026Beyond Weights and Gradients: A Taxonomy of Federated Learning Messagescited by 0
  26. 2026Meta-classification of one-class classification models using ranking correlation and nearest neighborcited by 0
  27. 2026Encryption-Compatible Clustered Federated Learning via Distributed Expectation-Maximization over Metadatacited by 0
  28. 2026How Edge of Stability Hinders SCAFFOLD in Federated Optimizationcited by 0