FedML: A Research Library and Benchmark for Federated Machine Learning
Not on the map. Why?
Abstract (arXiv)
Federated learning (FL) is a rapidly growing research field in machine learning. However, existing FL libraries cannot adequately support diverse algorithmic development; inconsistent dataset and model usage make fair algorithm comparison challenging. In this work, we introduce FedML, an open research library and benchmark to facilitate FL algorithm development and fair performance comparison. FedML supports three computing paradigms: on-device training for edge devices, distributed computing, and single-machine simulation. FedML also promotes diverse algorithmic research with flexible and generic API design and comprehensive reference baseline implementations (optimizer, models, and datasets). We hope FedML could provide an efficient and reproducible means for developing and evaluating FL algorithms that would benefit the FL research community. We maintain the source code, documents, and user community at https://fedml.ai.
Key facts. Cited by 298 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 59; 2022: 58; 2023: 78; 2024: 56; 2025: 30; 2026: 17.
298 papers.
Sort:
By area:
- 2021Model-Contrastive Federated Learningcited by 762
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 566
- 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
- 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 349
- 2021Federated Learning on Non-IID Data: A Surveycited by 345
- 2021No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Datacited by 241
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2023Towards Building the Federated GPT: Federated Instruction Tuningcited by 184
- 2022Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learningcited by 172
- 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 160
- 2021FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learningcited by 140
- 2022Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challengescited by 137
38 more
- 2021FedScale: Benchmarking Model and System Performance of Federated Learning at Scalecited by 135
- 2022FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settingscited by 121
- 2021FairFed: Enabling Group Fairness in Federated Learningcited by 114
- 2021Local Learning Matters: Rethinking Data Heterogeneity in Federated Learningcited by 114
- 2022Vertical Federated Learning: Concepts, Advances and Challengescited by 104
- 2023Personalized Federated Learning with Feature Alignment and Classifier Collaborationcited by 97
- 2021Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applicationscited by 96
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021Preservation of the Global Knowledge by Not-True Distillation in Federated Learningcited by 87
- 2021FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Taskscited by 84
- 2024A Survey of Resource-efficient LLM and Multimodal Foundation Modelscited by 84
- 2023When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directionscited by 83
- 2022NVIDIA FLARE: Federated Learning from Simulation to Real-Worldcited by 78
- 2021CAFE: Catastrophic Data Leakage in Vertical Federated Learningcited by 76
- 2021Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Datacited by 69
- 2021From Distributed Machine Learning to Federated Learning: A Surveycited by 65
- 2022Client Selection in Federated Learning: Principles, Challenges, and Opportunitiescited by 62
- 2021FedLab: A Flexible Federated Learning Frameworkcited by 54
- 2022FederatedScope: A Flexible Federated Learning Platform for Heterogeneitycited by 53
- 2022Virtual Homogeneity Learning: Defending against Data Heterogeneity in Federated Learningcited by 52
- 2023FedMultimodal: A Benchmark For Multimodal Federated Learningcited by 51
- 2021FedGEMS: Federated Learning of Larger Server Models via Selective Knowledge Fusioncited by 49
- 2021Federated Learning for Internet of Things: Applications, Challenges, and Opportunitiescited by 49
- 2022Federated Learning via Decentralized Dataset Distillation in Resource-Constrained Edge Environmentscited by 49
- 2021SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Trainingcited by 45
- 2022pFL-Bench: A Comprehensive Benchmark for Personalized Federated Learningcited by 44
- 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
- 2023Recent Advances on Federated Learning: A Systematic Surveycited by 40
- 2022Test-Time Robust Personalization for Federated Learningcited by 39
- 2021Emerging Trends in Federated Learning: From Model Fusion to Federated X Learningcited by 35
- 2021PyVertical: A Vertical Federated Learning Framework for Multi-headed SplitNNcited by 35
- 2021Layer-wise Adaptive Model Aggregation for Scalable Federated Learningcited by 35
- 2021FL-WBC: Enhancing Robustness against Model Poisoning Attacks in Federated Learning from a Client Perspectivecited by 35
- 2022Federated Learning under Distributed Concept Driftcited by 35
- 2024Low-Rank Adaptation for Foundation Models: A Comprehensive Reviewcited by 35
- 2022Federated Learning for Medical Applications: A Taxonomy, Current Trends, Challenges, and Future Research Directionscited by 34
- 2022Federated Learning for Healthcare Domain - Pipeline, Applications and Challengescited by 34
- 2024Advances and Open Challenges in Federated Foundation Modelscited by 33
50 most cited of 298 All 298 (JSON)
- 2026Making Cross-Continental Federated Learning Repeatable with FLIP: a Multi-Application Study28 Sep 2026
- 2026Efficiently Distributed Federated Learning17 Sep 2026
- 2026Scalability and Performance Evaluation of Federated Learning Frameworks: A Comparative Analysis14 Sep 2026
- 2026FedLTLib: A Comprehensive Benchmark for Federated Long-Tail Learning14 Sep 2026
- 2026Flower Hub: A Reproducible Benchmarking Platform for Federated Learning in Simulation and Deployment25 Aug 2026
- 2026Understanding Developer Pain Points in Federated Learning: Insights from Stack Overflow and GitHub21 Jul 2026
- 2026Decentralised AI Training and Inference with BlockTrain23 Jun 2026
- 2026Clipping Makes Distributed and Federated Asynchronous SGD Robust to Stragglers11 Jun 2026
- 2026Sample Selection Using Multi-Task Autoencoders in Federated Learning with Non-IID Data28 Apr 2026
- 2026Enhanced Privacy and Communication Efficiency in Non-IID Federated Learning with Adaptive Quantization and Differential Privacy25 Apr 2026
- 2026HadAgent: Harness-Aware Decentralized Agentic AI Serving with Proof-of-Inference Blockchain Consensus15 Apr 2026
- 2026Scalable Cross-Facility Federated Learning for Scientific Foundation Models on Multiple Supercomputers20 Mar 2026
38 more
- 2026LEA: Label Enumeration Attack in Vertical Federated Learning4 Mar 2026
- 2026Benchmarking Federated Learning in Edge Computing Environments: A Systematic Review and Performance Evaluation24 Feb 2026
- 2026FedAvg-Based CTMC Hazard Model for Federated Bridge Deterioration Assessment22 Feb 2026
- 2026One RNG to Rule Them All: How Randomness Becomes an Attack Vector in Machine Learning9 Feb 2026
- 2026Communication-efficient Federated Graph Classification via Generative Diffusion Modeling22 Jan 2026
- 2025Federated Learning Framework for Scalable AI in Heterogeneous HPC and Cloud Environments22 Nov 2025
- 2025Dynamic Participation in Federated Learning: Benchmarks and a Knowledge Pool Plugin20 Nov 2025
- 2025FedeCouple: Fine-Grained Balancing of Global-Generalization and Local-Adaptability in Federated Learning12 Nov 2025
- 2025CO-PFL: Contribution-Oriented Personalized Federated Learning for Heterogeneous Networks23 Oct 2025
- 2025FLAMMABLE: A Multi-Model Federated Learning Framework with Multi-Model Engagement and Adaptive Batch Sizes12 Oct 2025
- 2025OmniFed: A Modular Framework for Configurable Federated Learning from Edge to HPC23 Sep 2025
- 2025Benchmarking Robust Aggregation in Decentralized Gradient Marketplaces6 Sep 2025
- 2025On the Security and Privacy of Federated Learning: A Survey with Attacks, Defenses, Frameworks, Applications, and Future Directions19 Aug 2025
- 2025FLsim: A Modular and Library-Agnostic Simulation Framework for Federated Learning15 Jul 2025
- 2025FLoRIST: Singular Value Thresholding for Efficient and Accurate Federated Fine-Tuning of Large Language Models10 Jun 2025
- 2025HtFLlib: A Comprehensive Heterogeneous Federated Learning Library and Benchmark4 Jun 2025
- 2025ByzFL: Research Framework for Robust Federated Learning30 May 2025
- 2025WikiDBGraph: A Data Management Benchmark Suite for Collaborative Learning over Database Silos22 May 2025
- 2025Distributionally Robust Federated Learning with Client Drift Minimization21 May 2025
- 2025FNBench: Benchmarking Robust Federated Learning against Noisy Labels10 May 2025
- 2025Lazy But Effective: Collaborative Personalized Federated Learning with Heterogeneous Data5 May 2025
- 2025Federated Learning: A Survey on Privacy-Preserving Collaborative Intelligence24 Apr 2025
- 2025Towards a Distributed Federated Learning Aggregation Placement using Particle Swarm Intelligence22 Apr 2025
- 2025An Adaptive Clustering Scheme for Client Selections in Communication-Efficient Federated Learning11 Apr 2025
- 2025Federated Neural Architecture Search with Model-Agnostic Meta Learning8 Apr 2025
- 2025Federated Learning for Medical Image Classification: A Comprehensive Benchmark7 Apr 2025
- 2025FedSAUC: A Similarity-Aware Update Control for Communication-Efficient Federated Learning in Edge Computing7 Apr 2025
- 2025Tree-based Models for Vertical Federated Learning: A Survey3 Apr 2025
- 2025FLIP: Towards Comprehensive and Reliable Evaluation of Federated Prompt Learning28 Mar 2025
- 2025ProFed: a Benchmark for Proximity-based non-IID Federated Learning26 Mar 2025
- 2025FedRand: Enhancing Privacy in Federated Learning with Randomized LoRA Subparameter Updates10 Mar 2025
- 2025FLStore: Efficient Federated Learning Storage for non-training workloads1 Mar 2025
- 2025Fed-SB: A Silver Bullet for Extreme Communication Efficiency and Performance in (Private) Federated LoRA Fine-Tuning21 Feb 2025
- 2025Revisiting LocalSGD and SCAFFOLD: Improved Rates and Missing Analysis8 Jan 2025
- 2025Beyond Model Scale Limits: End-Edge-Cloud Federated Learning with Self-Rectified Knowledge Agglomeration1 Jan 2025
- 2024Low-Rank Adaptation for Foundation Models: A Comprehensive Review31 Dec 2024
- 2024Federated Learning with Workload Reduction through Partial Training of Client Models and Entropy-Based Data Selection30 Dec 2024
- 2024DapperFL: Domain Adaptive Federated Learning with Model Fusion Pruning for Edge Devices8 Dec 2024
50 newest of 298 All 298 (JSON)
- 2021Model-Contrastive Federated Learningcited by 762
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 566
- 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
- 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 349
- 2021Federated Learning on Non-IID Data: A Surveycited by 345
- 2021No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Datacited by 241
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2023Towards Building the Federated GPT: Federated Instruction Tuningcited by 184
- 2022Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learningcited by 172
- 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 160
- 2021FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learningcited by 140
- 2022Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challengescited by 137
12 most cited of 293 All 293 (JSON)
- 2026Making Cross-Continental Federated Learning Repeatable with FLIP: a Multi-Application Study28 Sep 2026
- 2026Efficiently Distributed Federated Learning17 Sep 2026
- 2026Scalability and Performance Evaluation of Federated Learning Frameworks: A Comparative Analysis14 Sep 2026
- 2026FedLTLib: A Comprehensive Benchmark for Federated Long-Tail Learning14 Sep 2026
- 2026Flower Hub: A Reproducible Benchmarking Platform for Federated Learning in Simulation and Deployment25 Aug 2026
- 2026Understanding Developer Pain Points in Federated Learning: Insights from Stack Overflow and GitHub21 Jul 2026
- 2026Decentralised AI Training and Inference with BlockTrain23 Jun 2026
- 2026Clipping Makes Distributed and Federated Asynchronous SGD Robust to Stragglers11 Jun 2026
- 2026Sample Selection Using Multi-Task Autoencoders in Federated Learning with Non-IID Data28 Apr 2026
- 2026Enhanced Privacy and Communication Efficiency in Non-IID Federated Learning with Adaptive Quantization and Differential Privacy25 Apr 2026
- 2026Scalable Cross-Facility Federated Learning for Scientific Foundation Models on Multiple Supercomputers20 Mar 2026
- 2026LEA: Label Enumeration Attack in Vertical Federated Learning4 Mar 2026
12 newest of 293 All 293 (JSON)