FederatedScope: A Flexible Federated Learning Platform for Heterogeneity
Not on the map. Why?
Abstract (arXiv)
Although remarkable progress has been made by existing federated learning (FL) platforms to provide infrastructures for development, these platforms may not well tackle the challenges brought by various types of heterogeneity, including the heterogeneity in participants' local data, resources, behaviors and learning goals. To fill this gap, in this paper, we propose a novel FL platform, named FederatedScope, which employs an event-driven architecture to provide users with great flexibility to independently describe the behaviors of different participants. Such a design makes it easy for users to describe participants with various local training processes, learning goals and backends, and coordinate them into an FL course with synchronous or asynchronous training strategies. Towards an easy-to-use and flexible platform, FederatedScope enables rich types of plug-in operations and components for efficient further development, and we have implemented several important components to better help users with privacy protection, attack simulation and auto-tuning. We have released FederatedScope at https://github.com/alibaba/FederatedScope to promote academic research and industrial deployment of federated learning in a wide range of scenarios.
Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 64 of its 114 references that are in the map. First posted on arXiv 11 Apr 2022.
Builds on
64 of 114 references.
References · 64
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
38 more
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
- 2019Deep Leakage from Gradientscited by 1,021
- 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 906
- 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
- 2019Towards Federated Learning at Scale: System Designcited by 832
- 2018LEAF: A Benchmark for Federated Settingscited by 792
- 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
- 2017Federated Multi-Task Learningcited by 672
- 2020Ditto: Fair and Robust Federated Learning Through Personalizationcited by 672
- 2020Personalized Federated Learning with Moreau Envelopescited by 618
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
- 2018Federated Learning for Mobile Keyboard Predictioncited by 572
- 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 571
- 2016Federated Optimization: Distributed Machine Learning for On-Device Intelligencecited by 564
- 2019Federated Learning with Personalization Layerscited by 541
- 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 536
- 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 520
- 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 470
- 2021Towards Personalized Federated Learningcited by 464
- 2019Federated Machine Learning: Concept and Applicationscited by 412
- 2020iDLG: Improved Deep Leakage from Gradientscited by 382
- 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 335
- 2017Deep Models Under the GAN: Information Leakage from Collaborative Deep Learningcited by 334
- 2020Three Approaches for Personalization with Applications to Federated Learningcited by 325
- 2021A Field Guide to Federated Optimizationcited by 315
- 2020Personalized Federated Learning: A Meta-Learning Approachcited by 312
- 2020Attack of the Tails: Yes, You Really Can Backdoor Federated Learningcited by 309
- 2020FedML: A Research Library and Benchmark for Federated Machine Learningcited by 300
- 2019Asynchronous Federated Optimizationcited by 267
- 2021Personalized Federated Learning using Hypernetworkscited by 212
- 2020Personalized Federated Learning with First Order Model Optimizationcited by 201
- 2021Federated Multi-Task Learning under a Mixture of Distributionscited by 192
- 2021Federated Learning with Buffered Asynchronous Aggregationcited by 190
- 2017Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryptioncited by 176
- 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
- 2015Asynchronous Parallel Stochastic Gradient for Nonconvex Optimizationcited by 116
- 2021Federated Graph Classification over Non-IID Graphscited by 114
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2022: 8; 2023: 16; 2024: 19; 2025: 7; 2026: 3.
53 papers.
Sort:
By area:
- 2023FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learningcited by 149
- 2022Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challengescited by 138
- 2023When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directionscited by 84
- 2024FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Modelcited by 74
- 2022pFL-Bench: A Comprehensive Benchmark for Personalized Federated Learningcited by 44
- 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
- 2023Efficient Personalized Federated Learning via Sparse Model-Adaptationcited by 38
- 2024A Survey on Efficient Federated Learning Methods for Foundation Model Trainingcited by 29
- 2023FS-Real: Towards Real-World Cross-Device Federated Learningcited by 22
- 2024On the Convergence of Zeroth-Order Federated Tuning for Large Language Modelscited by 19
- 2024Advances in APPFL: A Comprehensive and Extensible Federated Learning Frameworkcited by 19
- 2023PFLlib: A Beginner-Friendly and Comprehensive Personalized Federated Learning Library and Benchmarkcited by 17
38 more
- 2023Revisiting Personalized Federated Learning: Robustness Against Backdoor Attackscited by 16
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcarecited by 16
- 2024Synergizing Foundation Models and Federated Learning: A Surveycited by 14
- 2023MergeSFL: Split Federated Learning with Feature Merging and Batch Size Regulationcited by 13
- 2024Towards Federated RLHF with Aggregated Client Preference for LLMscited by 13
- 2023FLGo: A Fully Customizable Federated Learning Platformcited by 12
- 2024Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcarecited by 12
- 2024Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architecturescited by 12
- 2023Tunable Soft Prompts are Messengers in Federated Learningcited by 10
- 2022Auxo: Efficient Federated Learning via Scalable Client Clusteringcited by 8
- 2024pfl-research: simulation framework for accelerating research in Private Federated Learningcited by 8
- 2024COALA: A Practical and Vision-Centric Federated Learning Platformcited by 7
- 2024PII-Scope: A Comprehensive Study on Training Data PII Extraction Attacks in LLMscited by 7
- 2025HtFLlib: A Comprehensive Heterogeneous Federated Learning Library and Benchmarkcited by 7
- 2022FedHPO-B: A Benchmark Suite for Federated Hyperparameter Optimizationcited by 6
- 2023FederatedTrust: A Solution for Trustworthy Federated Learningcited by 6
- 2023Secure and Verifiable Data Collaboration with Low-Cost Zero-Knowledge Proofscited by 5
- 2024Personalized Federated Learning of Probabilistic Models: A PAC-Bayesian Approachcited by 5
- 2022Collaborating Heterogeneous Natural Language Processing Tasks via Federated Learningcited by 4
- 2023FedML Parrot: A Scalable Federated Learning System via Heterogeneity-aware Scheduling on Sequential and Hierarchical Trainingcited by 4
- 2024Exploring the Practicality of Federated Learning: A Survey Towards the Communication Perspectivecited by 4
- 2024HiFGL: A Hierarchical Framework for Cross-silo Cross-device Federated Graph Learningcited by 4
- 2022UniFed: All-In-One Federated Learning Platform to Unify Open-Source Frameworkscited by 3
- 2025Tree-based Models for Vertical Federated Learning: A Surveycited by 3
- 2023Survey of Federated Learning Models for Spatial-Temporal Mobility Applicationscited by 2
- 2022WrapperFL: A Model Agnostic Plug-in for Industrial Federated Learningcited by 1
- 2023HPN: Personalized Federated Hyperparameter Optimizationcited by 1
- 2025Integrating Identity-Based Identification against Adaptive Adversaries in Federated Learningcited by 1
- 2025FedMeNF: Privacy-Preserving Federated Meta-Learning for Neural Fieldscited by 1
- 2025Communication-Efficient and Accurate Approach for Aggregation in Federated Low-Rank Adaptationcited by 1
- 2026Scalable Cross-Facility Federated Learning for Scientific Foundation Models on Multiple Supercomputerscited by 1
- 2023A Comprehensive Empirical Study of Bugs in Open-Source Federated Learning Frameworkscited by 0
- 2023Personalized Federated Learning via ADMM with Moreau Envelopecited by 0
- 2024A Bargaining-based Approach for Feature Trading in Vertical Federated Learningcited by 0
- 2024TablePuppet: A Generic Framework for Relational Federated Learningcited by 0
- 2024Federated Computing -- Survey on Building Blocks, Extensions and Systemscited by 0
- 2024Where is the Testbed for my Federated Learning Research?cited by 0
- 2025MedSegNet10: A Publicly Accessible Network Repository for Split Federated Medical Image Segmentationcited by 0
50 most cited of 53 All 53 (JSON)
- 2026Flower Hub: A Reproducible Benchmarking Platform for Federated Learning in Simulation and Deployment25 Aug 2026
- 2026Scalable Cross-Facility Federated Learning for Scientific Foundation Models on Multiple Supercomputers20 Mar 2026
- 2026SecureSplit: Mitigating Backdoor Attacks in Split Learning20 Jan 2026
- 2025Communication-Efficient and Accurate Approach for Aggregation in Federated Low-Rank Adaptation30 Sep 2025
- 2025On Evaluating the Poisoning Robustness of Federated Learning under Local Differential Privacy5 Sep 2025
- 2025FedMeNF: Privacy-Preserving Federated Meta-Learning for Neural Fields8 Aug 2025
- 2025HtFLlib: A Comprehensive Heterogeneous Federated Learning Library and Benchmark4 Jun 2025
- 2025Integrating Identity-Based Identification against Adaptive Adversaries in Federated Learning3 Apr 2025
- 2025Tree-based Models for Vertical Federated Learning: A Survey3 Apr 2025
- 2025MedSegNet10: A Publicly Accessible Network Repository for Split Federated Medical Image Segmentation26 Mar 2025
- 2024Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architectures28 Nov 2024
- 2024PII-Scope: A Comprehensive Study on Training Data PII Extraction Attacks in LLMs9 Oct 2024
38 more
- 2024Advances in APPFL: A Comprehensive and Extensible Federated Learning Framework17 Sep 2024
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcare15 Sep 2024
- 2024COALA: A Practical and Vision-Centric Federated Learning Platform23 Jul 2024
- 2024Where is the Testbed for my Federated Learning Research?19 Jul 2024
- 2024Towards Federated RLHF with Aggregated Client Preference for LLMs3 Jul 2024
- 2024FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model25 Jun 2024
- 2024Synergizing Foundation Models and Federated Learning: A Survey18 Jun 2024
- 2024HiFGL: A Hierarchical Framework for Cross-silo Cross-device Federated Graph Learning15 Jun 2024
- 2024Exploring the Practicality of Federated Learning: A Survey Towards the Communication Perspective30 May 2024
- 2024Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare10 May 2024
- 2024pfl-research: simulation framework for accelerating research in Private Federated Learning9 Apr 2024
- 2024Federated Computing -- Survey on Building Blocks, Extensions and Systems3 Apr 2024
- 2024TablePuppet: A Generic Framework for Relational Federated Learning23 Mar 2024
- 2024A Bargaining-based Approach for Feature Trading in Vertical Federated Learning23 Feb 2024
- 2024On the Convergence of Zeroth-Order Federated Tuning for Large Language Models8 Feb 2024
- 2024Personalized Federated Learning of Probabilistic Models: A PAC-Bayesian Approach16 Jan 2024
- 2024A Survey on Efficient Federated Learning Methods for Foundation Model Training9 Jan 2024
- 2023PFLlib: A Beginner-Friendly and Comprehensive Personalized Federated Learning Library and Benchmark8 Dec 2023
- 2023Secure and Verifiable Data Collaboration with Low-Cost Zero-Knowledge Proofs26 Nov 2023
- 2023MergeSFL: Split Federated Learning with Feature Merging and Batch Size Regulation22 Nov 2023
- 2023Tunable Soft Prompts are Messengers in Federated Learning12 Nov 2023
- 2023Personalized Federated Learning via ADMM with Moreau Envelope12 Nov 2023
- 2023FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning1 Sep 2023
- 2023A Comprehensive Empirical Study of Bugs in Open-Source Federated Learning Frameworks9 Aug 2023
- 2023When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directions27 Jun 2023
- 2023FLGo: A Fully Customizable Federated Learning Platform21 Jun 2023
- 2023Survey of Federated Learning Models for Spatial-Temporal Mobility Applications9 May 2023
- 2023Efficient Personalized Federated Learning via Sparse Model-Adaptation4 May 2023
- 2023HPN: Personalized Federated Hyperparameter Optimization11 Apr 2023
- 2023FS-Real: Towards Real-World Cross-Device Federated Learning23 Mar 2023
- 2023FedML Parrot: A Scalable Federated Learning System via Heterogeneity-aware Scheduling on Sequential and Hierarchical Training3 Mar 2023
- 2023FederatedTrust: A Solution for Trustworthy Federated Learning20 Feb 2023
- 2023Revisiting Personalized Federated Learning: Robustness Against Backdoor Attacks3 Feb 2023
- 2022Collaborating Heterogeneous Natural Language Processing Tasks via Federated Learning12 Dec 2022
- 2022Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challenges15 Nov 2022
- 2022Auxo: Efficient Federated Learning via Scalable Client Clustering29 Oct 2022
- 2022UniFed: All-In-One Federated Learning Platform to Unify Open-Source Frameworks21 Jul 2022
- 2022WrapperFL: A Model Agnostic Plug-in for Industrial Federated Learning21 Jun 2022
50 newest of 53 All 53 (JSON)
- 2023FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learningcited by 149
- 2022Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challengescited by 138
- 2023When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directionscited by 84
- 2024FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Modelcited by 74
- 2022pFL-Bench: A Comprehensive Benchmark for Personalized Federated Learningcited by 44
- 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
- 2023Efficient Personalized Federated Learning via Sparse Model-Adaptationcited by 38
- 2024A Survey on Efficient Federated Learning Methods for Foundation Model Trainingcited by 29
- 2023FS-Real: Towards Real-World Cross-Device Federated Learningcited by 22
- 2024On the Convergence of Zeroth-Order Federated Tuning for Large Language Modelscited by 19
- 2024Advances in APPFL: A Comprehensive and Extensible Federated Learning Frameworkcited by 19
- 2023PFLlib: A Beginner-Friendly and Comprehensive Personalized Federated Learning Library and Benchmarkcited by 17
12 most cited of 52 All 52 (JSON)
- 2026Flower Hub: A Reproducible Benchmarking Platform for Federated Learning in Simulation and Deployment25 Aug 2026
- 2026Scalable Cross-Facility Federated Learning for Scientific Foundation Models on Multiple Supercomputers20 Mar 2026
- 2026SecureSplit: Mitigating Backdoor Attacks in Split Learning20 Jan 2026
- 2025Communication-Efficient and Accurate Approach for Aggregation in Federated Low-Rank Adaptation30 Sep 2025
- 2025On Evaluating the Poisoning Robustness of Federated Learning under Local Differential Privacy5 Sep 2025
- 2025FedMeNF: Privacy-Preserving Federated Meta-Learning for Neural Fields8 Aug 2025
- 2025HtFLlib: A Comprehensive Heterogeneous Federated Learning Library and Benchmark4 Jun 2025
- 2025Integrating Identity-Based Identification against Adaptive Adversaries in Federated Learning3 Apr 2025
- 2025Tree-based Models for Vertical Federated Learning: A Survey3 Apr 2025
- 2025MedSegNet10: A Publicly Accessible Network Repository for Split Federated Medical Image Segmentation26 Mar 2025
- 2024Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architectures28 Nov 2024
- 2024PII-Scope: A Comprehensive Study on Training Data PII Extraction Attacks in LLMs9 Oct 2024
12 newest of 52 All 52 (JSON)