Towards One-shot Federated Learning: Advances, Challenges, and Future Directions
Not on the map. Why?
Abstract (arXiv)
One-shot FL enables collaborative training in a single round, eliminating the need for iterative communication, making it particularly suitable for use in resource-constrained and privacy-sensitive applications. This survey offers a thorough examination of One-shot FL, highlighting its distinct operational framework compared to traditional federated approaches. One-shot FL supports resource-limited devices by enabling single-round model aggregation while maintaining data locality. The survey systematically categorizes existing methodologies, emphasizing advancements in client model initialization, aggregation techniques, and strategies for managing heterogeneous data distributions. Furthermore, we analyze the limitations of current approaches, particularly in terms of scalability and generalization in non-IID settings. By analyzing cutting-edge techniques and outlining open challenges, this survey aspires to provide a comprehensive reference for researchers and practitioners aiming to design and implement One-shot FL systems, advancing the development and adoption of One-shot FL solutions in a real-world, resource-constrained scenario.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 50 of its 92 references that are in the map. First posted on arXiv 5 May 2025.
Builds on
50 of 92 references.
References · 50
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 897
- 2018LEAF: A Benchmark for Federated Settingscited by 780
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 566
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 454
- 2017Differentially Private Federated Learning: A Client Level Perspectivecited by 451
- 2019Bayesian Nonparametric Federated Learning of Neural Networkscited by 385
- 2021Data-Free Knowledge Distillation for Heterogeneous Federated Learningcited by 380
- 2019BCN20000: Dermoscopic Lesions in the Wildcited by 224
38 more
- 2019The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: Results of the KiTS19 Challengecited by 188
- 2020TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learningcited by 176
- 2019SCAFFOLD: Stochastic Controlled Averaging for Federated Learningcited by 174
- 2019The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomescited by 168
- 2019One-Shot Federated Learningcited by 124
- 2022FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settingscited by 121
- 2022Privacy for Free: How does Dataset Condensation Help Privacy?cited by 119
- 2020Distilled One-Shot Federated Learningcited by 108
- 2021Heterogeneity for the Win: One-Shot Federated Clusteringcited by 87
- 2021Preservation of the Global Knowledge by Not-True Distillation in Federated Learningcited by 87
- 2020Practical One-Shot Federated Learning for Cross-Silo Settingcited by 76
- 2021FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learningcited by 67
- 2020XOR Mixup: Privacy-Preserving Data Augmentation for One-Shot Federated Learningcited by 58
- 2022Federated Learning via Decentralized Dataset Distillation in Resource-Constrained Edge Environmentscited by 49
- 2021SODA10M: A Large-Scale 2D Self/Semi-Supervised Object Detection Dataset for Autonomous Drivingcited by 43
- 2023One-shot Empirical Privacy Estimation for Federated Learningcited by 35
- 2023Exploring One-shot Semi-supervised Federated Learning with A Pre-trained Diffusion Modelcited by 33
- 2024Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boostingcited by 27
- 2022Data Heterogeneity-Robust Federated Learning via Group Client Selection in Industrial IoTcited by 25
- 2022Towards Efficient Communications in Federated Learning: A Contemporary Surveycited by 24
- 2019One-Shot Federated Learning: Theoretical Limits and Algorithms to Achieve Themcited by 23
- 2023FedLPA: One-shot Federated Learning with Layer-Wise Posterior Aggregationcited by 22
- 2022One-shot Federated Learning without Server-side Trainingcited by 20
- 2024FedFisher: Leveraging Fisher Information for One-Shot Federated Learningcited by 15
- 2023FedBEVT: Federated Learning Bird's Eye View Perception Transformer in Road Traffic Systemscited by 14
- 2024Revisiting Ensembling in One-Shot Federated Learningcited by 13
- 2024Task Arithmetic Through The Lens Of One-Shot Federated Learningcited by 12
- 2024One-shot Federated Learning via Synthetic Distiller-Distillate Communicationcited by 12
- 2024FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusioncited by 11
- 2024One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversitycited by 8
- 2024Federated scientific machine learning for approximating functions and solving differential equations with data heterogeneitycited by 8
- 2023One-Shot Federated Learning for LEO Constellations that Reduces Convergence Time from Days to 90 Minutescited by 7
- 2024Navigating Heterogeneity and Privacy in One-Shot Federated Learning with Diffusion Modelscited by 7
- 2022Learnings from Federated Learning in the Real worldcited by 6
- 2025One-shot Federated Learning Methods: A Practical Guidecited by 6
- 2022Shielding Federated Learning Systems against Inference Attacks with ARM TrustZonecited by 5
- 2024Marginal and training-conditional guarantees in one-shot federated conformal predictioncited by 3
- 2024DFDG: Data-Free Dual-Generator Adversarial Distillation for One-Shot Federated Learningcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.