One-Shot Federated Learning
Not on the map. Why?
Abstract (arXiv)
We present one-shot federated learning, where a central server learns a global model over a network of federated devices in a single round of communication. Our approach - drawing on ensemble learning and knowledge aggregation - achieves an average relative gain of 51.5% in AUC over local baselines and comes within 90.1% of the (unattainable) global ideal. We discuss these methods and identify several promising directions of future work.
Key facts. Cited by 124 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 20; 2023: 20; 2024: 30; 2025: 19; 2026: 13.
124 papers.
Sort:
By area:
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 566
- 2021Data-Free Knowledge Distillation for Heterogeneous Federated Learningcited by 380
- 2021Federated Learning for Open Bankingcited by 138
- 2021Parameterized Knowledge Transfer for Personalized Federated Learningcited by 108
- 2021DENSE: Data-Free One-Shot Federated Learningcited by 100
- 2025A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applicationscited by 91
- 2023Deep Model Fusion: A Surveycited by 89
- 2021Federated Learning: Opportunities and Challengescited by 83
- 2022Personalized Federated Learning via Variational Bayesian Inferencecited by 68
- 2021FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learningcited by 67
- 2022FedDM: Iterative Distribution Matching for Communication-Efficient Federated Learningcited by 65
- 2022Federated Learning via Decentralized Dataset Distillation in Resource-Constrained Edge Environmentscited by 49
38 more
- 2021FedSoft: Soft Clustered Federated Learning with Proximal Local Updatingcited by 46
- 2021Federated Learning Meets Natural Language Processing: A Surveycited by 42
- 2021Communication Efficiency in Federated Learning: Achievements and Challengescited by 40
- 2021Improving Fairness via Federated Learningcited by 39
- 2021Scaling Federated Learning for Fine-tuning of Large Language Modelscited by 36
- 2023Cross-Silo Prototypical Calibration for Federated Learning with Non-IID Datacited by 35
- 2021FedZKT: Zero-Shot Knowledge Transfer towards Resource-Constrained Federated Learning with Heterogeneous On-Device Modelscited by 31
- 2021SemiFed: Semi-supervised Federated Learning with Consistency and Pseudo-Labelingcited by 29
- 2024Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boostingcited by 27
- 2023One-Shot Federated Conformal Predictioncited by 26
- 2022A Survey on Federated Recommendation Systemscited by 25
- 2023Federated Generative Learning with Foundation Modelscited by 23
- 2023FedLPA: One-shot Federated Learning with Layer-Wise Posterior Aggregationcited by 22
- 2022One-shot Federated Learning without Server-side Trainingcited by 20
- 2022Practical Vertical Federated Learning with Unsupervised Representation Learningcited by 19
- 2021FedDQ: Communication-Efficient Federated Learning with Descending Quantizationcited by 18
- 2021Evaluating Federated Learning for Intrusion Detection in Internet of Things: Review and Challengescited by 16
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcarecited by 16
- 2024FedBiP: Heterogeneous One-Shot Federated Learning with Personalized Latent Diffusion Modelscited by 16
- 2022Non-IID Quantum Federated Learning with One-shot Communication Complexitycited by 15
- 2022Federated Few-Shot Learning for Mobile NLPcited by 15
- 2024FedFisher: Leveraging Fisher Information for One-Shot Federated Learningcited by 15
- 2022PerFED-GAN: Personalized Federated Learning via Generative Adversarial Networkscited by 14
- 2024Federated Distillation: A Surveycited by 14
- 2024Parametric Feature Transfer: One-shot Federated Learning with Foundation Modelscited by 13
- 2024Revisiting Ensembling in One-Shot Federated Learningcited by 13
- 2021FLIX: A Simple and Communication-Efficient Alternative to Local Methods in Federated Learningcited by 12
- 2024Task Arithmetic Through The Lens Of One-Shot Federated Learningcited by 12
- 2024One-shot Federated Learning via Synthetic Distiller-Distillate Communicationcited by 12
- 2021Federated Few-Shot Learning with Adversarial Learningcited by 11
- 2024FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusioncited by 11
- 2021What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Datacited by 10
- 2021FedMe: Federated Learning via Model Exchangecited by 10
- 2023Patchwork Learning: A Paradigm Towards Integrative Analysis across Diverse Biomedical Data Sourcescited by 10
- 2024One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversitycited by 8
- 2024Knowledge Distillation in Federated Learning: a Survey on Long Lasting Challenges and New Solutionscited by 8
- 2023One-Shot Federated Learning for LEO Constellations that Reduces Convergence Time from Days to 90 Minutescited by 7
- 2024Navigating Heterogeneity and Privacy in One-Shot Federated Learning with Diffusion Modelscited by 7
50 most cited of 124 All 124 (JSON)
- 2026Certified Uncertainty Propagation in One-Shot Federated Bayesian Models via Posterior Event Transport14 Sep 2026
- 2026Structural Entropy-Driven Graph Diffusion Generation for One-Shot Federated Graph Learning6 Sep 2026
- 2026Distribution Alignment for One-Shot Federated Learning via Optimal Transport15 Jun 2026
- 2026Multi-Level Analyzation of Imbalance to Resolve Non-IID-Ness in Federated Learning8 Jun 2026
- 2026Provable Sparse Inversion and Token Relabel Enhanced One-shot Federated Learning with ViTs11 May 2026
- 2026Robust Server Defense Against Unreliable Clients in One-Shot Fair Collaborative Machine Learning9 May 2026
- 2026Enabling Federated Inference via Unsupervised Consensus Embedding7 May 2026
- 2026FederatedFactory: Generative One-Shot Learning for Extremely Non-IID Distributed Scenarios17 Mar 2026
- 2026Catastrophic Forgetting Resilient One-Shot Incremental Federated Learning19 Feb 2026
- 2026The Gaussian-Head OFL Family: One-Shot Federated Learning from Client Global Statistics1 Feb 2026
- 2026Communication-efficient Federated Graph Classification via Generative Diffusion Modeling22 Jan 2026
- 2026One-Shot Federated Ridge Regression: Exact Recovery via Sufficient Statistic Aggregation13 Jan 2026
38 more
- 2026FedBiCross: Personalized One-Shot Federated Learning on Medical Images5 Jan 2026
- 2025A Robust Federated Learning Approach for Combating Attacks Against IoT Systems Under non-IID Challenges20 Nov 2025
- 2025On the Convergence and Stability of Distributed Sub-model Training8 Nov 2025
- 2025Robust Federated Inference30 Sep 2025
- 2025Towards a Larger Model via One-Shot Federated Learning on Heterogeneous Client Models19 Aug 2025
- 2025A New One-Shot Federated Learning Framework for Medical Imaging Classification with Feature-Guided Rectified Flow and Knowledge Distillation25 Jul 2025
- 2025FedBKD: Distilled Federated Learning to Embrace Gerneralization and Personalization on Non-IID Data25 Jun 2025
- 2025Federated Gaussian Mixture Models2 Jun 2025
- 2025Mosaic: Data-Free Knowledge Distillation via Mixture-of-Experts for Heterogeneous Distributed Environments26 May 2025
- 2025Towards One-shot Federated Learning: Advances, Challenges, and Future Directions5 May 2025
- 2025Defending against Backdoor Attacks via Module Switching8 Apr 2025
- 2025Federated Learning for Medical Image Classification: A Comprehensive Benchmark7 Apr 2025
- 2025Hierarchical Knowledge Structuring for Effective Federated Learning in Heterogeneous Environments4 Apr 2025
- 2025FedBEns: One-Shot Federated Learning based on Bayesian Ensemble19 Mar 2025
- 2025A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications10 Mar 2025
- 2025Capture Global Feature Statistics for One-Shot Federated Learning10 Mar 2025
- 2025One-shot Federated Learning Methods: A Practical Guide13 Feb 2025
- 2025FedMHO: Heterogeneous One-Shot Federated Learning Towards Resource-Constrained Edge Devices12 Feb 2025
- 2025One-Shot Federated Learning with Classifier-Free Diffusion Models12 Feb 2025
- 2025Fine-Tuning Federated Learning-Based Intrusion Detection Systems for Transportation IoT10 Feb 2025
- 2024A cautionary tale on the cost-effectiveness of collaborative AI in real-world medical applications9 Dec 2024
- 2024One-shot Federated Learning via Synthetic Distiller-Distillate Communication6 Dec 2024
- 2024Revisiting Federated Fine-Tuning: A Single Communication Round is Enough for Foundation Models5 Dec 2024
- 2024Task Arithmetic Through The Lens Of One-Shot Federated Learning27 Nov 2024
- 2024Personalized One-shot Federated Graph Learning for Heterogeneous Clients18 Nov 2024
- 2024Revisiting Ensembling in One-Shot Federated Learning11 Nov 2024
- 2024Local Superior Soups: A Catalyst for Model Merging in Cross-Silo Federated Learning31 Oct 2024
- 2024A Unified Solution to Diverse Heterogeneities in One-shot Federated Learning28 Oct 2024
- 2024FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusion27 Oct 2024
- 2024Private, Efficient and Scalable Kernel Learning for Medical Image Analysis21 Oct 2024
- 2024Disentangling data distribution for Federated Learning16 Oct 2024
- 2024FedBiP: Heterogeneous One-Shot Federated Learning with Personalized Latent Diffusion Models7 Oct 2024
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcare15 Sep 2024
- 2024DFDG: Data-Free Dual-Generator Adversarial Distillation for One-Shot Federated Learning12 Sep 2024
- 2024One-Shot Collaborative Data Distillation5 Aug 2024
- 2024CELLM: An Efficient Communication in Large Language Models Training for Federated Learning30 Jul 2024
- 2024Accuracy-Privacy Trade-off in the Mitigation of Membership Inference Attack in Federated Learning26 Jul 2024
- 2024FedAQ: Communication-Efficient Federated Edge Learning via Joint Uplink and Downlink Adaptive Quantization26 Jun 2024
50 newest of 124 All 124 (JSON)
- 2024FedBiP: Heterogeneous One-Shot Federated Learning with Personalized Latent Diffusion Modelscited by 16
- 2024Navigating Heterogeneity and Privacy in One-Shot Federated Learning with Diffusion Modelscited by 7
- 2025One-Shot Federated Learning with Classifier-Free Diffusion Modelscited by 7
- 2023One-Shot Heterogeneous Federated Learning with Local Model-Guided Diffusion Modelscited by 5
- 2025A New One-Shot Federated Learning Framework for Medical Imaging Classification with Feature-Guided Rectified Flow and Knowledge Distillationcited by 1
- 2026Communication-efficient Federated Graph Classification via Generative Diffusion Modelingcited by 0
- 2026Communication-efficient Federated Graph Classification via Generative Diffusion Modeling22 Jan 2026
- 2025A New One-Shot Federated Learning Framework for Medical Imaging Classification with Feature-Guided Rectified Flow and Knowledge Distillation25 Jul 2025
- 2025One-Shot Federated Learning with Classifier-Free Diffusion Models12 Feb 2025
- 2024FedBiP: Heterogeneous One-Shot Federated Learning with Personalized Latent Diffusion Models7 Oct 2024
- 2024Navigating Heterogeneity and Privacy in One-Shot Federated Learning with Diffusion Models2 May 2024
- 2023One-Shot Heterogeneous Federated Learning with Local Model-Guided Diffusion Models15 Nov 2023
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 566
- 2021Data-Free Knowledge Distillation for Heterogeneous Federated Learningcited by 380
- 2021Federated Learning for Open Bankingcited by 138
- 2021Parameterized Knowledge Transfer for Personalized Federated Learningcited by 108
- 2021DENSE: Data-Free One-Shot Federated Learningcited by 100
- 2023Deep Model Fusion: A Surveycited by 89
- 2021Federated Learning: Opportunities and Challengescited by 83
- 2022Personalized Federated Learning via Variational Bayesian Inferencecited by 68
- 2021FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learningcited by 67
- 2022FedDM: Iterative Distribution Matching for Communication-Efficient Federated Learningcited by 65
- 2022Federated Learning via Decentralized Dataset Distillation in Resource-Constrained Edge Environmentscited by 49
- 2021FedSoft: Soft Clustered Federated Learning with Proximal Local Updatingcited by 46
12 most cited of 115 All 115 (JSON)
- 2026Certified Uncertainty Propagation in One-Shot Federated Bayesian Models via Posterior Event Transport14 Sep 2026
- 2026Structural Entropy-Driven Graph Diffusion Generation for One-Shot Federated Graph Learning6 Sep 2026
- 2026Distribution Alignment for One-Shot Federated Learning via Optimal Transport15 Jun 2026
- 2026Multi-Level Analyzation of Imbalance to Resolve Non-IID-Ness in Federated Learning8 Jun 2026
- 2026Provable Sparse Inversion and Token Relabel Enhanced One-shot Federated Learning with ViTs11 May 2026
- 2026Robust Server Defense Against Unreliable Clients in One-Shot Fair Collaborative Machine Learning9 May 2026
- 2026Enabling Federated Inference via Unsupervised Consensus Embedding7 May 2026
- 2026FederatedFactory: Generative One-Shot Learning for Extremely Non-IID Distributed Scenarios17 Mar 2026
- 2026Catastrophic Forgetting Resilient One-Shot Incremental Federated Learning19 Feb 2026
- 2026The Gaussian-Head OFL Family: One-Shot Federated Learning from Client Global Statistics1 Feb 2026
- 2026One-Shot Federated Ridge Regression: Exact Recovery via Sufficient Statistic Aggregation13 Jan 2026
- 2026FedBiCross: Personalized One-Shot Federated Learning on Medical Images5 Jan 2026
12 newest of 115 All 115 (JSON)