Federated Evaluation and Tuning for On-Device Personalization: System Design & Applications
Not on the map. Why?
Abstract (arXiv)
We describe the design of our federated task processing system. Originally, the system was created to support two specific federated tasks: evaluation and tuning of on-device ML systems, primarily for the purpose of personalizing these systems. In recent years, support for an additional federated task has been added: federated learning (FL) of deep neural networks. To our knowledge, only one other system has been described in literature that supports FL at scale. We include comparisons to that system to help discuss design decisions and attached trade-offs. Finally, we describe two specific large scale personalization use cases in detail to showcase the applicability of federated tuning to on-device personalization and to highlight application specific solutions.
Key facts. Cited by 84 papers in the map (data through 7 Oct 2026). Builds on 16 of its 33 references that are in the map. First posted on arXiv 16 Feb 2021.
Builds on
16 of 33 references.
References · 16
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
- 2018On First-Order Meta-Learning Algorithmscited by 1,003
- 2019Towards Federated Learning at Scale: System Designcited by 826
- 2017Federated Multi-Task Learningcited by 669
- 2016Federated Optimization: Distributed Machine Learning for On-Device Intelligencecited by 558
- 2019Improving Federated Learning Personalization via Model Agnostic Meta Learningcited by 264
- 2016Practical Secure Aggregation for Federated Learning on User-Held Datacited by 178
- 2018Protection Against Reconstruction and Its Applications in Private Federated Learningcited by 127
- 2016Decentralized Collaborative Learning of Personalized Models over Networkscited by 73
4 more
- 2019Variational Federated Multi-Task Learningcited by 69
- 2020Improving on-device speaker verification using federated learning with privacycited by 29
- 2016Personalized Speech recognition on mobile devicescited by 23
- 2018DJAM: distributed Jacobi asynchronous method for learning personal modelscited by 2
Built on by
Citing papers per year: 2021: 13; 2022: 23; 2023: 23; 2024: 12; 2025: 8; 2026: 5.
84 papers.
Sort:
By area:
- 2021A Field Guide to Federated Optimizationcited by 312
- 2021FedScale: Benchmarking Model and System Performance of Federated Learning at Scalecited by 135
- 2021Back to the Drawing Board: A Critical Evaluation of Poisoning Attacks on Production Federated Learningcited by 116
- 2022Neurotoxin: Durable Backdoors in Federated Learningcited by 97
- 2021Papaya: Practical, Private, and Scalable Federated Learningcited by 89
- 2021On Large-Cohort Training for Federated Learningcited by 73
- 2022Decepticons: Corrupted Transformers Breach Privacy in Federated Learning for Language Modelscited by 52
- 2023(Amplified) Banded Matrix Factorization: A unified approach to private trainingcited by 49
- 2022pFL-Bench: A Comprehensive Benchmark for Personalized Federated Learningcited by 44
- 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
- 2023On the Convergence of Federated Averaging with Cyclic Client Participationcited by 31
- 2023Towards Federated Foundation Models: Scalable Dataset Pipelines for Group-Structured Learningcited by 29
38 more
- 2022POET: Training Neural Networks on Tiny Devices with Integrated Rematerialization and Pagingcited by 26
- 2021Smart at what cost? Characterising Mobile Deep Neural Networks in the wildcited by 25
- 2022Personalization Improves Privacy-Accuracy Tradeoffs in Federated Learningcited by 23
- 2023FS-Real: Towards Real-World Cross-Device Federated Learningcited by 22
- 2023Practical Differentially Private and Byzantine-resilient Federated Learningcited by 18
- 2022Towards Fair Federated Recommendation Learning: Characterizing the Inter-Dependence of System and Data Heterogeneitycited by 17
- 2023FLINT: A Platform for Federated Learning Integrationcited by 17
- 2023Federated Prompt Learning for Weather Foundation Models on Devicescited by 17
- 2024Federated Learning in Practice: Reflections and Projectionscited by 15
- 2024FedMef: Towards Memory-efficient Federated Dynamic Pruningcited by 14
- 2025POPri: Private Federated Learning using Preference-Optimized Synthetic Datacited by 14
- 2022PrivFairFL: Privacy-Preserving Group Fairness in Federated Learningcited by 13
- 2025Do We Really Need to Design New Byzantine-robust Aggregation Rules?cited by 13
- 2021SPATL: Salient Parameter Aggregation and Transfer Learning for Heterogeneous Clients in Federated Learningcited by 11
- 2023FedWon: Triumphing Multi-domain Federated Learning Without Normalizationcited by 11
- 2022Enhancing Heterogeneous Federated Learning with Knowledge Extraction and Multi-Model Fusioncited by 10
- 2021Towards Efficient Synchronous Federated Training: A Survey on System Optimization Strategiescited by 9
- 2023Hiding in Plain Sight: Disguising Data Stealing Attacks in Federated Learningcited by 9
- 2023ULDP-FL: Federated Learning with Across Silo User-Level Differential Privacycited by 9
- 2024DrJAX: Scalable and Differentiable MapReduce Primitives in JAXcited by 9
- 2021FRL: Federated Rank Learningcited by 8
- 2022Pisces: Efficient Federated Learning via Guided Asynchronous Trainingcited by 8
- 2022Auxo: Efficient Federated Learning via Scalable Client Clusteringcited by 8
- 2023Green Federated Learningcited by 8
- 2024pfl-research: simulation framework for accelerating research in Private Federated Learningcited by 8
- 2024Federated Learning under Periodic Client Participation and Heterogeneous Data: A New Communication-Efficient Algorithm and Analysiscited by 8
- 2021FedTune: Automatic Tuning of Federated Learning Hyper-Parameters from System Perspectivecited by 7
- 2022Thinking Two Moves Ahead: Anticipating Other Users Improves Backdoor Attacks in Federated Learningcited by 7
- 2021Revisiting IoT Device Identificationcited by 6
- 2022Federated Domain Adaptation for ASR with Full Self-Supervisioncited by 6
- 2023Monitoring and Adapting ML Models on Mobile Devicescited by 6
- 2023Samplable Anonymous Aggregation for Private Federated Data Analysiscited by 6
- 2024Adversarially Guided Stateful Defense Against Backdoor Attacks in Federated Deep Learningcited by 5
- 2021Heterogeneous Federated Learning using Dynamic Model Pruning and Adaptive Gradientcited by 4
- 2022OLIVE: Oblivious Federated Learning on Trusted Execution Environment against the risk of sparsificationcited by 4
- 2022Certified Robustness in Federated Learningcited by 4
- 2022FEL: High Capacity Learning for Recommendation and Ranking via Federated Ensemble Learningcited by 4
- 2022FedorAS: Federated Architecture Search under system heterogeneitycited by 4
50 most cited of 84 All 84 (JSON)
- 2026Rethinking the Transferable Adversarial Attacks and Robust Defense in Federated Learning25 Aug 2026
- 2026SecureAFL: Secure Asynchronous Federated Learning4 Apr 2026
- 2026Scalable Cross-Facility Federated Learning for Scientific Foundation Models on Multiple Supercomputers20 Mar 2026
- 2026SoK: Enhancing Cryptographic Collaborative Learning with Differential Privacy14 Jan 2026
- 2026Communication-Efficient Federated AUC Maximization with Cyclic Client Participation4 Jan 2026
- 2025Research in Collaborative Learning Does Not Serve Cross-Silo Federated Learning in Practice14 Oct 2025
- 2025FedHybrid: Breaking the Memory Wall of Federated Learning via Hybrid Tensor Management13 Oct 2025
- 2025Toward Malicious Clients Detection in Federated Learning14 May 2025
- 2025POPri: Private Federated Learning using Preference-Optimized Synthetic Data23 Apr 2025
- 2025Personalized Federated Training of Diffusion Models with Privacy Guarantees1 Apr 2025
- 2025Towards Balancing Preference and Performance through Adaptive Personalized Explainability21 Mar 2025
- 2025Decoding FL Defenses: Systemization, Pitfalls, and Remedies3 Feb 2025
38 more
- 2025Do We Really Need to Design New Byzantine-robust Aggregation Rules?29 Jan 2025
- 2024Federated Learning under Periodic Client Participation and Heterogeneous Data: A New Communication-Efficient Algorithm and Analysis30 Oct 2024
- 2024Adversarially Guided Stateful Defense Against Backdoor Attacks in Federated Deep Learning15 Oct 2024
- 2024Federated Learning in Practice: Reflections and Projections11 Oct 2024
- 2024FedStein: Enhancing Multi-Domain Federated Learning Through James-Stein Estimator4 Oct 2024
- 2024Debiasing Federated Learning with Correlated Client Participation2 Oct 2024
- 2024Confidential Federated Computations16 Apr 2024
- 2024pfl-research: simulation framework for accelerating research in Private Federated Learning9 Apr 2024
- 2024FedMef: Towards Memory-efficient Federated Dynamic Pruning21 Mar 2024
- 2024DrJAX: Scalable and Differentiable MapReduce Primitives in JAX11 Mar 2024
- 2024Fake or Compromised? Making Sense of Malicious Clients in Federated Learning10 Mar 2024
- 2024FLGuard: Byzantine-Robust Federated Learning via Ensemble of Contrastive Models5 Mar 2024
- 2024Momentum Approximation in Asynchronous Private Federated Learning14 Feb 2024
- 2023Horizontal Federated Computer Vision31 Dec 2023
- 2023Venn: Resource Management for Collaborative Learning Jobs13 Dec 2023
- 2023On the Effect of Defections in Federated Learning and How to Prevent Them28 Nov 2023
- 2023FTA: Stealthy and Adaptive Backdoor Attack with Flexible Triggers on Federated Learning31 Aug 2023
- 2023ULDP-FL: Federated Learning with Across Silo User-Level Differential Privacy23 Aug 2023
- 2023Samplable Anonymous Aggregation for Private Federated Data Analysis27 Jul 2023
- 2023Project Florida: Federated Learning Made Easy21 Jul 2023
- 2023Towards Federated Foundation Models: Scalable Dataset Pipelines for Group-Structured Learning18 Jul 2023
- 2023Population Expansion for Training Language Models with Private Federated Learning14 Jul 2023
- 2023(Amplified) Banded Matrix Factorization: A unified approach to private training13 Jun 2023
- 2023FedWon: Triumphing Multi-domain Federated Learning Without Normalization9 Jun 2023
- 2023Hiding in Plain Sight: Disguising Data Stealing Attacks in Federated Learning5 Jun 2023
- 2023Federated Prompt Learning for Weather Foundation Models on Devices23 May 2023
- 2023Evaluating Privacy Leakage in Split Learning22 May 2023
- 2023Monitoring and Adapting ML Models on Mobile Devices12 May 2023
- 2023Can Fair Federated Learning reduce the need for Personalisation?4 May 2023
- 2023FedAVO: Improving Communication Efficiency in Federated Learning with African Vultures Optimizer2 May 2023
- 2023Practical Differentially Private and Byzantine-resilient Federated Learning15 Apr 2023
- 2023Green Federated Learning26 Mar 2023
- 2023FS-Real: Towards Real-World Cross-Device Federated Learning23 Mar 2023
- 2023FLINT: A Platform for Federated Learning Integration24 Feb 2023
- 2023On the Convergence of Federated Averaging with Cyclic Client Participation6 Feb 2023
- 2023Federated Automatic Differentiation18 Jan 2023
- 2022Federated Learning Hyper-Parameter Tuning from a System Perspective24 Nov 2022
- 2022Auxo: Efficient Federated Learning via Scalable Client Clustering29 Oct 2022
50 newest of 84 All 84 (JSON)
- 2021A Field Guide to Federated Optimizationcited by 312
- 2021FedScale: Benchmarking Model and System Performance of Federated Learning at Scalecited by 135
- 2021Back to the Drawing Board: A Critical Evaluation of Poisoning Attacks on Production Federated Learningcited by 116
- 2022Neurotoxin: Durable Backdoors in Federated Learningcited by 97
- 2021Papaya: Practical, Private, and Scalable Federated Learningcited by 89
- 2021On Large-Cohort Training for Federated Learningcited by 73
- 2022Decepticons: Corrupted Transformers Breach Privacy in Federated Learning for Language Modelscited by 52
- 2023(Amplified) Banded Matrix Factorization: A unified approach to private trainingcited by 49
- 2022pFL-Bench: A Comprehensive Benchmark for Personalized Federated Learningcited by 44
- 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
- 2023On the Convergence of Federated Averaging with Cyclic Client Participationcited by 31
- 2023Towards Federated Foundation Models: Scalable Dataset Pipelines for Group-Structured Learningcited by 29
12 most cited of 81 All 81 (JSON)
- 2026Rethinking the Transferable Adversarial Attacks and Robust Defense in Federated Learning25 Aug 2026
- 2026SecureAFL: Secure Asynchronous Federated Learning4 Apr 2026
- 2026Scalable Cross-Facility Federated Learning for Scientific Foundation Models on Multiple Supercomputers20 Mar 2026
- 2026SoK: Enhancing Cryptographic Collaborative Learning with Differential Privacy14 Jan 2026
- 2026Communication-Efficient Federated AUC Maximization with Cyclic Client Participation4 Jan 2026
- 2025Research in Collaborative Learning Does Not Serve Cross-Silo Federated Learning in Practice14 Oct 2025
- 2025FedHybrid: Breaking the Memory Wall of Federated Learning via Hybrid Tensor Management13 Oct 2025
- 2025Toward Malicious Clients Detection in Federated Learning14 May 2025
- 2025Towards Balancing Preference and Performance through Adaptive Personalized Explainability21 Mar 2025
- 2025Decoding FL Defenses: Systemization, Pitfalls, and Remedies3 Feb 2025
- 2025Do We Really Need to Design New Byzantine-robust Aggregation Rules?29 Jan 2025
- 2024Federated Learning under Periodic Client Participation and Heterogeneous Data: A New Communication-Efficient Algorithm and Analysis30 Oct 2024
12 newest of 81 All 81 (JSON)