mlsanityData to 7 Oct 2026

FLStore: Efficient Federated Learning Storage for non-training workloads

arXiv 2503.00323 ↗First posted 1 Mar 2025cs.LG cs.AI cs.DCcited by 0

Not on the map. Why?

Abstract (arXiv)

Federated Learning (FL) is an approach for privacy-preserving Machine Learning (ML), enabling model training across multiple clients without centralized data collection. With an aggregator server coordinating training, aggregating model updates, and storing metadata across rounds. In addition to training, a substantial part of FL systems are the non-training workloads such as scheduling, personalization, clustering, debugging, and incentivization. Most existing systems rely on the aggregator to handle non-training workloads and use cloud services for data storage. This results in high latency and increased costs as non-training workloads rely on large volumes of metadata, including weight parameters from client updates, hyperparameters, and aggregated updates across rounds, making the situation even worse. We propose FLStore, a serverless framework for efficient FL non-training workloads and storage. FLStore unifies the data and compute planes on a serverless cache, enabling locality-aware execution via tailored caching policies to reduce latency and costs. Per our evaluations, compared to cloud object store based aggregator server FLStore reduces per request average latency by 71% and costs by 92.45%, with peak improvements of 99.7% and 98.8%, respectively. Compared to an in-memory cloud cache based aggregator server, FLStore reduces average latency by 64.6% and costs by 98.83%, with peak improvements of 98.8% and 99.6%, respectively. FLStore integrates seamlessly with existing FL frameworks with minimal modifications, while also being fault-tolerant and highly scalable.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 77 references that are in the map. First posted on arXiv 1 Mar 2025.

Builds on

38 of 77 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  4. 2019Advances and Open Problems in Federated Learningcited by 3,021
  5. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  6. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
  7. 2019Towards Federated Learning at Scale: System Designcited by 826
  8. 2018LEAF: A Benchmark for Federated Settingscited by 780
  9. 2020An Efficient Framework for Clustered Federated Learningcited by 505
  10. 2021Towards Personalized Federated Learningcited by 462
  11. 2020Flower: A Friendly Federated Learning Research Frameworkcited by 449
  12. 2019FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantizationcited by 349
26 more
  1. 2020FedML: A Research Library and Benchmark for Federated Machine Learningcited by 298
  2. 2021Federated Learning with Buffered Asynchronous Aggregationcited by 188
  3. 2021FairFed: Enabling Group Fairness in Federated Learningcited by 114
  4. 2020UVeQFed: Universal Vector Quantization for Federated Learningcited by 103
  5. 2020TiFL: A Tier-based Federated Learning Systemcited by 95
  6. 2020FedAT: A High-Performance and Communication-Efficient Federated Learning System with Asynchronous Tierscited by 64
  7. 2021Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharingcited by 58
  8. 2020IBM Federated Learning: an Enterprise Framework White Paper V0.1cited by 57
  9. 2021FedSoft: Soft Clustered Federated Learning with Proximal Local Updatingcited by 46
  10. 2018TicTac: Accelerating Distributed Deep Learning with Communication Schedulingcited by 27
  11. 2021Resource-Efficient Federated Learningcited by 26
  12. 2021Personalized Federated Learning with Contextualized Generalizationcited by 23
  13. 2020BlockFLA: Accountable Federated Learning via Hybrid Blockchain Architecturecited by 20
  14. 2020Amazon SageMaker Autopilot: a white box AutoML solution at scalecited by 20
  15. 2021Towards Demystifying Serverless Machine Learning Trainingcited by 16
  16. 2021FedLess: Secure and Scalable Federated Learning Using Serverless Computingcited by 13
  17. 2020Amazon SageMaker Automatic Model Tuning: Scalable Gradient-Free Optimizationcited by 9
  18. 2022Auxo: Efficient Federated Learning via Scalable Client Clusteringcited by 8
  19. 2023FedDebug: Systematic Debugging for Federated Learning Applicationscited by 6
  20. 2022Towards an Accountable and Reproducible Federated Learning: A FactSheets Approachcited by 3
  21. 2022Towards cost-effective and resource-aware aggregation at Edge for Federated Learningcited by 3
  22. 2020InfiniCache: Exploiting Ephemeral Serverless Functions to Build a Cost-Effective Memory Cachecited by 2
  23. 2022InfiniStore: Elastic Serverless Cloud Storagecited by 2
  24. 2024LIFL: A Lightweight, Event-driven Serverless Platform for Federated Learningcited by 2
  25. 2024DynamicFL: Federated Learning with Dynamic Communication Resource Allocationcited by 1
  26. 2024Personalized Federated Learning Techniques: Empirical Analysiscited by 1

Built on by

Not cited yet.