Enhancing Efficiency in Multidevice Federated Learning through Data Selection
Not on the map. Why?
Abstract (arXiv)
Ubiquitous wearable and mobile devices provide access to a diverse set of data. However, the mobility demand for our devices naturally imposes constraints on their computational and communication capabilities. A solution is to locally learn knowledge from data captured by ubiquitous devices, rather than to store and transmit the data in its original form. In this paper, we develop a federated learning framework, called Centaur, to incorporate on-device data selection at the edge, which allows partition-based training of a deep neural nets through collaboration between constrained and resourceful devices within the multidevice ecosystem of the same user. We benchmark on five neural net architecture and six datasets that include image data and wearable sensor time series. On average, Centaur achieves ~19% higher classification accuracy and ~58% lower federated training latency, compared to the baseline. We also evaluate Centaur when dealing with imbalanced non-iid data, client participation heterogeneity, and different mobility patterns. To encourage further research in this area, we release our code at https://github.com/nokia-bell-labs/data-centric-federated-learning
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 33 of its 64 references that are in the map. First posted on arXiv 8 Nov 2022.
Builds on
33 of 64 references.
References · 33
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2019Searching for MobileNetV3cited by 1,984
- 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,132
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2020Adaptive Federated Optimizationcited by 1,036
- 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
- 2020Ensemble Distillation for Robust Model Fusion in Federated Learningcited by 678
- 2018Federated Learning for Mobile Keyboard Predictioncited by 565
- 2020Federated Learning with Matched Averagingcited by 564
- 2020Flower: A Friendly Federated Learning Research Frameworkcited by 449
21 more
- 2020HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clientscited by 334
- 2018Not All Samples Are Created Equal: Deep Learning with Importance Samplingcited by 323
- 2020SplitFed: When Federated Learning Meets Split Learningcited by 308
- 2018Distributed learning of deep neural network over multiple agentscited by 277
- 2019Client-Edge-Cloud Hierarchical Federated Learningcited by 202
- 2020TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systemscited by 161
- 2022On-Device Training Under 256KB Memorycited by 158
- 2021Parameterized Knowledge Transfer for Personalized Federated Learningcited by 108
- 2019Hierarchical Federated Learning Across Heterogeneous Cellular Networkscited by 98
- 2019Accelerating Deep Learning by Focusing on the Biggest Loserscited by 94
- 2021PPFL: Privacy-preserving Federated Learning with Trusted Execution Environmentscited by 93
- 2022DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Trainingcited by 74
- 2018Mobile Sensor Data Anonymizationcited by 70
- 2020μNAS: Constrained Neural Architecture Search for Microcontrollerscited by 54
- 2021Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Bettercited by 54
- 2019SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollerscited by 52
- 2021FLOP: Federated Learning on Medical Datasets using Partial Networkscited by 42
- 2021FedZKT: Zero-Shot Knowledge Transfer towards Resource-Constrained Federated Learning with Heterogeneous On-Device Modelscited by 31
- 20183LC: Lightweight and Effective Traffic Compression for Distributed Machine Learningcited by 16
- 2021On-device Federated Learning with Flowercited by 13
- 2021Communication-Efficient Hierarchical Federated Learning for IoT Heterogeneous Systems with Imbalanced Datacited by 10
Built on by
Citing papers per year: 2025: 2.
2 papers.