Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models
Not on the map. Why?
Abstract (arXiv)
Federated learning (FL) is an emerging technique that trains massive and geographically distributed edge data while maintaining privacy. However, FL has inherent challenges in terms of fairness and computational efficiency due to the rising heterogeneity of edges, and thus usually results in sub-optimal performance in recent state-of-the-art (SOTA) solutions. In this paper, we propose a Customized Federated Learning (CFL) system to eliminate FL heterogeneity from multiple dimensions. Specifically, CFL tailors personalized models from the specially designed global model for each client jointly guided by an online trained model-search helper and a novel aggregation algorithm. Extensive experiments demonstrate that CFL has full-stack advantages for both FL training and edge reasoning and significantly improves the SOTA performance w.r.t. model accuracy (up to 7.2% in the non-heterogeneous environment and up to 21.8% in the heterogeneous environment), efficiency, and FL fairness.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 41 of its 73 references that are in the map. First posted on arXiv 9 Feb 2023.
Builds on
41 of 73 references.
References · 41
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
- 2018Federated Learning with Non-IID Datacited by 1,099
- 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 778
- 2017Federated Multi-Task Learningcited by 669
- 2016Federated Optimization: Distributed Machine Learning for On-Device Intelligencecited by 558
- 2021Towards Personalized Federated Learningcited by 462
- 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 454
- 2019Federated Machine Learning: Concept and Applicationscited by 409
- 2019Fair Resource Allocation in Federated Learningcited by 389
29 more
- 2017SkipNet: Learning Dynamic Routing in Convolutional Networkscited by 328
- 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 277
- 2018Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learningcited by 242
- 2015Compressing Neural Networks with the Hashing Trickcited by 150
- 2015Structured Pruning of Deep Convolutional Neural Networkscited by 148
- 2020FMore: An Incentive Scheme of Multi-dimensional Auction for Federated Learning in MECcited by 48
- 2021FedCor: Correlation-Based Active Client Selection Strategy for Heterogeneous Federated Learningcited by 43
- 2015From Facial Parts Responses to Face Detection: A Deep Learning Approachcited by 42
- 2022Decomposed Soft Prompt Guided Fusion Enhancing for Compositional Zero-Shot Learningcited by 36
- 2020A Novel Perspective to Zero-shot Learning: Towards an Alignment of Manifold Structures via Semantic Feature Expansioncited by 31
- 2022Communication-Efficient Device Scheduling for Federated Learning Using Stochastic Optimizationcited by 28
- 2017Performance Guaranteed Network Acceleration via High-Order Residual Quantizationcited by 24
- 2021Personalized Federated Learning with Contextualized Generalizationcited by 23
- 2022CaDM: Codec-aware Diffusion Modeling for Neural-enhanced Video Streamingcited by 23
- 2022Towards Unbiased Multi-label Zero-Shot Learning with Pyramid and Semantic Attentioncited by 21
- 2019AMS-SFE: Towards an Alignment of Manifold Structures via Semantic Feature Expansion for Zero-shot Learningcited by 19
- 2019Adaptive Adjustment with Semantic Feature Space for Zero-Shot Recognitioncited by 18
- 2019Position-Aware Convolutional Networks for Traffic Predictioncited by 18
- 2022Exploring Optimal Substructure for Out-of-distribution Generalization via Feature-targeted Model Pruningcited by 17
- 2021Learning Robust Visual-semantic Mapping for Zero-shot Learningcited by 16
- 2021Communication-Efficient Online Federated Learning Framework for Nonlinear Regressioncited by 16
- 2022Efficient Stein Variational Inference for Reliable Distribution-lossless Network Pruningcited by 16
- 2019EE-AE: An Exclusivity Enhanced Unsupervised Feature Learning Approachcited by 15
- 2021Dynamic Class Queue for Large Scale Face Recognition In the Wildcited by 14
- 2022Fed-FSNet: Mitigating Non-I.I.D. Federated Learning via Fuzzy Synthesizing Networkcited by 14
- 2020Testing the Safety of Self-driving Vehicles by Simulating Perception and Predictioncited by 12
- 2022Personalized Federated Learning with Server-Side Informationcited by 6
- 2020Communication Contention Aware Scheduling of Multiple Deep Learning Training Jobscited by 3
- 2017Neuron Pruning for Compressing Deep Networks using Maxout Architecturescited by 1
Built on by
Citing papers per year: 2023: 4; 2024: 5; 2025: 1.
10 papers.
- 2023SRCD: Semantic Reasoning with Compound Domains for Single-Domain Generalized Object Detectioncited by 28
- 2024Fine-Grained Zero-Shot Learning: Advances, Challenges, and Prospectscited by 12
- 2023SFP: Spurious Feature-targeted Pruning for Out-of-Distribution Generalizationcited by 9
- 2023GBE-MLZSL: A Group Bi-Enhancement Framework for Multi-Label Zero-Shot Learningcited by 8
- 2023Attribute-Aware Representation Rectification for Generalized Zero-Shot Learningcited by 6
- 2024TsCA: On the Semantic Consistency Alignment via Conditional Transport for Compositional Zero-Shot Learningcited by 6
- 2024On the Element-Wise Representation and Reasoning in Zero-Shot Image Recognition: A Systematic Surveycited by 5
- 2024Dual Expert Distillation Network for Generalized Zero-Shot Learningcited by 4
- 2024Epsilon: Exploring Comprehensive Visual-Semantic Projection for Multi-Label Zero-Shot Learningcited by 3
- 2025FedAPA: Server-side Gradient-Based Adaptive Personalized Aggregation for Federated Learning on Heterogeneous Datacited by 0
- 2025FedAPA: Server-side Gradient-Based Adaptive Personalized Aggregation for Federated Learning on Heterogeneous Data11 Feb 2025
- 2024Epsilon: Exploring Comprehensive Visual-Semantic Projection for Multi-Label Zero-Shot Learning22 Aug 2024
- 2024TsCA: On the Semantic Consistency Alignment via Conditional Transport for Compositional Zero-Shot Learning16 Aug 2024
- 2024On the Element-Wise Representation and Reasoning in Zero-Shot Image Recognition: A Systematic Survey9 Aug 2024
- 2024Dual Expert Distillation Network for Generalized Zero-Shot Learning25 Apr 2024
- 2024Fine-Grained Zero-Shot Learning: Advances, Challenges, and Prospects31 Jan 2024
- 2023Attribute-Aware Representation Rectification for Generalized Zero-Shot Learning23 Nov 2023
- 2023GBE-MLZSL: A Group Bi-Enhancement Framework for Multi-Label Zero-Shot Learning2 Sep 2023
- 2023SRCD: Semantic Reasoning with Compound Domains for Single-Domain Generalized Object Detection4 Jul 2023
- 2023SFP: Spurious Feature-targeted Pruning for Out-of-Distribution Generalization19 May 2023