Closing the Generalization Gap in Parameter-efficient Federated Edge Learning
Not on the map. Why?
Abstract (arXiv)
Federated edge learning (FEEL) provides a promising foundation for edge artificial intelligence (AI) by enabling collaborative model training while preserving data privacy. However, limited and heterogeneous local datasets, as well as resource-constrained deployment, severely degrade both model generalization and resource utilization, leading to a compromised learning performance. Therefore, we propose a parameter-efficient FEEL framework that jointly leverages model pruning and client selection to tackle such challenges. First, we derive an information-theoretic generalization statement that characterizes the discrepancy between training and testing function losses and embed it into the convergence analysis. It reveals that a larger local generalization statement can undermine the global convergence. Then, we formulate a generalization-aware average squared gradient norm bound minimization problem, by jointly optimizing the pruning ratios, client selection, and communication-computation resources under energy and delay constraints. Despite its non-convexity, the resulting mixed-integer problem is efficiently solved via an alternating optimization algorithm. Extensive experiments demonstrate that the proposed design achieves superior learning performance than state-of-the-art baselines, validating the effectiveness of coupling generalization-aware analysis with system-level optimization for efficient FEEL.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
21 of 44 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2019Importance Estimation for Neural Network Pruningcited by 531
- 2021Federated Learning on Non-IID Data: A Surveycited by 345
- 2021No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Datacited by 241
- 2019Energy Efficient Federated Learning Over Wireless Communication Networkscited by 181
- 2020One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysiscited by 108
- 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmarkcited by 97
- 2023Decentralized Federated Learning: A Survey and Perspectivecited by 86
- 2020Towards Flexible Device Participation in Federated Learningcited by 64
- 2021Consensus Control for Decentralized Deep Learningcited by 49
- 2022Joint Privacy Enhancement and Quantization in Federated Learningcited by 34
9 more
- 2024Rethinking Resource Management in Edge Learning: A Joint Pre-training and Fine-tuning Design Paradigmcited by 13
- 2023FedCiR: Client-Invariant Representation Learning for Federated Non-IID Featurescited by 12
- 2022Towards Energy Efficient Distributed Federated Learning for 6G Networkscited by 7
- 2025The Larger the Merrier? Efficient Large AI Model Inference in Wireless Edge Networkscited by 6
- 2024Personalized Federated Learning of Probabilistic Models: A PAC-Bayesian Approachcited by 5
- 2024Resource-Aware Hierarchical Federated Learning in Wireless Video Caching Networkscited by 4
- 2025Federated Intelligence: When Large AI Models Meet Federated Fine-Tuning and Collaborative Reasoning at the Network Edgecited by 4
- 2024Towards Communication-efficient Federated Learning via Sparse and Aligned Adaptive Optimizationcited by 1
- 2025AI-in-the-Loop Sensing and Communication Joint Design for Edge Intelligencecited by 1
Built on by
Not cited yet.