mlsanityData to 14 Oct 2026

DapperFL: Domain Adaptive Federated Learning with Model Fusion Pruning for Edge Devices

arXiv 2412.05823 ↗First posted 8 Dec 2024cs.LG cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

Federated learning (FL) has emerged as a prominent machine learning paradigm in edge computing environments, enabling edge devices to collaboratively optimize a global model without sharing their private data. However, existing FL frameworks suffer from efficacy deterioration due to the system heterogeneity inherent in edge computing, especially in the presence of domain shifts across local data. In this paper, we propose a heterogeneous FL framework DapperFL, to enhance model performance across multiple domains. In DapperFL, we introduce a dedicated Model Fusion Pruning (MFP) module to produce personalized compact local models for clients to address the system heterogeneity challenges. The MFP module prunes local models with fused knowledge obtained from both local and remaining domains, ensuring robustness to domain shifts. Additionally, we design a Domain Adaptive Regularization (DAR) module to further improve the overall performance of DapperFL. The DAR module employs regularization generated by the pruned model, aiming to learn robust representations across domains. Furthermore, we introduce a specific aggregation algorithm for aggregating heterogeneous local models with tailored architectures and weights. We implement DapperFL on a realworld FL platform with heterogeneous clients. Experimental results on benchmark datasets with multiple domains demonstrate that DapperFL outperforms several state-of-the-art FL frameworks by up to 2.28%, while significantly achieving model volume reductions ranging from 20% to 80%. Our code is available at: https://github.com/jyzgh/DapperFL.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 40 of its 57 references that are in the map. First posted on arXiv 8 Dec 2024.

Builds on

40 of 57 references.

References · 40

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  4. 2019Advances and Open Problems in Federated Learningcited by 3,046
  5. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  6. 2014How transferable are features in deep neural networks?cited by 1,225
  7. 2019A Comprehensive Survey on Transfer Learningcited by 1,160
  8. 2016Pruning Filters for Efficient ConvNetscited by 1,143
  9. 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 943
  10. 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 906
  11. 2021Model-Contrastive Federated Learningcited by 766
  12. 2021Domain Generalization: A Surveycited by 764
28 more
  1. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
  2. 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 676
  3. 2021Domain Generalization with MixStylecited by 566
  4. 2019Federated Learning in Mobile Edge Networks: A Comprehensive Surveycited by 408
  5. 2021Data-Free Knowledge Distillation for Heterogeneous Federated Learningcited by 383
  6. 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 352
  7. 2020HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clientscited by 337
  8. 2020SplitFed: When Federated Learning Meets Split Learningcited by 310
  9. 2020FedML: A Research Library and Benchmark for Federated Machine Learningcited by 300
  10. 2019Model Pruning Enables Efficient Federated Learning on Edge Devicescited by 222
  11. 2018Expanding the Reach of Federated Learning by Reducing Client Resource Requirementscited by 163
  12. 2018Domain Generalization via Conditional Invariant Representationcited by 146
  13. 2022Uncertainty Modeling for Out-of-Distribution Generalizationcited by 125
  14. 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
  15. 2020Learning to Generalize Unseen Domains via Memory-based Multi-Source Meta-Learning for Person Re-Identificationcited by 110
  16. 2022FedRolex: Model-Heterogeneous Federated Learning with Rolling Sub-Model Extractioncited by 102
  17. 2022Split Learning over Wireless Networks: Parallel Design and Resource Managementcited by 75
  18. 2023FedGH: Heterogeneous Federated Learning with Generalized Global Headercited by 56
  19. 2018Effects of Degradations on Deep Neural Network Architecturescited by 48
  20. 2022A Survey on Heterogeneous Federated Learningcited by 42
  21. 2021Federated Learning with Domain Generalizationcited by 41
  22. 2023Eliminating Domain Bias for Federated Learning in Representation Spacecited by 38
  23. 2020Respecting Domain Relations: Hypothesis Invariance for Domain Generalizationcited by 30
  24. 2023Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models Reductioncited by 24
  25. 2023StableFDG: Style and Attention Based Learning for Federated Domain Generalizationcited by 21
  26. 2023Benchmarking Algorithms for Federated Domain Generalizationcited by 14
  27. 2022Binarizing Split Learning for Data Privacy Enhancement and Computation Reductioncited by 11
  28. 2023One-Shot Pruning for Fast-adapting Pre-trained Models on Devicescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 6.

9 papers.