mlsanityData to 14 Oct 2026

Have Your Cake and Eat It Too: Toward Efficient and Accurate Split Federated Learning

arXiv 2311.13163 ↗First posted 22 Nov 2023cs.LG cs.DCcited by 6

Not on the map. Why?

Abstract (arXiv)

Due to its advantages in resource constraint scenarios, Split Federated Learning (SFL) is promising in AIoT systems. However, due to data heterogeneity and stragglers, SFL suffers from the challenges of low inference accuracy and low efficiency. To address these issues, this paper presents a novel SFL approach, named Sliding Split Federated Learning (S2FL), which adopts an adaptive sliding model split strategy and a data balance-based training mechanism. By dynamically dispatching different model portions to AIoT devices according to their computing capability, S2FL can alleviate the low training efficiency caused by stragglers. By combining features uploaded by devices with different data distributions to generate multiple larger batches with a uniform distribution for back-propagation, S2FL can alleviate the performance degradation caused by data heterogeneity. Experimental results demonstrate that, compared to conventional SFL, S2FL can achieve up to 16.5% inference accuracy improvement and 3.54X training acceleration.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 28 of its 47 references that are in the map. First posted on arXiv 22 Nov 2023.

Builds on

28 of 47 references.

References · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  4. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  5. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  6. 2019On the Convergence of FedAvg on Non-IID Datacited by 1,229
  7. 2018Federated Learning with Non-IID Datacited by 1,108
  8. 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
  9. 2020An Efficient Framework for Clustered Federated Learningcited by 511
  10. 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 459
  11. 2018Split learning for health: Distributed deep learning without sharing raw patient datacited by 395
  12. 2021Data-Free Knowledge Distillation for Heterogeneous Federated Learningcited by 383
16 more
  1. 2018Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edgecited by 352
  2. 2020SplitFed: When Federated Learning Meets Split Learningcited by 310
  3. 2018Distributed learning of deep neural network over multiple agentscited by 279
  4. 2019Asynchronous Federated Optimizationcited by 267
  5. 2019Model Pruning Enables Efficient Federated Learning on Edge Devicescited by 222
  6. 2022FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correctioncited by 181
  7. 2020Distillation-Based Semi-Supervised Federated Learning for Communication-Efficient Collaborative Training with Non-IID Private Datacited by 125
  8. 2021Multi-Center Federated Learning: Clients Clustering for Better Personalizationcited by 113
  9. 2020Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Thingscited by 111
  10. 2019SAFA: a Semi-Asynchronous Protocol for Fast Federated Learning with Low Overheadcited by 82
  11. 2018In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learningcited by 80
  12. 2020FedAT: A High-Performance and Communication-Efficient Federated Learning System with Asynchronous Tierscited by 64
  13. 2022FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregationcited by 21
  14. 2021A Decentralized Federated Learning Framework via Committee Mechanism with Convergence Guaranteecited by 16
  15. 2022GitFL: Adaptive Asynchronous Federated Learning using Version Controlcited by 10
  16. 2021HADFL: Heterogeneity-aware Decentralized Federated Learning Frameworkcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 2; 2026: 1.

6 papers.