# Split Learning over Wireless Networks: Parallel Design and Resource Management

arXiv: https://arxiv.org/abs/2204.08119 · HTML: https://mlsanity.com/paper/2204.08119/

## Key facts

- Cited by 75 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Apr 2022.

## Built on by (most cited first, 30 of 75)

- [Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networks](https://mlsanity.com/paper/2303.15991/) (2023)
- [Split Learning in 6G Edge Networks](https://mlsanity.com/paper/2306.12194/) (2023)
- [AdaptSFL: Adaptive Split Federated Learning in Resource-constrained Edge Networks](https://mlsanity.com/paper/2403.13101/) (2024)
- [SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models](https://mlsanity.com/paper/2407.00952/) (2024)
- [Hierarchical Split Federated Learning: Convergence Analysis and System Optimization](https://mlsanity.com/paper/2412.07197/) (2024)
- [HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models](https://mlsanity.com/paper/2505.02795/) (2025)
- [Communication-Efficient Split Learning via Adaptive Feature-Wise Compression](https://mlsanity.com/paper/2307.10805/) (2023)
- [WDMoE: Wireless Distributed Large Language Models with Mixture of Experts](https://mlsanity.com/paper/2405.03131/) (2024)
- [Accelerating Split Federated Learning over Wireless Communication Networks](https://mlsanity.com/paper/2310.15584/) (2023)
- [ESFL: Efficient Split Federated Learning over Resource-Constrained Heterogeneous Wireless Devices](https://mlsanity.com/paper/2402.15903/) (2024)
- [HASFL: Heterogeneity-aware Split Federated Learning over Edge Computing Systems](https://mlsanity.com/paper/2506.08426/) (2025)
- [Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directions](https://mlsanity.com/paper/2207.09611/) (2022)
- [NetGPT: A Native-AI Network Architecture Beyond Provisioning Personalized Generative Services](https://mlsanity.com/paper/2307.06148/) (2023)
- [Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices](https://mlsanity.com/paper/2310.13981/) (2023)
- [Exploring the Privacy-Energy Consumption Tradeoff for Split Federated Learning](https://mlsanity.com/paper/2311.09441/) (2023)
- [DapperFL: Domain Adaptive Federated Learning with Model Fusion Pruning for Edge Devices](https://mlsanity.com/paper/2412.05823/) (2024)
- [Workflow Optimization for Parallel Split Learning](https://mlsanity.com/paper/2402.10092/) (2024)
- [FSL-SAGE: Accelerating Federated Split Learning via Smashed Activation Gradient Estimation](https://mlsanity.com/paper/2505.23182/) (2025)
- [Device Scheduling and Assignment in Hierarchical Federated Learning for Internet of Things](https://mlsanity.com/paper/2402.02506/) (2024)
- [Model Partition and Resource Allocation for Split Learning in Vehicular Edge Networks](https://mlsanity.com/paper/2411.06773/) (2024)
- [COMSPLIT: A Communication-Aware Split Learning Design for Heterogeneous IoT Platforms](https://mlsanity.com/paper/2410.19375/) (2024)
- [Split Unlearning](https://mlsanity.com/paper/2308.10422/) (2023)
- [Adaptive Split Learning over Energy-Constrained Wireless Edge Networks](https://mlsanity.com/paper/2403.05158/) (2024)
- [Multiple Access in the Era of Distributed Computing and Edge Intelligence](https://mlsanity.com/paper/2403.07903/) (2024)
- [Resource Management for Low-latency Cooperative Fine-tuning of Foundation Models at the Network Edge](https://mlsanity.com/paper/2407.09873/) (2024)
- [Split Federated Learning Over Heterogeneous Edge Devices: Algorithm and Optimization](https://mlsanity.com/paper/2411.13907/) (2024)
- [SLPerf: a Unified Framework for Benchmarking Split Learning](https://mlsanity.com/paper/2304.01502/) (2023)
- [Training Latency Minimization for Model-Splitting Allowed Federated Edge Learning](https://mlsanity.com/paper/2307.11532/) (2023)
- [Edge-assisted U-Shaped Split Federated Learning with Privacy-preserving for Internet of Things](https://mlsanity.com/paper/2311.04944/) (2023)
- [Speed Up Federated Learning in Heterogeneous Environment: A Dynamic Tiering Approach](https://mlsanity.com/paper/2312.05642/) (2023)

## Abstract (arXiv)

Split learning (SL) is a collaborative learning framework, which can train an artificial intelligence (AI) model between a device and an edge server by splitting the AI model into a device-side model and a server-side model at a cut layer. The existing SL approach conducts the training process sequentially across devices, which incurs significant training latency especially when the number of devices is large. In this paper, we design a novel SL scheme to reduce the training latency, named Cluster-based Parallel SL (CPSL) which conducts model training in a "first-parallel-then-sequential" manner. Specifically, the CPSL is to partition devices into several clusters, parallelly train device-side models in each cluster and aggregate them, and then sequentially train the whole AI model across clusters, thereby parallelizing the training process and reducing training latency. Furthermore, we propose a resource management algorithm to minimize the training latency of CPSL considering device heterogeneity and network dynamics in wireless networks. This is achieved by stochastically optimizing the cut layer selection, real-time device clustering, and radio spectrum allocation. The proposed two-timescale algorithm can jointly make the cut layer selection decision in a large timescale and device clustering and radio spectrum allocation decisions in a small timescale. Extensive simulation results on non-independent and identically distributed data demonstrate that the proposed solutions can greatly reduce the training latency as compared with the existing SL benchmarks, while adapting to network dynamics.
