Robust Split Federated Learning for U-shaped Medical Image Networks
Not on the map. Why?
Abstract (arXiv)
U-shaped networks are widely used in various medical image tasks, such as segmentation, restoration and reconstruction, but most of them usually rely on centralized learning and thus ignore privacy issues. To address the privacy concerns, federated learning (FL) and split learning (SL) have attracted increasing attention. However, it is hard for both FL and SL to balance the local computational cost, model privacy and parallel training simultaneously. To achieve this goal, in this paper, we propose Robust Split Federated Learning (RoS-FL) for U-shaped medical image networks, which is a novel hybrid learning paradigm of FL and SL. Previous works cannot preserve the data privacy, including the input, model parameters, label and output simultaneously. To effectively deal with all of them, we design a novel splitting method for U-shaped medical image networks, which splits the network into three parts hosted by different parties. Besides, the distributed learning methods usually suffer from a drift between local and global models caused by data heterogeneity. Based on this consideration, we propose a dynamic weight correction strategy (DWCS) to stabilize the training process and avoid model drift. Specifically, a weight correction loss is designed to quantify the drift between the models from two adjacent communication rounds. By minimizing this loss, a correction model is obtained. Then we treat the weighted sum of correction model and final round models as the result. The effectiveness of the proposed RoS-FL is supported by extensive experimental results on different tasks. Related codes will be released at https://github.com/Zi-YuanYang/RoS-FL.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 28 of its 56 references that are in the map. First posted on arXiv 13 Dec 2022.
Builds on
28 of 56 references.
References · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021Model-Contrastive Federated Learningcited by 762
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 583
- 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
- 2020SplitFed: When Federated Learning Meets Split Learningcited by 308
- 2021FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Spacecited by 284
16 more
- 2018Distributed learning of deep neural network over multiple agentscited by 277
- 2017Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN)cited by 224
- 2020U-Net and its variants for medical image segmentation: theory and applicationscited by 169
- 2021CrypTen: Secure Multi-Party Computation Meets Machine Learningcited by 131
- 2021Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learningcited by 111
- 2017Framing U-Net via Deep Convolutional Framelets: Application to Sparse-view CTcited by 87
- 2019Detailed comparison of communication efficiency of split learning and federated learningcited by 76
- 2019Split Learning for collaborative deep learning in healthcarecited by 72
- 2021DU-GAN: Generative Adversarial Networks with Dual-Domain U-Net Based Discriminators for Low-Dose CT Denoisingcited by 46
- 2022Federated Domain Generalization for Image Recognition via Cross-Client Style Transfercited by 40
- 2020Advancements of federated learning towards privacy preservation: from federated learning to split learningcited by 34
- 2021SplitAVG: A heterogeneity-aware federated deep learning method for medical imagingcited by 19
- 2022Dynamic Bank Learning for Semi-supervised Federated Image Diagnosis with Class Imbalancecited by 13
- 2021Towards Representation Identical Privacy-Preserving Graph Neural Network via Split Learningcited by 10
- 2022Hercules: Boosting the Performance of Privacy-preserving Federated Learningcited by 4
- 2022Split-U-Net: Preventing Data Leakage in Split Learning for Collaborative Multi-Modal Brain Tumor Segmentationcited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 5; 2026: 1.
11 papers.
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Surveycited by 125
- 2023Optimal Resource Allocation for U-Shaped Parallel Split Learningcited by 33
- 2025SafeSplit: A Novel Defense Against Client-Side Backdoor Attacks in Split Learning (Full Version)cited by 7
- 2024The Impact of Cut Layer Selection in Split Federated Learningcited by 6
- 2024HierSFL: Local Differential Privacy-aided Split Federated Learning in Mobile Edge Computingcited by 3
- 2024SCALA: Split Federated Learning with Concatenated Activations and Logit Adjustmentscited by 2
- 2025A Novel Approach to Breast Cancer Segmentation using U-Net Model with Attention Mechanisms and FedProxcited by 1
- 2025FedOptima: Optimizing Resource Utilization in Federated Learningcited by 0
- 2025NWaaS: A Non-Intrusive and Privacy-Preserving Watermarking-as-a-Service System with Adaptive Resource Schedulingcited by 0
- 2025ZORRO: Zero-Knowledge Robustness and Privacy for Split Learning (Full Version)cited by 0
- 2026USPLIT-VQA: U-Shaped Split Learning for Visual Question Answering with Contribution-Aware Weighted Aggregationcited by 0
- 2026USPLIT-VQA: U-Shaped Split Learning for Visual Question Answering with Contribution-Aware Weighted Aggregation10 Sep 2026
- 2025A Novel Approach to Breast Cancer Segmentation using U-Net Model with Attention Mechanisms and FedProx21 Oct 2025
- 2025ZORRO: Zero-Knowledge Robustness and Privacy for Split Learning (Full Version)11 Sep 2025
- 2025NWaaS: A Non-Intrusive and Privacy-Preserving Watermarking-as-a-Service System with Adaptive Resource Scheduling24 Jul 2025
- 2025FedOptima: Optimizing Resource Utilization in Federated Learning10 Mar 2025
- 2025SafeSplit: A Novel Defense Against Client-Side Backdoor Attacks in Split Learning (Full Version)11 Jan 2025
- 2024The Impact of Cut Layer Selection in Split Federated Learning20 Dec 2024
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Survey9 Jul 2024
- 2024SCALA: Split Federated Learning with Concatenated Activations and Logit Adjustments8 May 2024
- 2024HierSFL: Local Differential Privacy-aided Split Federated Learning in Mobile Edge Computing16 Jan 2024
- 2023Optimal Resource Allocation for U-Shaped Parallel Split Learning17 Aug 2023