mlsanityData to 7 Oct 2026

Robust Split Federated Learning for U-shaped Medical Image Networks

arXiv 2212.06378 ↗First posted 13 Dec 2022eess.IV cs.CV cs.DCcited by 11

Not on the map. Why?

Abstract (arXiv)

U-shaped networks are widely used in various medical image tasks, such as segmentation, restoration and reconstruction, but most of them usually rely on centralized learning and thus ignore privacy issues. To address the privacy concerns, federated learning (FL) and split learning (SL) have attracted increasing attention. However, it is hard for both FL and SL to balance the local computational cost, model privacy and parallel training simultaneously. To achieve this goal, in this paper, we propose Robust Split Federated Learning (RoS-FL) for U-shaped medical image networks, which is a novel hybrid learning paradigm of FL and SL. Previous works cannot preserve the data privacy, including the input, model parameters, label and output simultaneously. To effectively deal with all of them, we design a novel splitting method for U-shaped medical image networks, which splits the network into three parts hosted by different parties. Besides, the distributed learning methods usually suffer from a drift between local and global models caused by data heterogeneity. Based on this consideration, we propose a dynamic weight correction strategy (DWCS) to stabilize the training process and avoid model drift. Specifically, a weight correction loss is designed to quantify the drift between the models from two adjacent communication rounds. By minimizing this loss, a correction model is obtained. Then we treat the weighted sum of correction model and final round models as the result. The effectiveness of the proposed RoS-FL is supported by extensive experimental results on different tasks. Related codes will be released at https://github.com/Zi-YuanYang/RoS-FL.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 28 of its 56 references that are in the map. First posted on arXiv 13 Dec 2022.

Builds on

28 of 56 references.

References · 28

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  4. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  5. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
  6. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
  7. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  8. 2021Model-Contrastive Federated Learningcited by 762
  9. 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 583
  10. 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
  11. 2020SplitFed: When Federated Learning Meets Split Learningcited by 308
  12. 2021FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Spacecited by 284
16 more
  1. 2018Distributed learning of deep neural network over multiple agentscited by 277
  2. 2017Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN)cited by 224
  3. 2020U-Net and its variants for medical image segmentation: theory and applicationscited by 169
  4. 2021CrypTen: Secure Multi-Party Computation Meets Machine Learningcited by 131
  5. 2021Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learningcited by 111
  6. 2017Framing U-Net via Deep Convolutional Framelets: Application to Sparse-view CTcited by 87
  7. 2019Detailed comparison of communication efficiency of split learning and federated learningcited by 76
  8. 2019Split Learning for collaborative deep learning in healthcarecited by 72
  9. 2021DU-GAN: Generative Adversarial Networks with Dual-Domain U-Net Based Discriminators for Low-Dose CT Denoisingcited by 46
  10. 2022Federated Domain Generalization for Image Recognition via Cross-Client Style Transfercited by 40
  11. 2020Advancements of federated learning towards privacy preservation: from federated learning to split learningcited by 34
  12. 2021SplitAVG: A heterogeneity-aware federated deep learning method for medical imagingcited by 19
  13. 2022Dynamic Bank Learning for Semi-supervised Federated Image Diagnosis with Class Imbalancecited by 13
  14. 2021Towards Representation Identical Privacy-Preserving Graph Neural Network via Split Learningcited by 10
  15. 2022Hercules: Boosting the Performance of Privacy-preserving Federated Learningcited by 4
  16. 2022Split-U-Net: Preventing Data Leakage in Split Learning for Collaborative Multi-Modal Brain Tumor Segmentationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 4; 2025: 5; 2026: 1.

11 papers.