Differentially Private Label Protection in Split Learning
Not on the map. Why?
Abstract (arXiv)
Split learning is a distributed training framework that allows multiple parties to jointly train a machine learning model over vertically partitioned data (partitioned by attributes). The idea is that only intermediate computation results, rather than private features and labels, are shared between parties so that raw training data remains private. Nevertheless, recent works showed that the plaintext implementation of split learning suffers from severe privacy risks that a semi-honest adversary can easily reconstruct labels. In this work, we propose textsfTPSL (Transcript Private Split Learning), a generic gradient perturbation based split learning framework that provides provable differential privacy guarantee. Differential privacy is enforced on not only the model weights, but also the communicated messages in the distributed computation setting. Our experiments on large-scale real-world datasets demonstrate the robustness and effectiveness of textsfTPSL against label leakage attacks. We also find that textsfTPSL have a better utility-privacy trade-off than baselines.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 26 of its 42 references that are in the map. First posted on arXiv 4 Mar 2022.
Builds on
26 of 42 references.
References · 26
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2016Deep Learning with Differential Privacycited by 2,682
- 2016Wide & Deep Learning for Recommender Systemscited by 745
- 2020An Efficient Framework for Clustered Federated Learningcited by 505
- 2018Spectral Signatures in Backdoor Attackscited by 457
- 2019Federated Machine Learning: Concept and Applicationscited by 409
- 2018Split learning for health: Distributed deep learning without sharing raw patient datacited by 391
- 2016Semi-supervised Knowledge Transfer for Deep Learning from Private Training Datacited by 347
- 2018Distributed learning of deep neural network over multiple agentscited by 277
- 2018Scalable Private Learning with PATEcited by 266
- 2020Differentially Private Learning Needs Better Features (or Much More Data)cited by 233
- 2017Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryptioncited by 174
14 more
- 2017Collecting Telemetry Data Privatelycited by 147
- 2020Lower Bounds and Optimal Algorithms for Personalized Federated Learningcited by 122
- 2021Deep Learning with Label Differential Privacycited by 113
- 2014Preserving Statistical Validity in Adaptive Data Analysiscited by 102
- 2020VAFL: a Method of Vertical Asynchronous Federated Learningcited by 87
- 2021Label Leakage and Protection in Two-party Split Learningcited by 87
- 2020Federated Accelerated Stochastic Gradient Descentcited by 85
- 2021UnSplit: Data-Oblivious Model Inversion, Model Stealing, and Label Inference Attacks Against Split Learningcited by 52
- 2020Can We Use Split Learning on 1D CNN Models for Privacy Preserving Training?cited by 50
- 2021Antipodes of Label Differential Privacy: PATE and ALIBIcited by 50
- 2020SplitNN-driven Vertical Partitioningcited by 42
- 2019A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regressioncited by 37
- 2020Hybrid Differentially Private Federated Learning on Vertically Partitioned Datacited by 22
- 2021Vertical Federated Learning without Revealing Intersection Membershipcited by 19
Built on by
Citing papers per year: 2022: 4; 2023: 9; 2024: 8; 2025: 3; 2026: 1.
25 papers.
Sort:
By area:
- 2023Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networkscited by 95
- 2023A Survey on Vertical Federated Learning: From a Layered Perspectivecited by 30
- 2023Split-and-Denoise: Protect large language model inference with local differential privacycited by 30
- 2022Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directionscited by 14
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Surveycited by 14
- 2022Differentially Private CutMix for Split Learning with Vision Transformercited by 13
- 2022Vertical Semi-Federated Learning for Efficient Online Advertisingcited by 12
- 2024SplitLLM: Collaborative Inference of LLMs for Model Placement and Throughput Optimizationcited by 10
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learningcited by 8
- 2023Adaptive Compression-Aware Split Learning and Inference for Enhanced Network Efficiencycited by 8
- 2023Label Inference Attack against Split Learning under Regression Settingcited by 7
- 2024A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspectivecited by 7
13 more
- 2025SafeSplit: A Novel Defense Against Client-Side Backdoor Attacks in Split Learning (Full Version)cited by 7
- 2022VFed-SSD: Towards Practical Vertical Federated Advertisingcited by 5
- 2023SplitOut: Out-of-the-Box Training-Hijacking Detection in Split Learning via Outlier Detectioncited by 4
- 2023PFSL: Personalized & Fair Split Learning with Data & Label Privacy for thin clientscited by 3
- 2024Privacy-Preserving Split Learning with Vision Transformers using Patch-Wise Random and Noisy CutMixcited by 2
- 2024LabObf: A Label Protection Scheme for Vertical Federated Learning Through Label Obfuscationcited by 1
- 2024S2NeRF: Privacy-preserving Training Framework for NeRFcited by 1
- 2025Oops!... They Stole it Again: Attacks on Split Learningcited by 1
- 2026The Art of Mixology: Mixup-based Obfuscation for Privacy-Preserving Split Learning in Large Language Modelscited by 1
- 2023GAN-based Vertical Federated Learning for Label Protection in Binary Classificationcited by 0
- 2024FedAdOb: Privacy-Preserving Federated Deep Learning with Adaptive Obfuscationcited by 0
- 2024On Differentially Private String Distancescited by 0
- 2025Towards Privacy-Preserving and Heterogeneity-aware Split Federated Learning via Probabilistic Maskingcited by 0
- 2026The Art of Mixology: Mixup-based Obfuscation for Privacy-Preserving Split Learning in Large Language Models15 Jun 2026
- 2025Towards Privacy-Preserving and Heterogeneity-aware Split Federated Learning via Probabilistic Masking18 Sep 2025
- 2025Oops!... They Stole it Again: Attacks on Split Learning14 Aug 2025
- 2025SafeSplit: A Novel Defense Against Client-Side Backdoor Attacks in Split Learning (Full Version)11 Jan 2025
- 2024On Differentially Private String Distances8 Nov 2024
- 2024SplitLLM: Collaborative Inference of LLMs for Model Placement and Throughput Optimization14 Oct 2024
- 2024S2NeRF: Privacy-preserving Training Framework for NeRF3 Sep 2024
- 2024Privacy-Preserving Split Learning with Vision Transformers using Patch-Wise Random and Noisy CutMix2 Aug 2024
- 2024FedAdOb: Privacy-Preserving Federated Deep Learning with Adaptive Obfuscation3 Jun 2024
- 2024LabObf: A Label Protection Scheme for Vertical Federated Learning Through Label Obfuscation27 May 2024
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey25 May 2024
- 2024A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspective6 Feb 2024
13 more
- 2023Adaptive Compression-Aware Split Learning and Inference for Enhanced Network Efficiency9 Nov 2023
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learning15 Oct 2023
- 2023Split-and-Denoise: Protect large language model inference with local differential privacy13 Oct 2023
- 2023A Survey on Vertical Federated Learning: From a Layered Perspective4 Apr 2023
- 2023Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networks26 Mar 2023
- 2023PFSL: Personalized & Fair Split Learning with Data & Label Privacy for thin clients19 Mar 2023
- 2023SplitOut: Out-of-the-Box Training-Hijacking Detection in Split Learning via Outlier Detection16 Feb 2023
- 2023GAN-based Vertical Federated Learning for Label Protection in Binary Classification4 Feb 2023
- 2023Label Inference Attack against Split Learning under Regression Setting18 Jan 2023
- 2022Differentially Private CutMix for Split Learning with Vision Transformer28 Oct 2022
- 2022Vertical Semi-Federated Learning for Efficient Online Advertising30 Sep 2022
- 2022Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directions20 Jul 2022
- 2022VFed-SSD: Towards Practical Vertical Federated Advertising31 May 2022
- 2023Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networkscited by 95
- 2023A Survey on Vertical Federated Learning: From a Layered Perspectivecited by 30
- 2023Split-and-Denoise: Protect large language model inference with local differential privacycited by 30
- 2022Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directionscited by 14
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Surveycited by 14
- 2022Differentially Private CutMix for Split Learning with Vision Transformercited by 13
- 2022Vertical Semi-Federated Learning for Efficient Online Advertisingcited by 12
- 2024SplitLLM: Collaborative Inference of LLMs for Model Placement and Throughput Optimizationcited by 10
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learningcited by 8
- 2023Adaptive Compression-Aware Split Learning and Inference for Enhanced Network Efficiencycited by 8
- 2023Label Inference Attack against Split Learning under Regression Settingcited by 7
- 2024A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspectivecited by 7
12 most cited of 24 All 24 (JSON)
- 2026The Art of Mixology: Mixup-based Obfuscation for Privacy-Preserving Split Learning in Large Language Models15 Jun 2026
- 2025Towards Privacy-Preserving and Heterogeneity-aware Split Federated Learning via Probabilistic Masking18 Sep 2025
- 2025Oops!... They Stole it Again: Attacks on Split Learning14 Aug 2025
- 2025SafeSplit: A Novel Defense Against Client-Side Backdoor Attacks in Split Learning (Full Version)11 Jan 2025
- 2024On Differentially Private String Distances8 Nov 2024
- 2024SplitLLM: Collaborative Inference of LLMs for Model Placement and Throughput Optimization14 Oct 2024
- 2024S2NeRF: Privacy-preserving Training Framework for NeRF3 Sep 2024
- 2024FedAdOb: Privacy-Preserving Federated Deep Learning with Adaptive Obfuscation3 Jun 2024
- 2024LabObf: A Label Protection Scheme for Vertical Federated Learning Through Label Obfuscation27 May 2024
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey25 May 2024
- 2024A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspective6 Feb 2024
- 2023Adaptive Compression-Aware Split Learning and Inference for Enhanced Network Efficiency9 Nov 2023
12 newest of 24 All 24 (JSON)