Practical Defences Against Model Inversion Attacks for Split Neural Networks
Not on the map. Why?
Abstract (arXiv)
We describe a threat model under which a split network-based federated learning system is susceptible to a model inversion attack by a malicious computational server. We demonstrate that the attack can be successfully performed with limited knowledge of the data distribution by the attacker. We propose a simple additive noise method to defend against model inversion, finding that the method can significantly reduce attack efficacy at an acceptable accuracy trade-off on MNIST. Furthermore, we show that NoPeekNN, an existing defensive method, protects different information from exposure, suggesting that a combined defence is necessary to fully protect private user data.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 24 of its 36 references that are in the map. First posted on arXiv 12 Apr 2021.
Builds on
24 of 36 references.
References · 24
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2016Deep Learning with Differential Privacycited by 2,682
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
- 2019Towards Federated Learning at Scale: System Designcited by 826
- 2018How To Backdoor Federated Learningcited by 745
- 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 462
- 2018Split learning for health: Distributed deep learning without sharing raw patient datacited by 391
- 2016Semi-supervised Knowledge Transfer for Deep Learning from Private Training Datacited by 347
- 2020FedML: A Research Library and Benchmark for Federated Machine Learningcited by 298
12 more
- 2018Scalable Private Learning with PATEcited by 266
- 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 241
- 2018Stealing Hyperparameters in Machine Learningcited by 115
- 2018A generic framework for privacy preserving deep learningcited by 103
- 2020Can We Use Split Learning on 1D CNN Models for Privacy Preserving Training?cited by 50
- 2020SplitNN-driven Vertical Partitioningcited by 42
- 2021PyVertical: A Vertical Federated Learning Framework for Multi-headed SplitNNcited by 35
- 2018No Peek: A Survey of private distributed deep learningcited by 30
- 2021Privacy and Trust Redefined in Federated Machine Learningcited by 13
- 2020Asymmetric Private Set Intersection with Applications to Contact Tracing and Private Vertical Federated Machine Learningcited by 12
- 2020Evaluation of Inference Attack Models for Deep Learning on Medical Datacited by 9
- 2020A Distributed Trust Framework for Privacy-Preserving Machine Learningcited by 7
Built on by
Citing papers per year: 2021: 3; 2022: 5; 2023: 5; 2024: 6; 2025: 7; 2026: 3.
29 papers.
Sort:
By area:
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2022ResSFL: A Resistance Transfer Framework for Defending Model Inversion Attack in Split Federated Learningcited by 36
- 2024Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defensescited by 30
- 2021ExPLoit: Extracting Private Labels in Split Learningcited by 15
- 2022Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directionscited by 14
- 2023Bounding the Invertibility of Privacy-preserving Instance Encoding using Fisher Informationcited by 11
- 2021Privacy Vulnerability of Split Computing to Data-Free Model Inversion Attackscited by 8
- 2024Improving Robustness to Model Inversion Attacks via Sparse Coding Architecturescited by 8
- 2022Get your Foes Fooled: Proximal Gradient Split Learning for Defense against Model Inversion Attacks on IoMT datacited by 7
- 2023Split Without a Leak: Reducing Privacy Leakage in Split Learningcited by 6
- 2025Theoretical Insights in Model Inversion Robustness and Conditional Entropy Maximization for Collaborative Inference Systemscited by 6
- 2024A Hybrid Quantum Neural Network for Split Learningcited by 5
17 more
- 2024MIBench: A Comprehensive Framework for Benchmarking Model Inversion Attack and Defensecited by 5
- 2023Analyzing the vulnerabilities in SplitFed Learning: Assessing the robustness against Data Poisoning Attackscited by 4
- 2024SFPrompt: Communication-Efficient Split Federated Fine-Tuning for Large Pre-Trained Models over Resource-Limited Devicescited by 4
- 2022Measuring and Controlling Split Layer Privacy Leakage Using Fisher Informationcited by 3
- 2025DRAG: Data Reconstruction Attack using Guided Diffusioncited by 3
- 2023Approximating ReLU on a Reduced Ring for Efficient MPC-based Private Inferencecited by 2
- 2025P3SL: Personalized Privacy-Preserving Split Learning on Heterogeneous Edge Devicescited by 2
- 2025What Your Features Reveal: Data-Efficient Black-Box Feature Inversion Attack for Split DNNscited by 2
- 2025A Taxonomy of Attacks and Defenses in Split Learningcited by 1
- 2025Oops!... They Stole it Again: Attacks on Split Learningcited by 1
- 2026Privacy-Preserving Split Learning for Federated LLM Fine-Tuningcited by 1
- 2022Split Federated Learning on Micro-controllers: A Keyword Spotting Showcasecited by 0
- 2023GAN-based Vertical Federated Learning for Label Protection in Binary Classificationcited by 0
- 2024Enhancing Privacy in ControlNet and Stable Diffusion via Split Learningcited by 0
- 2025Revisiting the Privacy Risks of Split Inference: A GAN-Based Data Reconstruction Attack via Progressive Feature Optimizationcited by 0
- 2026A Privacy Study of Sparse Collaborative Inferencecited by 0
- 2026Spectrum-Aware Bounds on Invertibility for Privacy-Enhancing Instance Encodingcited by 0
- 2026Privacy-Preserving Split Learning for Federated LLM Fine-Tuning9 Sep 2026
- 2026Spectrum-Aware Bounds on Invertibility for Privacy-Enhancing Instance Encoding24 Aug 2026
- 2026A Privacy Study of Sparse Collaborative Inference17 Aug 2026
- 2025What Your Features Reveal: Data-Efficient Black-Box Feature Inversion Attack for Split DNNs19 Nov 2025
- 2025DRAG: Data Reconstruction Attack using Guided Diffusion15 Sep 2025
- 2025Revisiting the Privacy Risks of Split Inference: A GAN-Based Data Reconstruction Attack via Progressive Feature Optimization28 Aug 2025
- 2025Oops!... They Stole it Again: Attacks on Split Learning14 Aug 2025
- 2025P3SL: Personalized Privacy-Preserving Split Learning on Heterogeneous Edge Devices23 Jul 2025
- 2025A Taxonomy of Attacks and Defenses in Split Learning9 May 2025
- 2025Theoretical Insights in Model Inversion Robustness and Conditional Entropy Maximization for Collaborative Inference Systems1 Mar 2025
- 2024MIBench: A Comprehensive Framework for Benchmarking Model Inversion Attack and Defense7 Oct 2024
- 2024A Hybrid Quantum Neural Network for Split Learning25 Sep 2024
17 more
- 2024Enhancing Privacy in ControlNet and Stable Diffusion via Split Learning13 Sep 2024
- 2024SFPrompt: Communication-Efficient Split Federated Fine-Tuning for Large Pre-Trained Models over Resource-Limited Devices24 Jul 2024
- 2024Improving Robustness to Model Inversion Attacks via Sparse Coding Architectures21 Mar 2024
- 2024Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defenses6 Feb 2024
- 2023Approximating ReLU on a Reduced Ring for Efficient MPC-based Private Inference9 Sep 2023
- 2023Split Without a Leak: Reducing Privacy Leakage in Split Learning30 Aug 2023
- 2023Analyzing the vulnerabilities in SplitFed Learning: Assessing the robustness against Data Poisoning Attacks4 Jul 2023
- 2023Bounding the Invertibility of Privacy-preserving Instance Encoding using Fisher Information6 May 2023
- 2023GAN-based Vertical Federated Learning for Label Protection in Binary Classification4 Feb 2023
- 2022Split Federated Learning on Micro-controllers: A Keyword Spotting Showcase4 Oct 2022
- 2022Measuring and Controlling Split Layer Privacy Leakage Using Fisher Information21 Sep 2022
- 2022Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directions20 Jul 2022
- 2022ResSFL: A Resistance Transfer Framework for Defending Model Inversion Attack in Split Federated Learning9 May 2022
- 2022Get your Foes Fooled: Proximal Gradient Split Learning for Defense against Model Inversion Attacks on IoMT data12 Jan 2022
- 2021ExPLoit: Extracting Private Labels in Split Learning25 Nov 2021
- 2021Privacy Vulnerability of Split Computing to Data-Free Model Inversion Attacks13 Jul 2021
- 2021Survey: Leakage and Privacy at Inference Time4 Jul 2021
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2022ResSFL: A Resistance Transfer Framework for Defending Model Inversion Attack in Split Federated Learningcited by 36
- 2024Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defensescited by 30
- 2021ExPLoit: Extracting Private Labels in Split Learningcited by 15
- 2022Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directionscited by 14
- 2023Bounding the Invertibility of Privacy-preserving Instance Encoding using Fisher Informationcited by 11
- 2021Privacy Vulnerability of Split Computing to Data-Free Model Inversion Attackscited by 8
- 2024Improving Robustness to Model Inversion Attacks via Sparse Coding Architecturescited by 8
- 2022Get your Foes Fooled: Proximal Gradient Split Learning for Defense against Model Inversion Attacks on IoMT datacited by 7
- 2023Split Without a Leak: Reducing Privacy Leakage in Split Learningcited by 6
- 2025Theoretical Insights in Model Inversion Robustness and Conditional Entropy Maximization for Collaborative Inference Systemscited by 6
- 2024A Hybrid Quantum Neural Network for Split Learningcited by 5
12 most cited of 26 All 26 (JSON)
- 2026Privacy-Preserving Split Learning for Federated LLM Fine-Tuning9 Sep 2026
- 2026Spectrum-Aware Bounds on Invertibility for Privacy-Enhancing Instance Encoding24 Aug 2026
- 2026A Privacy Study of Sparse Collaborative Inference17 Aug 2026
- 2025What Your Features Reveal: Data-Efficient Black-Box Feature Inversion Attack for Split DNNs19 Nov 2025
- 2025Revisiting the Privacy Risks of Split Inference: A GAN-Based Data Reconstruction Attack via Progressive Feature Optimization28 Aug 2025
- 2025Oops!... They Stole it Again: Attacks on Split Learning14 Aug 2025
- 2025P3SL: Personalized Privacy-Preserving Split Learning on Heterogeneous Edge Devices23 Jul 2025
- 2025A Taxonomy of Attacks and Defenses in Split Learning9 May 2025
- 2025Theoretical Insights in Model Inversion Robustness and Conditional Entropy Maximization for Collaborative Inference Systems1 Mar 2025
- 2024MIBench: A Comprehensive Framework for Benchmarking Model Inversion Attack and Defense7 Oct 2024
- 2024A Hybrid Quantum Neural Network for Split Learning25 Sep 2024
- 2024SFPrompt: Communication-Efficient Split Federated Fine-Tuning for Large Pre-Trained Models over Resource-Limited Devices24 Jul 2024
12 newest of 26 All 26 (JSON)