A Survey of Privacy Attacks in Machine Learning
Not on the map. Why?
Cited by 27 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
As machine learning becomes more widely used, the need to study its implications in security and privacy becomes more urgent. Although the body of work in privacy has been steadily growing over the past few years, research on the privacy aspects of machine learning has received less focus than the security aspects. Our contribution in this research is an analysis of more than 40 papers related to privacy attacks against machine learning that have been published during the past seven years. We propose an attack taxonomy, together with a threat model that allows the categorization of different attacks based on the adversarial knowledge, and the assets under attack. An initial exploration of the causes of privacy leaks is presented, as well as a detailed analysis of the different attacks. Finally, we present an overview of the most commonly proposed defenses and a discussion of the open problems and future directions identified during our analysis.
Key facts. Cited by 143 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 23; 2023: 25; 2024: 34; 2025: 32; 2026: 20.
143 papers.
Sort:
By area:
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2023Large Language Model Alignment: A Surveycited by 241
- 2021FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learningcited by 140
- 2023ProPILE: Probing Privacy Leakage in Large Language Modelscited by 127
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2023Membership Inference Attacks against Synthetic Data through Overfitting Detectioncited by 66
- 2023Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competitioncited by 65
- 2022Label-Only Model Inversion Attacks via Boundary Repulsioncited by 56
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 47
- 2023Tricking LLMs into Disobedience: Formalizing, Analyzing, and Detecting Jailbreakscited by 45
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
38 more
- 2024Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs)cited by 44
- 2022Gradient Obfuscation Gives a False Sense of Security in Federated Learningcited by 37
- 2023Reinforcement Learning-Based Black-Box Model Inversion Attackscited by 33
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2022On the Privacy Risks of Algorithmic Recoursecited by 32
- 2021FedHM: Efficient Federated Learning for Heterogeneous Models via Low-rank Factorizationcited by 31
- 2022Bilateral Dependency Optimization: Defending Against Model-inversion Attackscited by 30
- 2023Identifying and Mitigating Privacy Risks Stemming from Language Models: A Surveycited by 30
- 2023Beyond Privacy: Navigating the Opportunities and Challenges of Synthetic Datacited by 29
- 2022Model Inversion Attacks against Graph Neural Networkscited by 26
- 2022Sketching for First Order Method: Efficient Algorithm for Low-Bandwidth Channel and Vulnerabilitycited by 25
- 2023A Survey on Privacy in Graph Neural Networks: Attacks, Preservation, and Applicationscited by 22
- 2022The privacy issue of counterfactual explanations: explanation linkage attackscited by 20
- 2023Gaussian Membership Inference Privacycited by 20
- 2021Property Inference Attacks on Convolutional Neural Networks: Influence and Implications of Target Model's Complexitycited by 19
- 2024Is Retain Set All You Need in Machine Unlearning? Restoring Performance of Unlearned Models with Out-Of-Distribution Imagescited by 18
- 2024Poison-splat: Computation Cost Attack on 3D Gaussian Splattingcited by 17
- 2025Rethinking Data Protection in the (Generative) Artificial Intelligence Eracited by 17
- 2023Understanding Reconstruction Attacks with the Neural Tangent Kernel and Dataset Distillationcited by 14
- 2022Differentially Private Counterfactuals via Functional Mechanismcited by 13
- 2022Machine Learning with Confidential Computing: A Systematization of Knowledgecited by 13
- 2022Towards Lightweight Black-Box Attacks against Deep Neural Networkscited by 13
- 2024The Federation Strikes Back: A Survey of Federated Learning Privacy Attacks, Defenses, Applications, and Policy Landscapecited by 13
- 2023Recent Advances of Differential Privacy in Centralized Deep Learning: A Systematic Surveycited by 12
- 2024Trained Random Forests Completely Reveal your Datasetcited by 11
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasurescited by 11
- 2025Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemblecited by 11
- 2022Exploiting Fairness to Enhance Sensitive Attributes Reconstructioncited by 10
- 2025Robustness and Cybersecurity in the EU Artificial Intelligence Actcited by 10
- 2021Towards Efficient Synchronous Federated Training: A Survey on System Optimization Strategiescited by 9
- 2024Noise-Aware Algorithm for Heterogeneous Differentially Private Federated Learningcited by 9
- 2024Imperio: Language-Guided Backdoor Attacks for Arbitrary Model Controlcited by 8
- 2024Improving Robustness to Model Inversion Attacks via Sparse Coding Architecturescited by 8
- 2024TUNI: A Textual Unimodal Detector for Identity Inference in CLIP Modelscited by 8
- 2023Probabilistic Dataset Reconstruction from Interpretable Modelscited by 7
- 2024Cross-silo Federated Learning with Record-level Personalized Differential Privacycited by 7
- 2024The Data Minimization Principle in Machine Learningcited by 7
- 2025RealHarm: A Collection of Real-World Language Model Application Failurescited by 7
50 most cited of 143 All 143 (JSON)
- 2026Blockchain-Enabled Artificial Intelligence and AI Agents for Secure Data Sharing and Cybersecurity Applications23 Sep 2026
- 2026SoK: Privacy Attacks on Machine Learning via Explainable AI9 Sep 2026
- 2026Lensless Gaze Is Not Private by Default: Auditing Identity Leakage Across Disclosure Surfaces31 Aug 2026
- 2026TOUR: A Trajectory-Level Unlearning Benchmark for Offline Reinforcement Learning23 Jul 2026
- 2026End-to-End Differential Privacy in Training Deep Neural Network Classifiers21 Jul 2026
- 2026Attribute Inference from Interactive Targeted Ads13 Jun 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2026idSCD: Identifying Training Datasets through Semantic Correlation Descriptors28 May 2026
- 2026Choose Wisely and Privately: Proactive Client Selection for Fair and Efficient Federated Learning20 May 2026
- 2026Privacy Evaluation of Generative Models for Trajectory Generation14 May 2026
- 2026Ruyi2.5 Technical Report18 Mar 2026
- 2026Informationally Compressive Anonymization: Non-Degrading Sensitive Input Protection for Privacy-Preserving Supervised Machine Learning16 Mar 2026
38 more
- 2026Privacy-Preserving Machine Learning for IoT: A Cross-Paradigm Survey and Future Roadmap13 Mar 2026
- 2026Revisiting the LiRA Membership Inference Attack Under Realistic Assumptions8 Mar 2026
- 2026Linear Model Extraction via Factual and Counterfactual Queries10 Feb 2026
- 2026Robust Federated Learning via Byzantine Filtering over Encrypted Updates5 Feb 2026
- 2026To Defend Against Cyber Attacks, We Must Teach AI Agents to Hack1 Feb 2026
- 2026Rethinking Anonymity Claims in Synthetic Data Generation: A Model-Centric Privacy Attack Perspective30 Jan 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2026Inference Attacks Against Graph Generative Diffusion Models7 Jan 2026
- 2025Divided We Fall: Defending Against Adversarial Attacks via Soft-Gated Fractional Mixture-of-Experts with Randomized Adversarial Training23 Dec 2025
- 2025WARP: Weight Teleportation for Attack-Resilient Unlearning Protocols29 Nov 2025
- 2025AttackPilot: Autonomous Inference Attacks Against ML Services With LLM-Based Agents24 Nov 2025
- 2025Biologically-Informed Hybrid Membership Inference Attacks on Generative Genomic Models10 Nov 2025
- 2025An Investigation of Memorization Risk in Healthcare Foundation Models14 Oct 2025
- 2025"We are not Future-ready": Understanding AI Privacy Risks and Existing Mitigation Strategies from the Perspective of AI Developers in Europe1 Oct 2025
- 2025Can Federated Learning Safeguard Private Data in LLM Training? Vulnerabilities, Attacks, and Defense Evaluation25 Sep 2025
- 2025Generative Model Inversion Through the Lens of the Manifold Hypothesis24 Sep 2025
- 2025Towards Privacy-Aware Bayesian Networks: A Credal Approach23 Sep 2025
- 2025LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systems12 Sep 2025
- 2025On the Security and Privacy of Federated Learning: A Survey with Attacks, Defenses, Frameworks, Applications, and Future Directions19 Aug 2025
- 2025AI Security Map: Holistic Organization of AI Security Technologies and Impacts on Stakeholders12 Aug 2025
- 2025Evaluating the Dynamics of Membership Privacy in Deep Learning31 Jul 2025
- 2025Rethinking Data Protection in the (Generative) Artificial Intelligence Era3 Jul 2025
- 2025Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemble16 Jun 2025
- 2025Differential privacy for medical deep learning: methods, tradeoffs, and deployment implications31 May 2025
- 2025Buffer-free Class-Incremental Learning with Out-of-Distribution Detection29 May 2025
- 2025Privacy Risks and Preservation Methods in Explainable Artificial Intelligence: A Scoping Review5 May 2025
- 2025Rethinking Client-oriented Federated Graph Learning19 Apr 2025
- 2025RealHarm: A Collection of Real-World Language Model Application Failures14 Apr 2025
- 2025Benchmarking Federated Machine Unlearning methods for Tabular Data1 Apr 2025
- 2025THEMIS: Towards Practical Intellectual Property Protection for Post-Deployment On-Device Deep Learning Models31 Mar 2025
- 2025Energy-Latency Attacks: A New Adversarial Threat to Deep Learning6 Mar 2025
- 2025Robustness and Cybersecurity in the EU Artificial Intelligence Act22 Feb 2025
- 2025A Survey of Model Extraction Attacks and Defenses in Distributed Computing Environments22 Feb 2025
- 2025PPO-MI: Efficient Black-Box Model Inversion via Proximal Policy Optimization20 Feb 2025
- 2025On the Privacy Risks of Spiking Neural Networks: A Membership Inference Analysis18 Feb 2025
- 2025A hierarchical approach for assessing the vulnerability of tree-based classification models to membership inference attack13 Feb 2025
- 2025From Counterfactuals to Trees: Competitive Analysis of Model Extraction Attacks7 Feb 2025
- 2025Training Set Reconstruction from Differentially Private Forests: How Effective is DP?7 Feb 2025
50 newest of 143 All 143 (JSON)
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2023Membership Inference Attacks against Synthetic Data through Overfitting Detectioncited by 66
- 2023Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competitioncited by 65
- 2023Tricking LLMs into Disobedience: Formalizing, Analyzing, and Detecting Jailbreakscited by 45
- 2024Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs)cited by 44
- 2022On the Privacy Risks of Algorithmic Recoursecited by 32
- 2023Gaussian Membership Inference Privacycited by 20
- 2024Is Retain Set All You Need in Machine Unlearning? Restoring Performance of Unlearned Models with Out-Of-Distribution Imagescited by 18
- 2025Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemblecited by 11
- 2024Imperio: Language-Guided Backdoor Attacks for Arbitrary Model Controlcited by 8
- 2023Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systemscited by 6
- 2025Rethinking Membership Inference Attacks Against Transfer Learningcited by 5
12 most cited of 26 All 26 (JSON)
- 2026idSCD: Identifying Training Datasets through Semantic Correlation Descriptors28 May 2026
- 2026Revisiting the LiRA Membership Inference Attack Under Realistic Assumptions8 Mar 2026
- 2026To Defend Against Cyber Attacks, We Must Teach AI Agents to Hack1 Feb 2026
- 2025WARP: Weight Teleportation for Attack-Resilient Unlearning Protocols29 Nov 2025
- 2025Biologically-Informed Hybrid Membership Inference Attacks on Generative Genomic Models10 Nov 2025
- 2025Evaluating the Dynamics of Membership Privacy in Deep Learning31 Jul 2025
- 2025Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemble16 Jun 2025
- 2025Benchmarking Federated Machine Unlearning methods for Tabular Data1 Apr 2025
- 2025THEMIS: Towards Practical Intellectual Property Protection for Post-Deployment On-Device Deep Learning Models31 Mar 2025
- 2025On the Privacy Risks of Spiking Neural Networks: A Membership Inference Analysis18 Feb 2025
- 2025A hierarchical approach for assessing the vulnerability of tree-based classification models to membership inference attack13 Feb 2025
- 2025Rethinking Membership Inference Attacks Against Transfer Learning20 Jan 2025
12 newest of 26 All 26 (JSON)
- 2023Large Language Model Alignment: A Surveycited by 241
- 2023Large Language Model Alignment: A Survey26 Sep 2023
- 2021FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learningcited by 140
- 2023ProPILE: Probing Privacy Leakage in Large Language Modelscited by 127
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2022Label-Only Model Inversion Attacks via Boundary Repulsioncited by 56
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 47
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2022Gradient Obfuscation Gives a False Sense of Security in Federated Learningcited by 37
- 2023Reinforcement Learning-Based Black-Box Model Inversion Attackscited by 33
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2021FedHM: Efficient Federated Learning for Heterogeneous Models via Low-rank Factorizationcited by 31
- 2022Bilateral Dependency Optimization: Defending Against Model-inversion Attackscited by 30
12 most cited of 109 All 109 (JSON)
- 2026SoK: Privacy Attacks on Machine Learning via Explainable AI9 Sep 2026
- 2026Lensless Gaze Is Not Private by Default: Auditing Identity Leakage Across Disclosure Surfaces31 Aug 2026
- 2026End-to-End Differential Privacy in Training Deep Neural Network Classifiers21 Jul 2026
- 2026Attribute Inference from Interactive Targeted Ads13 Jun 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2026Choose Wisely and Privately: Proactive Client Selection for Fair and Efficient Federated Learning20 May 2026
- 2026Privacy Evaluation of Generative Models for Trajectory Generation14 May 2026
- 2026Ruyi2.5 Technical Report18 Mar 2026
- 2026Informationally Compressive Anonymization: Non-Degrading Sensitive Input Protection for Privacy-Preserving Supervised Machine Learning16 Mar 2026
- 2026Privacy-Preserving Machine Learning for IoT: A Cross-Paradigm Survey and Future Roadmap13 Mar 2026
- 2026Linear Model Extraction via Factual and Counterfactual Queries10 Feb 2026
- 2026Robust Federated Learning via Byzantine Filtering over Encrypted Updates5 Feb 2026
12 newest of 109 All 109 (JSON)