SNAP: Efficient Extraction of Private Properties with Poisoning
Not on the map. Why?
Abstract (arXiv)
Property inference attacks allow an adversary to extract global properties of the training dataset from a machine learning model. Such attacks have privacy implications for data owners sharing their datasets to train machine learning models. Several existing approaches for property inference attacks against deep neural networks have been proposed, but they all rely on the attacker training a large number of shadow models, which induces a large computational overhead. In this paper, we consider the setting of property inference attacks in which the attacker can poison a subset of the training dataset and query the trained target model. Motivated by our theoretical analysis of model confidences under poisoning, we design an efficient property inference attack, SNAP, which obtains higher attack success and requires lower amounts of poisoning than the state-of-the-art poisoning-based property inference attack by Mahloujifar et al. For example, on the Census dataset, SNAP achieves 34% higher success rate than Mahloujifar et al. while being 56.5x faster. We also extend our attack to infer whether a certain property was present at all during training and estimate the exact proportion of a property of interest efficiently. We evaluate our attack on several properties of varying proportions from four datasets and demonstrate SNAP's generality and effectiveness. An open-source implementation of SNAP can be found at https://github.com/johnmath/snap-sp23.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 35 of its 51 references that are in the map. First posted on arXiv 25 Aug 2022.
Builds on
35 of 51 references.
References · 35
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
- 2021Membership Inference Attacks From First Principlescited by 878
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 864
- 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 520
- 2019Does Learning Require Memorization? A Short Tale about a Long Tailcited by 460
- 2020Label-Only Membership Inference Attackscited by 388
- 2021Opacus: User-Friendly Differential Privacy Library in PyTorchcited by 383
23 more
- 2017Certified Defenses for Data Poisoning Attackscited by 303
- 2020Systematic Evaluation of Privacy Risks of Machine Learning Modelscited by 292
- 2019White-box vs Black-box: Bayes Optimal Strategies for Membership Inferencecited by 271
- 2021Enhanced Membership Inference Attacks against Machine Learning Modelscited by 248
- 2018Manipulating Machine Learning: Poisoning Attacks and Countermeasures for Regression Learningcited by 225
- 2020Auditing Differentially Private Machine Learning: How Private is Private SGD?cited by 218
- 2021Adversary Instantiation: Lower Bounds for Differentially Private Machine Learningcited by 199
- 2020Witches' Brew: Industrial Scale Data Poisoning via Gradient Matchingcited by 163
- 2022Reconstructing Training Data with Informed Adversariescited by 148
- 2013Hacking Smart Machines with Smarter Ones: How to Extract Meaningful Data from Machine Learning Classifierscited by 130
- 2021When the Curious Abandon Honesty: Federated Learning Is Not Privatecited by 127
- 2020Revisiting Membership Inference Under Realistic Assumptionscited by 112
- 2022Truth Serum: Poisoning Machine Learning Models to Reveal Their Secretscited by 101
- 2018Is feature selection secure against training data poisoning?cited by 93
- 2018Technical Report: When Does Machine Learning FAIL? Generalized Transferability for Evasion and Poisoning Attackscited by 81
- 2019Data Poisoning against Differentially-Private Learners: Attacks and Defensescited by 78
- 2020Subpopulation Data Poisoning Attackscited by 70
- 2021Property Inference From Poisoningcited by 60
- 2022Improved Certified Defenses against Data Poisoning with (Deterministic) Finite Aggregationcited by 52
- 2020Leakage of Dataset Properties in Multi-Party Machine Learningcited by 47
- 2021Gradient Disaggregation: Breaking Privacy in Federated Learning by Reconstructing the User Participant Matrixcited by 43
- 2021Formalizing and Estimating Distribution Inference Riskscited by 43
- 2021Property Inference Attacks Against GANscited by 33
Built on by
Citing papers per year: 2022: 2; 2023: 10; 2024: 8; 2025: 7; 2026: 4.
31 papers.
Sort:
By area:
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 51
- 2023SoK: Memorization in General-Purpose Large Language Modelscited by 37
- 2022Dissecting Distribution Inferencecited by 15
- 2023TMI! Finetuned Models Leak Private Information from their Pretraining Datacited by 14
- 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attackscited by 13
- 2024Range Membership Inference Attackscited by 12
- 2023Manipulating Transfer Learning for Property Inferencecited by 8
- 2023Quantifying Privacy Risks of Prompts in Visual Prompt Learningcited by 8
- 2024A Method to Facilitate Membership Inference Attacks in Deep Learning Modelscited by 7
- 2023Summary Statistic Privacy in Data Sharingcited by 6
- 2023SoK: Unintended Interactions among Machine Learning Defenses and Riskscited by 6
- 2023Attesting Distributional Properties of Training Data for Machine Learningcited by 5
19 more
- 2023Chameleon: Increasing Label-Only Membership Leakage with Adaptive Poisoningcited by 5
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmarkcited by 5
- 2025Exploiting Leaderboards for Large-Scale Distribution of Malicious Modelscited by 5
- 2023PriSampler: Mitigating Property Inference of Diffusion Modelscited by 4
- 2024Decaf: Data Distribution Decompose Attack against Federated Learningcited by 4
- 2024Analyzing Inference Privacy Risks Through Gradients in Machine Learningcited by 4
- 2025Toward Efficient Inference Attacks: Shadow Model Sharing via Mixture-of-Expertscited by 4
- 2024Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approachcited by 3
- 2025Disparate Privacy Vulnerability: Targeted Attribute Inference Attacks and Defensescited by 3
- 2025When Better Features Mean Greater Risks: The Performance-Privacy Trade-Off in Contrastive Learningcited by 3
- 2024Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearningcited by 2
- 2025Membership Inference Attack with Partial Featurescited by 1
- 2023Threats, Vulnerabilities, and Controls of Machine Learning Based Systems: A Survey and Taxonomycited by 0
- 2024Security and Privacy of 6G Federated Learning-enabled Dynamic Spectrum Sharingcited by 0
- 2025Black-Box Privacy Attacks on Shared Representations in Multitask Learningcited by 0
- 2026Boundary-targeted Membership Inference Attacks on Safety Classifierscited by 0
- 2026SoK: Colluding Adversaries in Machine Learning Pipelinescited by 0
- 2026Code-Poisoning Property Inference Attackscited by 0
- 2026QuanText: Protecting Dataset-Level Secrets in Textual Data Sharingcited by 0
- 2026QuanText: Protecting Dataset-Level Secrets in Textual Data Sharing16 Sep 2026
- 2026Code-Poisoning Property Inference Attacks17 Jul 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2026Boundary-targeted Membership Inference Attacks on Safety Classifiers21 May 2026
- 2025Toward Efficient Inference Attacks: Shadow Model Sharing via Mixture-of-Experts15 Oct 2025
- 2025Membership Inference Attack with Partial Features8 Aug 2025
- 2025Exploiting Leaderboards for Large-Scale Distribution of Malicious Models11 Jul 2025
- 2025Black-Box Privacy Attacks on Shared Representations in Multitask Learning19 Jun 2025
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmark9 Jun 2025
- 2025When Better Features Mean Greater Risks: The Performance-Privacy Trade-Off in Contrastive Learning6 Jun 2025
- 2025Disparate Privacy Vulnerability: Targeted Attribute Inference Attacks and Defenses5 Apr 2025
- 2024Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approach6 Nov 2024
19 more
- 2024Analyzing Inference Privacy Risks Through Gradients in Machine Learning29 Aug 2024
- 2024Range Membership Inference Attacks9 Aug 2024
- 2024A Method to Facilitate Membership Inference Attacks in Deep Learning Models2 Jul 2024
- 2024Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearning1 Jul 2024
- 2024Security and Privacy of 6G Federated Learning-enabled Dynamic Spectrum Sharing18 Jun 2024
- 2024Decaf: Data Distribution Decompose Attack against Federated Learning24 May 2024
- 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attacks4 Mar 2024
- 2023SoK: Unintended Interactions among Machine Learning Defenses and Risks7 Dec 2023
- 2023SoK: Memorization in General-Purpose Large Language Models24 Oct 2023
- 2023Quantifying Privacy Risks of Prompts in Visual Prompt Learning18 Oct 2023
- 2023Chameleon: Increasing Label-Only Membership Leakage with Adaptive Poisoning5 Oct 2023
- 2023Attesting Distributional Properties of Training Data for Machine Learning18 Aug 2023
- 2023PriSampler: Mitigating Property Inference of Diffusion Models8 Jun 2023
- 2023TMI! Finetuned Models Leak Private Information from their Pretraining Data1 Jun 2023
- 2023Manipulating Transfer Learning for Property Inference21 Mar 2023
- 2023Summary Statistic Privacy in Data Sharing3 Mar 2023
- 2023Threats, Vulnerabilities, and Controls of Machine Learning Based Systems: A Survey and Taxonomy18 Jan 2023
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learning21 Dec 2022
- 2022Dissecting Distribution Inference15 Dec 2022
- 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attackscited by 13
- 2024Range Membership Inference Attackscited by 12
- 2023Quantifying Privacy Risks of Prompts in Visual Prompt Learningcited by 8
- 2024A Method to Facilitate Membership Inference Attacks in Deep Learning Modelscited by 7
- 2023Chameleon: Increasing Label-Only Membership Leakage with Adaptive Poisoningcited by 5
- 2024Decaf: Data Distribution Decompose Attack against Federated Learningcited by 4
- 2025Toward Efficient Inference Attacks: Shadow Model Sharing via Mixture-of-Expertscited by 4
- 2025When Better Features Mean Greater Risks: The Performance-Privacy Trade-Off in Contrastive Learningcited by 3
- 2024Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearningcited by 2
- 2025Membership Inference Attack with Partial Featurescited by 1
- 2026Boundary-targeted Membership Inference Attacks on Safety Classifierscited by 0
- 2026Boundary-targeted Membership Inference Attacks on Safety Classifiers21 May 2026
- 2025Toward Efficient Inference Attacks: Shadow Model Sharing via Mixture-of-Experts15 Oct 2025
- 2025Membership Inference Attack with Partial Features8 Aug 2025
- 2025When Better Features Mean Greater Risks: The Performance-Privacy Trade-Off in Contrastive Learning6 Jun 2025
- 2024Range Membership Inference Attacks9 Aug 2024
- 2024A Method to Facilitate Membership Inference Attacks in Deep Learning Models2 Jul 2024
- 2024Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearning1 Jul 2024
- 2024Decaf: Data Distribution Decompose Attack against Federated Learning24 May 2024
- 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attacks4 Mar 2024
- 2023Quantifying Privacy Risks of Prompts in Visual Prompt Learning18 Oct 2023
- 2023Chameleon: Increasing Label-Only Membership Leakage with Adaptive Poisoning5 Oct 2023
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 51
- 2023SoK: Memorization in General-Purpose Large Language Modelscited by 37
- 2022Dissecting Distribution Inferencecited by 15
- 2023TMI! Finetuned Models Leak Private Information from their Pretraining Datacited by 14
- 2023Manipulating Transfer Learning for Property Inferencecited by 8
- 2023Summary Statistic Privacy in Data Sharingcited by 6
- 2023SoK: Unintended Interactions among Machine Learning Defenses and Riskscited by 6
- 2023Attesting Distributional Properties of Training Data for Machine Learningcited by 5
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmarkcited by 5
- 2025Exploiting Leaderboards for Large-Scale Distribution of Malicious Modelscited by 5
- 2024Analyzing Inference Privacy Risks Through Gradients in Machine Learningcited by 4
- 2024Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approachcited by 3
12 most cited of 19 All 19 (JSON)
- 2026QuanText: Protecting Dataset-Level Secrets in Textual Data Sharing16 Sep 2026
- 2026Code-Poisoning Property Inference Attacks17 Jul 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2025Exploiting Leaderboards for Large-Scale Distribution of Malicious Models11 Jul 2025
- 2025Black-Box Privacy Attacks on Shared Representations in Multitask Learning19 Jun 2025
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmark9 Jun 2025
- 2025Disparate Privacy Vulnerability: Targeted Attribute Inference Attacks and Defenses5 Apr 2025
- 2024Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approach6 Nov 2024
- 2024Analyzing Inference Privacy Risks Through Gradients in Machine Learning29 Aug 2024
- 2024Security and Privacy of 6G Federated Learning-enabled Dynamic Spectrum Sharing18 Jun 2024
- 2023SoK: Unintended Interactions among Machine Learning Defenses and Risks7 Dec 2023
- 2023SoK: Memorization in General-Purpose Large Language Models24 Oct 2023
12 newest of 19 All 19 (JSON)