mlsanityData to 14 Oct 2026

SNAP: Efficient Extraction of Private Properties with Poisoning

arXiv 2208.12348 ↗First posted 25 Aug 2022cs.LG cs.CRcited by 31

Not on the map. Why?

Abstract (arXiv)

Property inference attacks allow an adversary to extract global properties of the training dataset from a machine learning model. Such attacks have privacy implications for data owners sharing their datasets to train machine learning models. Several existing approaches for property inference attacks against deep neural networks have been proposed, but they all rely on the attacker training a large number of shadow models, which induces a large computational overhead. In this paper, we consider the setting of property inference attacks in which the attacker can poison a subset of the training dataset and query the trained target model. Motivated by our theoretical analysis of model confidences under poisoning, we design an efficient property inference attack, SNAP, which obtains higher attack success and requires lower amounts of poisoning than the state-of-the-art poisoning-based property inference attack by Mahloujifar et al. For example, on the Census dataset, SNAP achieves 34% higher success rate than Mahloujifar et al. while being 56.5x faster. We also extend our attack to infer whether a certain property was present at all during training and estimate the exact proportion of a property of interest efficiently. We evaluate our attack on several properties of varying proportions from four datasets and demonstrate SNAP's generality and effectiveness. An open-source implementation of SNAP can be found at https://github.com/johnmath/snap-sp23.

Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 35 of its 51 references that are in the map. First posted on arXiv 25 Aug 2022.

Builds on

35 of 51 references.

References · 35

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  3. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  4. 2020Extracting Training Data from Large Language Modelscited by 2,189
  5. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  6. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
  7. 2021Membership Inference Attacks From First Principlescited by 878
  8. 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 864
  9. 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 520
  10. 2019Does Learning Require Memorization? A Short Tale about a Long Tailcited by 460
  11. 2020Label-Only Membership Inference Attackscited by 388
  12. 2021Opacus: User-Friendly Differential Privacy Library in PyTorchcited by 383
23 more
  1. 2017Certified Defenses for Data Poisoning Attackscited by 303
  2. 2020Systematic Evaluation of Privacy Risks of Machine Learning Modelscited by 292
  3. 2019White-box vs Black-box: Bayes Optimal Strategies for Membership Inferencecited by 271
  4. 2021Enhanced Membership Inference Attacks against Machine Learning Modelscited by 248
  5. 2018Manipulating Machine Learning: Poisoning Attacks and Countermeasures for Regression Learningcited by 225
  6. 2020Auditing Differentially Private Machine Learning: How Private is Private SGD?cited by 218
  7. 2021Adversary Instantiation: Lower Bounds for Differentially Private Machine Learningcited by 199
  8. 2020Witches' Brew: Industrial Scale Data Poisoning via Gradient Matchingcited by 163
  9. 2022Reconstructing Training Data with Informed Adversariescited by 148
  10. 2013Hacking Smart Machines with Smarter Ones: How to Extract Meaningful Data from Machine Learning Classifierscited by 130
  11. 2021When the Curious Abandon Honesty: Federated Learning Is Not Privatecited by 127
  12. 2020Revisiting Membership Inference Under Realistic Assumptionscited by 112
  13. 2022Truth Serum: Poisoning Machine Learning Models to Reveal Their Secretscited by 101
  14. 2018Is feature selection secure against training data poisoning?cited by 93
  15. 2018Technical Report: When Does Machine Learning FAIL? Generalized Transferability for Evasion and Poisoning Attackscited by 81
  16. 2019Data Poisoning against Differentially-Private Learners: Attacks and Defensescited by 78
  17. 2020Subpopulation Data Poisoning Attackscited by 70
  18. 2021Property Inference From Poisoningcited by 60
  19. 2022Improved Certified Defenses against Data Poisoning with (Deterministic) Finite Aggregationcited by 52
  20. 2020Leakage of Dataset Properties in Multi-Party Machine Learningcited by 47
  21. 2021Gradient Disaggregation: Breaking Privacy in Federated Learning by Reconstructing the User Participant Matrixcited by 43
  22. 2021Formalizing and Estimating Distribution Inference Riskscited by 43
  23. 2021Property Inference Attacks Against GANscited by 33

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 10; 2024: 8; 2025: 7; 2026: 4.

31 papers.

Sort:

By area:

  1. 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 51
  2. 2023SoK: Memorization in General-Purpose Large Language Modelscited by 37
  3. 2022Dissecting Distribution Inferencecited by 15
  4. 2023TMI! Finetuned Models Leak Private Information from their Pretraining Datacited by 14
  5. 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attackscited by 13
  6. 2024Range Membership Inference Attackscited by 12
  7. 2023Manipulating Transfer Learning for Property Inferencecited by 8
  8. 2023Quantifying Privacy Risks of Prompts in Visual Prompt Learningcited by 8
  9. 2024A Method to Facilitate Membership Inference Attacks in Deep Learning Modelscited by 7
  10. 2023Summary Statistic Privacy in Data Sharingcited by 6
  11. 2023SoK: Unintended Interactions among Machine Learning Defenses and Riskscited by 6
  12. 2023Attesting Distributional Properties of Training Data for Machine Learningcited by 5
19 more
  1. 2023Chameleon: Increasing Label-Only Membership Leakage with Adaptive Poisoningcited by 5
  2. 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmarkcited by 5
  3. 2025Exploiting Leaderboards for Large-Scale Distribution of Malicious Modelscited by 5
  4. 2023PriSampler: Mitigating Property Inference of Diffusion Modelscited by 4
  5. 2024Decaf: Data Distribution Decompose Attack against Federated Learningcited by 4
  6. 2024Analyzing Inference Privacy Risks Through Gradients in Machine Learningcited by 4
  7. 2025Toward Efficient Inference Attacks: Shadow Model Sharing via Mixture-of-Expertscited by 4
  8. 2024Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approachcited by 3
  9. 2025Disparate Privacy Vulnerability: Targeted Attribute Inference Attacks and Defensescited by 3
  10. 2025When Better Features Mean Greater Risks: The Performance-Privacy Trade-Off in Contrastive Learningcited by 3
  11. 2024Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearningcited by 2
  12. 2025Membership Inference Attack with Partial Featurescited by 1
  13. 2023Threats, Vulnerabilities, and Controls of Machine Learning Based Systems: A Survey and Taxonomycited by 0
  14. 2024Security and Privacy of 6G Federated Learning-enabled Dynamic Spectrum Sharingcited by 0
  15. 2025Black-Box Privacy Attacks on Shared Representations in Multitask Learningcited by 0
  16. 2026Boundary-targeted Membership Inference Attacks on Safety Classifierscited by 0
  17. 2026SoK: Colluding Adversaries in Machine Learning Pipelinescited by 0
  18. 2026Code-Poisoning Property Inference Attackscited by 0
  19. 2026QuanText: Protecting Dataset-Level Secrets in Textual Data Sharingcited by 0