Property Inference Attacks Against GANs
On the map: LLM safety and security → Membership inference attacks
Abstract (arXiv)
While machine learning (ML) has made tremendous progress during the past decade, recent research has shown that ML models are vulnerable to various security and privacy attacks. So far, most of the attacks in this field focus on discriminative models, represented by classifiers. Meanwhile, little attention has been paid to the security and privacy risks of generative models, such as generative adversarial networks (GANs). In this paper, we propose the first set of training dataset property inference attacks against GANs. Concretely, the adversary aims to infer the macro-level training dataset property, i.e., the proportion of samples used to train a target GAN with respect to a certain attribute. A successful property inference attack can allow the adversary to gain extra knowledge of the target GAN's training dataset, thereby directly violating the intellectual property of the target model owner. Also, it can be used as a fairness auditor to check whether the target GAN is trained with a biased dataset. Besides, property inference can serve as a building block for other advanced attacks, such as membership inference. We propose a general attack pipeline that can be tailored to two attack scenarios, including the full black-box setting and partial black-box setting. For the latter, we introduce a novel optimization framework to increase the attack efficacy. Extensive experiments over four representative GAN models on five property inference tasks show that our attacks achieve strong performance. In addition, we show that our attacks can be used to enhance the performance of membership inference against GANs.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 42 of its 72 references that are in the map. First posted on arXiv 15 Nov 2021.
Builds on
42 of 72 references.
Closest ancestors · 3
Same direction, newest first
- 2021Membership Inference Attacks Against Recommender Systems16 Sep
- 2021EncoderMI: Membership Inference against Pre-trained Encoders in Contrastive Learning25 Aug
- 2021ML-Doctor: Holistic Risk Assessment of Inference Attacks Against Machine Learning Models4 Feb
Other references · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2013Intriguing properties of neural networkscited by 5,114
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2016Practical Black-Box Attacks against Machine Learningcited by 893
27 more
- 2014Show and Tell: A Neural Image Caption Generatorcited by 877
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
- 2016Stealing Machine Learning Models via Prediction APIscited by 602
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 509
- 2018ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Modelscited by 475
- 2020Label-Only Membership Inference Attackscited by 371
- 2018Knockoff Nets: Stealing Functionality of Black-Box Modelscited by 285
- 2017EMNIST: an extension of MNIST to handwritten letterscited by 212
- 2019High Accuracy and High Fidelity Extraction of Neural Networkscited by 208
- 2020BadNL: Backdoor Attacks against NLP Models with Semantic-preserving Improvementscited by 191
- 2020When Machine Unlearning Jeopardizes Privacycited by 181
- 2019Stolen Memories: Leveraging Model Memorization for Calibrated White-Box Membership Inferencecited by 168
- 2017Generalization and Equilibrium in Generative Adversarial Nets (GANs)cited by 165
- 2020Membership Leakage in Label-Only Exposurescited by 156
- 2020Dynamic Backdoor Attacks Against Machine Learning Modelscited by 147
- 2019Updates-Leak: Data Set Inference and Reconstruction Attacks in Online Learningcited by 117
- 2018Stealing Hyperparameters in Machine Learningcited by 115
- 2020Stealing Links from Graph Neural Networkscited by 114
- 2016SampleRNN: An Unconditional End-to-End Neural Audio Generation Modelcited by 110
- 2018Synthesizing Tabular Data using Generative Adversarial Networkscited by 92
- 2021Membership Inference Attack on Graph Neural Networkscited by 81
- 2021Node-Level Membership Inference Attacks Against Graph Neural Networkscited by 80
- 2017Knock Knock, Who's There? Membership Inference on Aggregate Location Datacited by 63
- 2021Quantifying and Mitigating Privacy Risks of Contrastive Learningcited by 35
- 2017LOGAN: Membership Inference Attacks Against Generative Modelscited by 28
Built on by
Citing papers per year: 2021: 2; 2022: 8; 2023: 6; 2024: 8; 2025: 4; 2026: 4.
32 papers.
Sort:
By area:
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 47
- 2022Data Poisoning Attacks Against Multimodal Encoderscited by 41
- 2023SoK: Memorization in General-Purpose Large Language Modelscited by 36
- 2022SNAP: Efficient Extraction of Private Properties with Poisoningcited by 29
- 2022Auditing Membership Leakages of Multi-Exit Networkscited by 26
- 2023Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Modelscited by 22
- 2022Group Property Inference Attacks Against Graph Neural Networkscited by 21
- 2022Distribution inference risks: Identifying and mitigating sources of leakagecited by 17
- 2022Dissecting Distribution Inferencecited by 15
- 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attackscited by 13
- 2024Data Mixture Inference: What do BPE Tokenizers Reveal about their Training Data?cited by 13
20 more
- 2021Correlation inference attacks against machine learning modelscited by 7
- 2024Exploring Privacy and Fairness Risks in Sharing Diffusion Models: An Adversarial Perspectivecited by 6
- 2023Attesting Distributional Properties of Training Data for Machine Learningcited by 5
- 2023PriSampler: Mitigating Property Inference of Diffusion Modelscited by 4
- 2025Can We Infer Confidential Properties of Training Data from LLMs?cited by 4
- 2023Adversarial Robustness in Unsupervised Machine Learning: A Systematic Reviewcited by 3
- 2024Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approachcited by 3
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Modelscited by 3
- 2025Quantifying the Privacy Implications of High-Fidelity Synthetic Network Trafficcited by 3
- 2023Class Attribute Inference Attacks: Inferring Sensitive Class Information by Diffusion-Based Attribute Manipulationscited by 2
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directionscited by 2
- 2022Inferring Class Label Distribution of Training Data from Classifiers: An Accuracy-Augmented Meta-Classifier Attackcited by 1
- 2026Alignment Defends LLMs from Property Inference Attackscited by 1
- 2021HyObscure: Hybrid Obscuring for Privacy-Preserving Data Publishingcited by 0
- 2024Unraveling Attacks in Machine Learning-based IoT Ecosystems: A Survey and the Open Libraries Behind Themcited by 0
- 2024FRIDA: Free-Rider Detection using Privacy Attackscited by 0
- 2025Black-Box Privacy Attacks on Shared Representations in Multitask Learningcited by 0
- 2026SoK: Colluding Adversaries in Machine Learning Pipelinescited by 0
- 2026Code-Poisoning Property Inference Attackscited by 0
- 2026QuanText: Protecting Dataset-Level Secrets in Textual Data Sharingcited by 0
- 2026QuanText: Protecting Dataset-Level Secrets in Textual Data Sharing16 Sep 2026
- 2026Code-Poisoning Property Inference Attacks17 Jul 2026
- 2026Alignment Defends LLMs from Property Inference Attacks8 Jun 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2025Quantifying the Privacy Implications of High-Fidelity Synthetic Network Traffic25 Nov 2025
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Models25 Sep 2025
- 2025Black-Box Privacy Attacks on Shared Representations in Multitask Learning19 Jun 2025
- 2025Can We Infer Confidential Properties of Training Data from LLMs?12 Jun 2025
- 2024Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approach6 Nov 2024
- 2024FRIDA: Free-Rider Detection using Privacy Attacks7 Oct 2024
- 2024Data Mixture Inference: What do BPE Tokenizers Reveal about their Training Data?23 Jul 2024
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directions4 Jun 2024
20 more
- 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attacks4 Mar 2024
- 2024Exploring Privacy and Fairness Risks in Sharing Diffusion Models: An Adversarial Perspective28 Feb 2024
- 2024Unraveling Attacks in Machine Learning-based IoT Ecosystems: A Survey and the Open Libraries Behind Them22 Jan 2024
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems11 Jan 2024
- 2023Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Models30 Oct 2023
- 2023SoK: Memorization in General-Purpose Large Language Models24 Oct 2023
- 2023Attesting Distributional Properties of Training Data for Machine Learning18 Aug 2023
- 2023PriSampler: Mitigating Property Inference of Diffusion Models8 Jun 2023
- 2023Adversarial Robustness in Unsupervised Machine Learning: A Systematic Review1 Jun 2023
- 2023Class Attribute Inference Attacks: Inferring Sensitive Class Information by Diffusion-Based Attribute Manipulations16 Mar 2023
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learning21 Dec 2022
- 2022Dissecting Distribution Inference15 Dec 2022
- 2022Inferring Class Label Distribution of Training Data from Classifiers: An Accuracy-Augmented Meta-Classifier Attack8 Nov 2022
- 2022Data Poisoning Attacks Against Multimodal Encoders30 Sep 2022
- 2022Distribution inference risks: Identifying and mitigating sources of leakage18 Sep 2022
- 2022Group Property Inference Attacks Against Graph Neural Networks2 Sep 2022
- 2022SNAP: Efficient Extraction of Private Properties with Poisoning25 Aug 2022
- 2022Auditing Membership Leakages of Multi-Exit Networks23 Aug 2022
- 2021Correlation inference attacks against machine learning models16 Dec 2021
- 2021HyObscure: Hybrid Obscuring for Privacy-Preserving Data Publishing15 Dec 2021
- 2023Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Modelscited by 22
- 2024Exploring Privacy and Fairness Risks in Sharing Diffusion Models: An Adversarial Perspectivecited by 6
- 2023PriSampler: Mitigating Property Inference of Diffusion Modelscited by 4
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Modelscited by 3
- 2025Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Models25 Sep 2025
- 2024Exploring Privacy and Fairness Risks in Sharing Diffusion Models: An Adversarial Perspective28 Feb 2024
- 2023Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Models30 Oct 2023
- 2023PriSampler: Mitigating Property Inference of Diffusion Models8 Jun 2023
- 2026Alignment Defends LLMs from Property Inference Attackscited by 1
- 2026Alignment Defends LLMs from Property Inference Attacks8 Jun 2026
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 47
- 2023SoK: Memorization in General-Purpose Large Language Modelscited by 36
- 2022SNAP: Efficient Extraction of Private Properties with Poisoningcited by 29
- 2022Auditing Membership Leakages of Multi-Exit Networkscited by 26
- 2022Group Property Inference Attacks Against Graph Neural Networkscited by 21
- 2022Distribution inference risks: Identifying and mitigating sources of leakagecited by 17
- 2022Dissecting Distribution Inferencecited by 15
- 2024Data Mixture Inference: What do BPE Tokenizers Reveal about their Training Data?cited by 13
- 2021Correlation inference attacks against machine learning modelscited by 7
- 2023Attesting Distributional Properties of Training Data for Machine Learningcited by 5
- 2025Can We Infer Confidential Properties of Training Data from LLMs?cited by 4
12 most cited of 24 All 24 (JSON)
- 2026QuanText: Protecting Dataset-Level Secrets in Textual Data Sharing16 Sep 2026
- 2026Code-Poisoning Property Inference Attacks17 Jul 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2025Black-Box Privacy Attacks on Shared Representations in Multitask Learning19 Jun 2025
- 2025Can We Infer Confidential Properties of Training Data from LLMs?12 Jun 2025
- 2024Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approach6 Nov 2024
- 2024FRIDA: Free-Rider Detection using Privacy Attacks7 Oct 2024
- 2024Data Mixture Inference: What do BPE Tokenizers Reveal about their Training Data?23 Jul 2024
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directions4 Jun 2024
- 2024Unraveling Attacks in Machine Learning-based IoT Ecosystems: A Survey and the Open Libraries Behind Them22 Jan 2024
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems11 Jan 2024
- 2023SoK: Memorization in General-Purpose Large Language Models24 Oct 2023
12 newest of 24 All 24 (JSON)