Evaluating Membership Inference Through Adversarial Robustness
On the map: LLM safety and security → Membership inference attacks
Abstract (arXiv)
The usage of deep learning is being escalated in many applications. Due to its outstanding performance, it is being used in a variety of security and privacy-sensitive areas in addition to conventional applications. One of the key aspects of deep learning efficacy is to have abundant data. This trait leads to the usage of data which can be highly sensitive and private, which in turn causes wariness with regard to deep learning in the general public. Membership inference attacks are considered lethal as they can be used to figure out whether a piece of data belongs to the training dataset or not. This can be problematic with regards to leakage of training data information and its characteristics. To highlight the significance of these types of attacks, we propose an enhanced methodology for membership inference attacks based on adversarial robustness, by adjusting the directions of adversarial perturbations through label smoothing under a white-box setting. We evaluate our proposed method on three datasets: Fashion-MNIST, CIFAR-10, and CIFAR-100. Our experimental results reveal that the performance of our method surpasses that of the existing adversarial robustness-based method when attacking normally trained models. Additionally, through comparing our technique with the state-of-the-art metric-based membership inference methods, our proposed method also shows better performance when attacking adversarially trained models. The code for reproducing the results of this work is available at urlhttps://github.com/plll4zzx/Evaluating-Membership-Inference-Through-Adversarial-Robustness.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 23 of its 37 references that are in the map. First posted on arXiv 14 May 2022.
Builds on
23 of 37 references.
References · 23
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2013Intriguing properties of neural networkscited by 5,114
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
11 more
- 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
- 2015Listen, Attend and Spellcited by 542
- 2020Label-Only Membership Inference Attackscited by 371
- 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 312
- 2020Systematic Evaluation of Privacy Risks of Machine Learning Modelscited by 273
- 2019White-box vs Black-box: Bayes Optimal Strategies for Membership Inferencecited by 265
- 2015The MegaFace Benchmark: 1 Million Faces for Recognition at Scalecited by 199
- 2019Stolen Memories: Leveraging Model Memorization for Calibrated White-Box Membership Inferencecited by 168
- 2020Membership Leakage in Label-Only Exposurescited by 156
- 2018Android HIV: A Study of Repackaging Malware for Evading Machine-Learning Detectioncited by 19
- 2021Self-Supervised Adversarial Example Detection by Disentangled Representationcited by 7
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 3; 2026: 1.
7 papers.
- 2025Character-Level Perturbations Disrupt LLM Watermarkscited by 7
- 2023Masked Language Model Based Textual Adversarial Example Detectioncited by 5
- 2025Exploring Gradient-Guided Masked Language Model to Detect Textual Adversarial Attackscited by 4
- 2026Are You Still the Agent I Authorized? Earned Authority under a Fixed Ceiling for Evolving Agentscited by 4
- 2023SoK: Comparing Different Membership Inference Attacks with a Comprehensive Benchmarkcited by 3
- 2025When Better Features Mean Greater Risks: The Performance-Privacy Trade-Off in Contrastive Learningcited by 3
- 2024Improving Membership Inference in ASR Model Auditing with Perturbed Loss Featurescited by 2
- 2026Are You Still the Agent I Authorized? Earned Authority under a Fixed Ceiling for Evolving Agents26 Jul 2026
- 2025Character-Level Perturbations Disrupt LLM Watermarks11 Sep 2025
- 2025When Better Features Mean Greater Risks: The Performance-Privacy Trade-Off in Contrastive Learning6 Jun 2025
- 2025Exploring Gradient-Guided Masked Language Model to Detect Textual Adversarial Attacks8 Apr 2025
- 2024Improving Membership Inference in ASR Model Auditing with Perturbed Loss Features2 May 2024
- 2023SoK: Comparing Different Membership Inference Attacks with a Comprehensive Benchmark12 Jul 2023
- 2023Masked Language Model Based Textual Adversarial Example Detection18 Apr 2023