ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Models
Not on the map. Why?
Cited by 225 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Machine learning (ML) has become a core component of many real-world applications and training data is a key factor that drives current progress. This huge success has led Internet companies to deploy machine learning as a service (MLaaS). Recently, the first membership inference attack has shown that extraction of information on the training set is possible in such MLaaS settings, which has severe security and privacy implications. However, the early demonstrations of the feasibility of such attacks have many assumptions on the adversary, such as using multiple so-called shadow models, knowledge of the target model structure, and having a dataset from the same distribution as the target model's training data. We relax all these key assumptions, thereby showing that such attacks are very broadly applicable at low cost and thereby pose a more severe risk than previously thought. We present the most comprehensive study so far on this emerging and developing threat using eight diverse datasets which show the viability of the proposed attacks across domains. In addition, we propose the first effective defense mechanisms against such broader class of membership inference attacks that maintain a high level of utility of the ML model.
Key facts. Cited by 475 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 66; 2022: 95; 2023: 78; 2024: 87; 2025: 87; 2026: 62.
475 papers.
Sort:
By area:
- 2021Membership Inference Attacks From First Principlescited by 839
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2022A Survey of Machine Unlearningcited by 298
- 2021Enhanced Membership Inference Attacks against Machine Learning Modelscited by 237
- 2021Machine Unlearning of Features and Labelscited by 223
- 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 194
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
- 2022Dataset Distillation using Neural Feature Regressioncited by 177
- 2022Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attackscited by 168
- 2022Reconstructing Training Data with Informed Adversariescited by 143
- 2021On the Importance of Difficulty Calibration in Membership Inference Attackscited by 137
- 2023Are Diffusion Models Vulnerable to Membership Inference Attacks?cited by 135
38 more
- 2021Graph Unlearningcited by 129
- 2022Reconstructing Training Data from Trained Neural Networkscited by 129
- 2022Zero-Shot Machine Unlearningcited by 125
- 2021Decentralized Federated Averagingcited by 114
- 2023A Comprehensive Survey of Dataset Distillationcited by 114
- 2023Low-Cost High-Power Membership Inference Attackscited by 99
- 2023KGA: A General Machine Unlearning Framework Based on Knowledge Gap Alignmentcited by 94
- 2022Membership Inference Attacks by Exploiting Loss Trajectorycited by 93
- 2021Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?cited by 91
- 2023Practical Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibrationcited by 90
- 2023Membership Inference Attacks against Diffusion Modelscited by 84
- 2022BppAttack: Stealthy and Efficient Trojan Attacks against Deep Neural Networks via Image Quantization and Contrastive Adversarial Learningcited by 82
- 2021Membership Inference Attack on Graph Neural Networkscited by 81
- 2021Node-Level Membership Inference Attacks Against Graph Neural Networkscited by 80
- 2021ML-Doctor: Holistic Risk Assessment of Inference Attacks Against Machine Learning Modelscited by 79
- 2021Practical Blind Membership Inference Attack via Differential Comparisonscited by 73
- 2022Federated Unlearning with Knowledge Distillationcited by 70
- 2021EncoderMI: Membership Inference against Pre-trained Encoders in Contrastive Learningcited by 68
- 2023Bag of Tricks for Training Data Extraction from Language Modelscited by 67
- 2022Membership Inference Attacks Against Text-to-image Generation Modelscited by 66
- 2023Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifierscited by 66
- 2021Mitigating Membership Inference Attacks by Self-Distillation Through a Novel Ensemble Architecturecited by 63
- 2023Scalable Membership Inference Attacks via Quantile Regressioncited by 61
- 2022"Real Attackers Don't Compute Gradients": Bridging the Gap Between Adversarial ML Research and Practicecited by 55
- 2024SoK: Membership Inference Attacks on LLMs are Rushing Nowhere (and How to Fix It)cited by 54
- 2021Membership Inference Attacks Against Recommender Systemscited by 52
- 2021Adapting Membership Inference Attacks to GNN for Graph Classification: Approaches and Implicationscited by 50
- 2021Model Stealing Attacks Against Inductive Graph Neural Networkscited by 50
- 2023Prompt Stealing Attacks Against Text-to-Image Generation Modelscited by 48
- 2023Exposing the Fake: Effective Diffusion-Generated Images Detectioncited by 48
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 47
- 2023Membership Inference of Diffusion Modelscited by 46
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2022SSLGuard: A Watermarking Scheme for Self-supervised Learning Pre-trained Encoderscited by 43
- 2022Bounding Training Data Reconstruction in Private (Deep) Learningcited by 43
- 2022Membership Inference Attacks and Defenses in Neural Network Pruningcited by 42
- 2023White-box Membership Inference Attacks against Diffusion Modelscited by 42
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Aheadcited by 40
50 most cited of 475 All 475 (JSON)
- 2026Power Side-Channel Membership Inference Attack on Embedded Machine Learning7 Oct 2026
- 2026Calibrating One-Round Membership Inference with Neighbors28 Sep 2026
- 2026No Free Efficiency: Revisiting the Trade-off Between Training Efficiency and Model Vulnerability27 Sep 2026
- 2026Membership Inference via Pairwise Likelihood Ratios11 Sep 2026
- 2026Privacy-Preserving Split Learning for Federated LLM Fine-Tuning9 Sep 2026
- 2026Membership is Ownership: A Robust Ownership Verification Framework for Diffusion Models28 Aug 2026
- 2026Rethinking Demonstration Unlearning in Imitation Learning for Robotics21 Aug 2026
- 2026TOUR: A Trajectory-Level Unlearning Benchmark for Offline Reinforcement Learning23 Jul 2026
- 2026ADS-C: Antidistillation Sampling for Classification16 Jul 2026
- 2026Quantifying Training Membership Information in the Hyperspherical Embedding Geometry of Face Recognition Models16 Jul 2026
- 2026Data Provenance for Image Auto-Regressive Generation22 Jun 2026
- 2026MGI: Member vs Generated Inference22 Jun 2026
38 more
- 2026Have You Ever Seen Them? Entity-level Membership Inference through Interrogating Large Language Models22 Jun 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2026Is My Vision-Language Data in Your AI? Membership Inference Test (MINT) Demo 25 Jun 2026
- 2026Revisiting Privacy Amplification by Subsampling in Selective Release DPSGD3 Jun 2026
- 2026Bayesian Membership Privacy for Graph Neural Networks2 Jun 2026
- 2026idSCD: Identifying Training Datasets through Semantic Correlation Descriptors28 May 2026
- 2026A Full-Pipeline Framework for Evaluating Membership Inference Attacks in Machine Learning28 May 2026
- 2026MRMMIA: Membership Inference Attacks on Memory in Chat Agents27 May 2026
- 2026Single-Sample Black-Box Membership Inference Attack against Vision-Language Models via Cross-modal Semantic Alignment17 May 2026
- 2026ReMIA: a Powerful and Efficient Alternative to Membership Inference Attacks against Synthetic Data Generators14 May 2026
- 2026DistractMIA: Black-Box Membership Inference on Vision-Language Models via Semantic Distraction12 May 2026
- 2026On Privacy in Data-Space Tabular Diffusion Models: Influential Factors, Attacker Knowledge, and Metrics7 May 2026
- 2026Generalization and Membership Inference Attack a Practical Perspective21 Apr 2026
- 2026A Dual Perspective on Synthetic Trajectory Generators: Utility Framework and Privacy Vulnerabilities21 Apr 2026
- 2026Towards Reliable Testing of Machine Unlearning16 Apr 2026
- 2026Evaluating Differential Privacy Against Membership Inference in Federated Learning: Insights from the NIST Genomics Red Team Challenge14 Apr 2026
- 2026CoLA: A Choice Leakage Attack Framework to Expose Privacy Risks in Subset Training14 Apr 2026
- 2026Protecting and Preserving Protest Dynamics for Responsible Analysis6 Apr 2026
- 2026Forgetting to Witness: Efficient Federated Unlearning and Its Visible Evaluation6 Apr 2026
- 2026Jellyfish: Zero-Shot Federated Unlearning Scheme with Knowledge Disentanglement5 Apr 2026
- 2026Learning the Signature of Memorization in Autoregressive Language Models3 Apr 2026
- 2026A Unified Perspective on Adversarial Membership Manipulation in Vision Models3 Apr 2026
- 2026AutoMIA: Improved Baselines for Membership Inference Attack via Agentic Self-Exploration1 Apr 2026
- 2026ReproMIA: A Comprehensive Analysis of Model Reprogramming for Proactive Membership Inference Attacks30 Mar 2026
- 2026Uncovering Memorization in Timeseries Imputation models: LBRM Membership Inference and its link to attribute Leakage25 Mar 2026
- 2026A Critical Review on the Effectiveness and Privacy Threats of Membership Inference Attacks24 Mar 2026
- 2026Automated Membership Inference Attacks (AutoMIA): Discovering MIA Signal Computations using LLM Agents19 Mar 2026
- 2026Informationally Compressive Anonymization: Non-Degrading Sensitive Input Protection for Privacy-Preserving Supervised Machine Learning16 Mar 2026
- 2026Privacy-Preserving Machine Learning for IoT: A Cross-Paradigm Survey and Future Roadmap13 Mar 2026
- 2026Learnability and Privacy Vulnerability are Entangled in a Few Critical Weights13 Mar 2026
- 2026Exponential-Family Membership Inference: From LiRA and RMIA to BaVarIA12 Mar 2026
- 2026Revisiting the LiRA Membership Inference Attack Under Realistic Assumptions8 Mar 2026
- 2026Turning Black Box into White Box: Dataset Distillation Leaks1 Mar 2026
- 2026Unlearning Evaluation through Subset Statistical Independence28 Feb 2026
- 2026Mitigating Membership Inference in Intermediate Representations with Differentially Private Training26 Feb 2026
- 2026LoMime: Query-Efficient Membership Inference using Model Extraction in Label-Only Settings21 Feb 2026
- 2026Assessing Per-Sample Membership Inference Vulnerability without Retraining17 Feb 2026
- 2026Protecting Private Code in IDE Autocomplete using Differential Privacy30 Jan 2026
50 newest of 475 All 475 (JSON)
- 2021Membership Inference Attacks From First Principlescited by 839
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2022A Survey of Machine Unlearningcited by 298
- 2021Enhanced Membership Inference Attacks against Machine Learning Modelscited by 237
- 2021Machine Unlearning of Features and Labelscited by 223
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
- 2022Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attackscited by 168
- 2021On the Importance of Difficulty Calibration in Membership Inference Attackscited by 137
- 2021Graph Unlearningcited by 129
- 2022Zero-Shot Machine Unlearningcited by 125
- 2023Low-Cost High-Power Membership Inference Attackscited by 99
- 2023KGA: A General Machine Unlearning Framework Based on Knowledge Gap Alignmentcited by 94
12 most cited of 195 All 195 (JSON)
- 2026Power Side-Channel Membership Inference Attack on Embedded Machine Learning7 Oct 2026
- 2026Calibrating One-Round Membership Inference with Neighbors28 Sep 2026
- 2026Membership Inference via Pairwise Likelihood Ratios11 Sep 2026
- 2026Data Provenance for Image Auto-Regressive Generation22 Jun 2026
- 2026MGI: Member vs Generated Inference22 Jun 2026
- 2026Have You Ever Seen Them? Entity-level Membership Inference through Interrogating Large Language Models22 Jun 2026
- 2026Is My Vision-Language Data in Your AI? Membership Inference Test (MINT) Demo 25 Jun 2026
- 2026idSCD: Identifying Training Datasets through Semantic Correlation Descriptors28 May 2026
- 2026A Full-Pipeline Framework for Evaluating Membership Inference Attacks in Machine Learning28 May 2026
- 2026MRMMIA: Membership Inference Attacks on Memory in Chat Agents27 May 2026
- 2026ReMIA: a Powerful and Efficient Alternative to Membership Inference Attacks against Synthetic Data Generators14 May 2026
- 2026Generalization and Membership Inference Attack a Practical Perspective21 Apr 2026
12 newest of 195 All 195 (JSON)
- 2023Are Diffusion Models Vulnerable to Membership Inference Attacks?cited by 135
- 2023Membership Inference Attacks against Diffusion Modelscited by 84
- 2023Exposing the Fake: Effective Diffusion-Generated Images Detectioncited by 48
- 2023Membership Inference of Diffusion Modelscited by 46
- 2023White-box Membership Inference Attacks against Diffusion Modelscited by 42
- 2023Black-box Membership Inference Attacks against Fine-tuned Diffusion Modelscited by 35
- 2024Attacks and Defenses for Generative Diffusion Models: A Comprehensive Surveycited by 32
- 2023Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Modelscited by 22
- 2024CDI: Copyrighted Data Identification in Diffusion Modelscited by 17
- 2024FedBiP: Heterogeneous One-Shot Federated Learning with Personalized Latent Diffusion Modelscited by 16
- 2024Towards Black-Box Membership Inference Attack for Diffusion Modelscited by 14
- 2023Data Forensics in Diffusion Models: A Systematic Analysis of Membership Privacycited by 10
12 most cited of 29 All 29 (JSON)
- 2026Membership is Ownership: A Robust Ownership Verification Framework for Diffusion Models28 Aug 2026
- 2026ReproMIA: A Comprehensive Analysis of Model Reprogramming for Proactive Membership Inference Attacks30 Mar 2026
- 2026Noise as a Probe: Membership Inference Attacks on Diffusion Models Leveraging Initial Noise29 Jan 2026
- 2026Inference Attacks Against Graph Generative Diffusion Models7 Jan 2026
- 2025Privacy Preserving Diffusion Models for Mixed-Type Tabular Data Generation29 Nov 2025
- 2025Noise Aggregation Analysis Driven by Small-Noise Injection: Efficient Membership Inference for Diffusion Models18 Oct 2025
- 2025Auditing Data Provenance in Real-world Text-to-Image Diffusion Models for Privacy and Copyright Protection13 Jun 2025
- 2025Enhancing Membership Inference Attacks on Diffusion Models from a Frequency-Domain Perspective27 May 2025
- 2024Federated Diffusion Modeling with Differential Privacy for Tabular Data Synthesis20 Dec 2024
- 2024CDI: Copyrighted Data Identification in Diffusion Models19 Nov 2024
- 2024Dual-Model Defense: Safeguarding Diffusion Models from Membership Inference Attacks through Disjoint Data Splitting22 Oct 2024
- 2024FedBiP: Heterogeneous One-Shot Federated Learning with Personalized Latent Diffusion Models7 Oct 2024
12 newest of 29 All 29 (JSON)
- 2024Membership Inference Attacks against Large Vision-Language Modelscited by 31
- 2025Vid-SME: Membership Inference Attacks against Large Video Understanding Modelscited by 17
- 2024Self-Comparison for Dataset-Level Membership Inference in Large (Vision-)Language Modelscited by 6
- 2025Image Corruption-Inspired Membership Inference Attacks against Large Vision-Language Modelscited by 3
- 2025Are Neuro-Inspired Multi-Modal Vision-Language Models Resilient to Membership Inference Privacy Leakage?cited by 2
- 2025DIS-CO: Discovering Copyrighted Content in VLMs Training Datacited by 1
- 2026DistractMIA: Black-Box Membership Inference on Vision-Language Models via Semantic Distractioncited by 0
- 2026Single-Sample Black-Box Membership Inference Attack against Vision-Language Models via Cross-modal Semantic Alignmentcited by 0
- 2026Single-Sample Black-Box Membership Inference Attack against Vision-Language Models via Cross-modal Semantic Alignment17 May 2026
- 2026DistractMIA: Black-Box Membership Inference on Vision-Language Models via Semantic Distraction12 May 2026
- 2025Are Neuro-Inspired Multi-Modal Vision-Language Models Resilient to Membership Inference Privacy Leakage?24 Nov 2025
- 2025Image Corruption-Inspired Membership Inference Attacks against Large Vision-Language Models14 Jun 2025
- 2025Vid-SME: Membership Inference Attacks against Large Video Understanding Models29 May 2025
- 2025DIS-CO: Discovering Copyrighted Content in VLMs Training Data24 Feb 2025
- 2024Membership Inference Attacks against Large Vision-Language Models5 Nov 2024
- 2024Self-Comparison for Dataset-Level Membership Inference in Large (Vision-)Language Models16 Oct 2024
- 2025AttackPilot: Autonomous Inference Attacks Against ML Services With LLM-Based Agentscited by 2
- 2026Automated Membership Inference Attacks (AutoMIA): Discovering MIA Signal Computations using LLM Agentscited by 0
- 2026AutoMIA: Improved Baselines for Membership Inference Attack via Agentic Self-Explorationcited by 0
- 2026AutoMIA: Improved Baselines for Membership Inference Attack via Agentic Self-Exploration1 Apr 2026
- 2026Automated Membership Inference Attacks (AutoMIA): Discovering MIA Signal Computations using LLM Agents19 Mar 2026
- 2025AttackPilot: Autonomous Inference Attacks Against ML Services With LLM-Based Agents24 Nov 2025
- 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 194
- 2022Dataset Distillation using Neural Feature Regressioncited by 177
- 2022Reconstructing Training Data with Informed Adversariescited by 143
- 2022Reconstructing Training Data from Trained Neural Networkscited by 129
- 2021Decentralized Federated Averagingcited by 114
- 2023A Comprehensive Survey of Dataset Distillationcited by 114
- 2021Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?cited by 91
- 2022BppAttack: Stealthy and Efficient Trojan Attacks against Deep Neural Networks via Image Quantization and Contrastive Adversarial Learningcited by 82
- 2021Membership Inference Attack on Graph Neural Networkscited by 81
- 2021Node-Level Membership Inference Attacks Against Graph Neural Networkscited by 80
- 2023Bag of Tricks for Training Data Extraction from Language Modelscited by 67
- 2022"Real Attackers Don't Compute Gradients": Bridging the Gap Between Adversarial ML Research and Practicecited by 55
12 most cited of 234 All 234 (JSON)
- 2026No Free Efficiency: Revisiting the Trade-off Between Training Efficiency and Model Vulnerability27 Sep 2026
- 2026Privacy-Preserving Split Learning for Federated LLM Fine-Tuning9 Sep 2026
- 2026ADS-C: Antidistillation Sampling for Classification16 Jul 2026
- 2026Quantifying Training Membership Information in the Hyperspherical Embedding Geometry of Face Recognition Models16 Jul 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2026Revisiting Privacy Amplification by Subsampling in Selective Release DPSGD3 Jun 2026
- 2026Bayesian Membership Privacy for Graph Neural Networks2 Jun 2026
- 2026On Privacy in Data-Space Tabular Diffusion Models: Influential Factors, Attacker Knowledge, and Metrics7 May 2026
- 2026A Dual Perspective on Synthetic Trajectory Generators: Utility Framework and Privacy Vulnerabilities21 Apr 2026
- 2026CoLA: A Choice Leakage Attack Framework to Expose Privacy Risks in Subset Training14 Apr 2026
- 2026Protecting and Preserving Protest Dynamics for Responsible Analysis6 Apr 2026
- 2026Informationally Compressive Anonymization: Non-Degrading Sensitive Input Protection for Privacy-Preserving Supervised Machine Learning16 Mar 2026
12 newest of 234 All 234 (JSON)