Membership Inference Attacks Against Recommender Systems
On the map: LLM safety and security → Membership inference attacks
Abstract (arXiv)
Recently, recommender systems have achieved promising performances and become one of the most widely used web applications. However, recommender systems are often trained on highly sensitive user data, thus potential data leakage from recommender systems may lead to severe privacy problems. In this paper, we make the first attempt on quantifying the privacy leakage of recommender systems through the lens of membership inference. In contrast with traditional membership inference against machine learning classifiers, our attack faces two main differences. First, our attack is on the user-level but not on the data sample-level. Second, the adversary can only observe the ordered recommended items from a recommender system instead of prediction results in the form of posterior probabilities. To address the above challenges, we propose a novel method by representing users from relevant items. Moreover, a shadow recommender is established to derive the labeled training data for training the attack model. Extensive experimental results show that our attack framework achieves a strong performance. In addition, we design a defense mechanism to effectively mitigate the membership inference threat of recommender systems.
Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 29 of its 55 references that are in the map. First posted on arXiv 16 Sep 2021.
Builds on
29 of 55 references.
References · 29
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2017Neural Collaborative Filteringcited by 1,111
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,106
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 864
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 840
- 2017Evasion Attacks against Machine Learning at Test Timecited by 689
- 2016Stealing Machine Learning Models via Prediction APIscited by 619
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 520
- 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 520
- 2018ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Modelscited by 498
17 more
- 2020Label-Only Membership Inference Attackscited by 388
- 2019White-box vs Black-box: Bayes Optimal Strategies for Membership Inferencecited by 271
- 2018Scalable Private Learning with PATEcited by 269
- 2018Manipulating Machine Learning: Poisoning Attacks and Countermeasures for Regression Learningcited by 225
- 2019High Accuracy and High Fidelity Extraction of Neural Networkscited by 214
- 2021Adversary Instantiation: Lower Bounds for Differentially Private Machine Learningcited by 199
- 2019MemGuard: Defending against Black-Box Membership Inference Attacks via Adversarial Examplescited by 197
- 2018Machine Learning with Membership Privacy using Adversarial Regularizationcited by 186
- 2019Stolen Memories: Leveraging Model Memorization for Calibrated White-Box Membership Inferencecited by 175
- 2020Membership Leakage in Label-Only Exposurescited by 168
- 2020Stealing Links from Graph Neural Networkscited by 115
- 2017Fast Matrix Factorization for Online Recommendation with Implicit Feedbackcited by 101
- 2016Towards the Science of Security and Privacy in Machine Learningcited by 89
- 2019How to Prove Your Model Belongs to You: A Blind-Watermark based Framework to Protect Intellectual Property of DNNcited by 66
- 2017LOGAN: Membership Inference Attacks Against Generative Modelscited by 28
- 2019Joint Neural Collaborative Filtering for Recommender Systemscited by 11
- 2017walk2friends: Inferring Social Links from Mobility Profilescited by 7
Built on by
Citing papers per year: 2021: 1; 2022: 17; 2023: 13; 2024: 11; 2025: 10; 2026: 5.
57 papers.
Sort:
By area:
- 2022The Privacy Onion Effect: Memorization is Relativecited by 136
- 2022Membership Inference Attacks by Exploiting Loss Trajectorycited by 101
- 2023Practical Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibrationcited by 98
- 2022Recommendation Unlearningcited by 80
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 51
- 2022M^4I: Multi-modal Models Membership Inferencecited by 34
- 2021Property Inference Attacks Against GANscited by 33
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2023Overconfidence is a Dangerous Thing: Mitigating Membership Inference Attacks by Enforcing Less Confident Predictioncited by 29
- 2024SeqMIA: Sequential-Metric Based Membership Inference Attackcited by 23
- 2023Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Modelscited by 22
- 2024Is Difficulty Calibration All We Need? Towards More Practical Membership Inference Attackscited by 21
38 more
- 2023Machine Unlearning: A Surveycited by 19
- 2022Membership Inference Attacks and Generalization: A Causal Perspectivecited by 17
- 2022Debiasing Learning for Membership Inference Attacks Against Recommender Systemscited by 12
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasurescited by 11
- 2025Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemblecited by 11
- 2023Code Membership Inference for Detecting Unauthorized Data Use in Code Pre-trained Language Modelscited by 8
- 2024Federated Graph Condensation with Information Bottleneck Principlescited by 8
- 2023User Consented Federated Recommender System Against Personalized Attribute Inference Attackcited by 7
- 2022LegoNet: A Fast and Exact Unlearning Architecturecited by 6
- 2023Recommendation Unlearning via Matrix Correctioncited by 6
- 2024Shadow-Free Membership Inference Attacks: Recommender Systems Are More Vulnerable Than You Thoughtcited by 6
- 2022On the Privacy Risks of Cell-Based NAS Architecturescited by 5
- 2022Finding MNEMON: Reviving Memories of Node Embeddingscited by 4
- 2023SecurityNet: Assessing Machine Learning Vulnerabilities on Public Modelscited by 4
- 2025Unlearning Inversion Attacks for Graph Neural Networkscited by 4
- 2025RecPS: Privacy Risk Scoring for Recommender Systemscited by 4
- 2022Adversarial Machine Learning Threat Analysis and Remediation in Open Radio Access Network (O-RAN)cited by 3
- 2022Privacy-preserving Generative Framework Against Membership Inference Attackscited by 3
- 2022Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Surveycited by 3
- 2023SoK: Comparing Different Membership Inference Attacks with a Comprehensive Benchmarkcited by 3
- 2023Private Matrix Factorization with Public Item Featurescited by 3
- 2025Membership Inference Attacks on Recommender System: A Surveycited by 3
- 2024Privacy in LLM-based Recommendation: Recent Advances and Future Directionscited by 2
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directionscited by 2
- 2024SoK: Security and Privacy Risks of Healthcare AIcited by 2
- 2025Membership Inference Attacks with False Discovery Rate Controlcited by 2
- 2025Are Neuro-Inspired Multi-Modal Vision-Language Models Resilient to Membership Inference Privacy Leakage?cited by 2
- 2022Data Provenance via Differential Auditingcited by 1
- 2022Data Leakage via Access Patterns of Sparse Features in Deep Learning-based Recommendation Systemscited by 1
- 2023Inferring Communities of Interest in Collaborative Learning-based Recommender Systemscited by 1
- 2023Defense Against Model Extraction Attacks on Recommender Systemscited by 1
- 2024On Active Privacy Auditing in Supervised Fine-tuning for White-Box Language Modelscited by 1
- 2024Hide in Plain Sight: Clean-Label Backdoor for Auditing Membership Inferencecited by 1
- 2025Learning to Attack: Uncovering Privacy Risks in Sequential Data Releasescited by 1
- 2025IndirectAD: Practical Data Poisoning Attacks against Recommender Systems for Item Promotioncited by 1
- 2026SoK: Challenges in Tabular Membership Inference Attackscited by 1
- 2026Attack by Unlearning: Unlearning-Induced Adversarial Attacks on Graph Neural Networkscited by 1
- 2022Membership Inference Attacks Against Latent Factor Modelcited by 0
50 most cited of 57 All 57 (JSON)
- 2026SoK: Rethinking Membership Inference in Tabular Machine Learning13 Oct 2026
- 2026Attacking and Defending Multi-Agent Collaborative Filtering Systems Through Connectivity4 Aug 2026
- 2026TRU: Targeted Reverse Update for Efficient Multimodal Recommendation Unlearning2 Apr 2026
- 2026Attack by Unlearning: Unlearning-Induced Adversarial Attacks on Graph Neural Networks19 Mar 2026
- 2026SoK: Challenges in Tabular Membership Inference Attacks22 Jan 2026
- 2025Are Neuro-Inspired Multi-Modal Vision-Language Models Resilient to Membership Inference Privacy Leakage?24 Nov 2025
- 2025Non-Rival Data as Rival Products: An Encapsulation-Forging Approach for Data Synthesis10 Nov 2025
- 2025IndirectAD: Practical Data Poisoning Attacks against Recommender Systems for Item Promotion8 Nov 2025
- 2025Learning to Attack: Uncovering Privacy Risks in Sequential Data Releases28 Oct 2025
- 2025Membership Inference Attacks on Recommender System: A Survey14 Sep 2025
- 2025Membership Inference Attacks on In-Context Examples in LLM-based Recommender Systems26 Aug 2025
- 2025Membership Inference Attacks with False Discovery Rate Control9 Aug 2025
38 more
- 2025RecPS: Privacy Risk Scoring for Recommender Systems24 Jul 2025
- 2025Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemble16 Jun 2025
- 2025Unlearning Inversion Attacks for Graph Neural Networks1 Jun 2025
- 2024Hide in Plain Sight: Clean-Label Backdoor for Auditing Membership Inference24 Nov 2024
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasures15 Nov 2024
- 2024On Active Privacy Auditing in Supervised Fine-tuning for White-Box Language Models11 Nov 2024
- 2024TDDBench: A Benchmark for Training data detection5 Nov 2024
- 2024SoK: Security and Privacy Risks of Healthcare AI11 Sep 2024
- 2024Is Difficulty Calibration All We Need? Towards More Practical Membership Inference Attacks31 Aug 2024
- 2024SeqMIA: Sequential-Metric Based Membership Inference Attack21 Jul 2024
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directions4 Jun 2024
- 2024Privacy in LLM-based Recommendation: Recent Advances and Future Directions3 Jun 2024
- 2024Shadow-Free Membership Inference Attacks: Recommender Systems Are More Vulnerable Than You Thought11 May 2024
- 2024Federated Graph Condensation with Information Bottleneck Principles7 May 2024
- 2023User Consented Federated Recommender System Against Personalized Attribute Inference Attack23 Dec 2023
- 2023Model Stealing Attack against Recommender System18 Dec 2023
- 2023Code Membership Inference for Detecting Unauthorized Data Use in Code Pre-trained Language Models12 Dec 2023
- 2023Practical Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration10 Nov 2023
- 2023Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Models30 Oct 2023
- 2023Defense Against Model Extraction Attacks on Recommender Systems25 Oct 2023
- 2023SecurityNet: Assessing Machine Learning Vulnerabilities on Public Models19 Oct 2023
- 2023Private Matrix Factorization with Public Item Features17 Sep 2023
- 2023Recommendation Unlearning via Matrix Correction29 Jul 2023
- 2023SoK: Comparing Different Membership Inference Attacks with a Comprehensive Benchmark12 Jul 2023
- 2023Overconfidence is a Dangerous Thing: Mitigating Membership Inference Attacks by Enforcing Less Confident Prediction4 Jul 2023
- 2023Inferring Communities of Interest in Collaborative Learning-based Recommender Systems15 Jun 2023
- 2023Machine Unlearning: A Survey6 Jun 2023
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learning21 Dec 2022
- 2022Membership Inference Attacks Against Latent Factor Model15 Dec 2022
- 2022Data Leakage via Access Patterns of Sparse Features in Deep Learning-based Recommendation Systems12 Dec 2022
- 2022LegoNet: A Fast and Exact Unlearning Architecture28 Oct 2022
- 2022Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey19 Oct 2022
- 2022A Comprehensive Survey on Trustworthy Recommender Systems21 Sep 2022
- 2022Membership Inference Attacks and Generalization: A Causal Perspective18 Sep 2022
- 2022M^4I: Multi-modal Models Membership Inference15 Sep 2022
- 2022On the Privacy Risks of Cell-Based NAS Architectures4 Sep 2022
- 2022Data Provenance via Differential Auditing4 Sep 2022
- 2022Membership Inference Attacks by Exploiting Loss Trajectory31 Aug 2022
50 newest of 57 All 57 (JSON)
- 2022Membership Inference Attacks by Exploiting Loss Trajectorycited by 101
- 2023Practical Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibrationcited by 98
- 2022M^4I: Multi-modal Models Membership Inferencecited by 34
- 2021Property Inference Attacks Against GANscited by 33
- 2023Overconfidence is a Dangerous Thing: Mitigating Membership Inference Attacks by Enforcing Less Confident Predictioncited by 29
- 2024SeqMIA: Sequential-Metric Based Membership Inference Attackcited by 23
- 2024Is Difficulty Calibration All We Need? Towards More Practical Membership Inference Attackscited by 21
- 2023Machine Unlearning: A Surveycited by 19
- 2022Membership Inference Attacks and Generalization: A Causal Perspectivecited by 17
- 2022Debiasing Learning for Membership Inference Attacks Against Recommender Systemscited by 12
- 2025Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemblecited by 11
- 2023Code Membership Inference for Detecting Unauthorized Data Use in Code Pre-trained Language Modelscited by 8
12 most cited of 26 All 26 (JSON)
- 2026SoK: Rethinking Membership Inference in Tabular Machine Learning13 Oct 2026
- 2026TRU: Targeted Reverse Update for Efficient Multimodal Recommendation Unlearning2 Apr 2026
- 2026SoK: Challenges in Tabular Membership Inference Attacks22 Jan 2026
- 2025IndirectAD: Practical Data Poisoning Attacks against Recommender Systems for Item Promotion8 Nov 2025
- 2025Membership Inference Attacks on Recommender System: A Survey14 Sep 2025
- 2025Membership Inference Attacks on In-Context Examples in LLM-based Recommender Systems26 Aug 2025
- 2025Membership Inference Attacks with False Discovery Rate Control9 Aug 2025
- 2025Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemble16 Jun 2025
- 2024TDDBench: A Benchmark for Training data detection5 Nov 2024
- 2024Is Difficulty Calibration All We Need? Towards More Practical Membership Inference Attacks31 Aug 2024
- 2024SeqMIA: Sequential-Metric Based Membership Inference Attack21 Jul 2024
- 2024Shadow-Free Membership Inference Attacks: Recommender Systems Are More Vulnerable Than You Thought11 May 2024
12 newest of 26 All 26 (JSON)
- 2022The Privacy Onion Effect: Memorization is Relativecited by 136
- 2022Recommendation Unlearningcited by 80
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 51
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasurescited by 11
- 2024Federated Graph Condensation with Information Bottleneck Principlescited by 8
- 2023User Consented Federated Recommender System Against Personalized Attribute Inference Attackcited by 7
- 2023Recommendation Unlearning via Matrix Correctioncited by 6
- 2022On the Privacy Risks of Cell-Based NAS Architecturescited by 5
- 2022Finding MNEMON: Reviving Memories of Node Embeddingscited by 4
- 2025Unlearning Inversion Attacks for Graph Neural Networkscited by 4
- 2025RecPS: Privacy Risk Scoring for Recommender Systemscited by 4
12 most cited of 28 All 28 (JSON)
- 2026Attack by Unlearning: Unlearning-Induced Adversarial Attacks on Graph Neural Networks19 Mar 2026
- 2025Non-Rival Data as Rival Products: An Encapsulation-Forging Approach for Data Synthesis10 Nov 2025
- 2025Learning to Attack: Uncovering Privacy Risks in Sequential Data Releases28 Oct 2025
- 2025RecPS: Privacy Risk Scoring for Recommender Systems24 Jul 2025
- 2025Unlearning Inversion Attacks for Graph Neural Networks1 Jun 2025
- 2024Hide in Plain Sight: Clean-Label Backdoor for Auditing Membership Inference24 Nov 2024
- 2024Model Inversion Attacks: A Survey of Approaches and Countermeasures15 Nov 2024
- 2024On Active Privacy Auditing in Supervised Fine-tuning for White-Box Language Models11 Nov 2024
- 2024SoK: Security and Privacy Risks of Healthcare AI11 Sep 2024
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directions4 Jun 2024
- 2024Privacy in LLM-based Recommendation: Recent Advances and Future Directions3 Jun 2024
- 2024Federated Graph Condensation with Information Bottleneck Principles7 May 2024
12 newest of 28 All 28 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Reference Recommendation based Membership Inference Attack against Hybrid-based Recommender Systems ↗
- 2025Membership Inference Attack against Large Language Model-based Recommendation Systems: A New Distillation-based Paradigm
- 2025RAID: An In-Training Defense against Attribute Inference Attacks in Recommender Systems
- 2026A Critical Review on the Effectiveness and Privacy Threats of Membership Inference Attacks
- 2026A Full-Pipeline Framework for Evaluating Membership Inference Attacks in Machine Learning
- 2023PORE: Provably Robust Recommender Systems against Data Poisoning Attacks
- 2021Data Poisoning Attacks to Deep Learning Based Recommender Systems
- 2023Making Users Indistinguishable: Attribute-wise Unlearning in Recommender Systems