Game-Theoretic Machine Unlearning: Mitigating Extra Privacy Leakage
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
With the extensive use of machine learning technologies, data providers encounter increasing privacy risks. Recent legislation, such as GDPR, obligates organizations to remove requested data and its influence from a trained model. Machine unlearning is an emerging technique designed to enable machine learning models to erase users' private information. Although several efficient machine unlearning schemes have been proposed, these methods still have limitations. First, removing the contributions of partial data may lead to model performance degradation. Second, discrepancies between the original and generated unlearned models can be exploited by attackers to obtain target sample's information, resulting in additional privacy leakage risks. To address above challenges, we proposed a game-theoretic machine unlearning algorithm that simulates the competitive relationship between unlearning performance and privacy protection. This algorithm comprises unlearning and privacy modules. The unlearning module possesses a loss function composed of model distance and classification error, which is used to derive the optimal strategy. The privacy module aims to make it difficult for an attacker to infer membership information from the unlearned data, thereby reducing the privacy leakage risk during the unlearning process. Additionally, the experimental results on real-world datasets demonstrate that this game-theoretic unlearning algorithm's effectiveness and its ability to generate an unlearned model with a performance similar to that of the retrained one while mitigating extra privacy leakage risks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 35 of its 46 references that are in the map. First posted on arXiv 6 Nov 2024.
Builds on
35 of 46 references.
Closest ancestors · 17
Same direction, newest first
- 2024Distribution-Level Feature Distancing for Machine Unlearning: Towards a Better Trade-off Between Model Utility and Forgetting23 Sep
- 2024Towards Robust Knowledge Unlearning: An Adversarial Framework for Assessing and Improving Unlearning Robustness in Large Language Models20 Aug
- 2024Don't Forget Too Much: Towards Machine Unlearning on Feature Level16 Jun
- 2024Adversarial Machine Unlearning11 Jun
- 2024A Survey on Machine Unlearning: Techniques and New Emerged Privacy Risks10 Jun
- 2024Learn What You Want to Unlearn: Unlearning Inversion Attacks against Machine Unlearning4 Apr
- 2024Machine unlearning through fine-grained model parameters perturbation9 Jan
- 2023Layer Attack Unlearning: Fast and Accurate Machine Unlearning via Layer Level Attack and Knowledge Distillation28 Dec
- 2023Boundary Unlearning21 Mar
- 2023Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifiers27 Jan
- 2022Forget Unlearning: Towards True Data-Deletion in Machine Learning17 Oct
- 2022Deep Regression Unlearning15 Oct
5 more
- 2022Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks using an Incompetent Teacher17 May
- 2022Deletion Inference, Reconstruction, and Compliance in Machine (Un)Learning7 Feb
- 2022Zero-Shot Machine Unlearning14 Jan
- 2021Fast Yet Effective Machine Unlearning17 Nov
- 2021Lightweight machine unlearning in neural network10 Nov
Other references · 18
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2019Machine Unlearningcited by 1,061
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
- 2019Certified Data Removal from Machine Learning Modelscited by 535
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 465
- 2014New insights and perspectives on the natural gradient methodcited by 443
- 2020Amnesiac Machine Learningcited by 319
- 2020Approximate Data Deletion from Machine Learning Modelscited by 255
- 2020When Machine Unlearning Jeopardizes Privacycited by 198
- 2019MemGuard: Defending against Black-Box Membership Inference Attacks via Adversarial Examplescited by 197
- 2020Mixed-Privacy Forgetting in Deep Networkscited by 163
6 more
- 2021Graph Unlearningcited by 138
- 2020Machine Unlearning: Linear Filtration for Logit-based Classifierscited by 95
- 2021ML-Doctor: Holistic Risk Assessment of Inference Attacks Against Machine Learning Modelscited by 85
- 2022Federated Unlearning with Knowledge Distillationcited by 73
- 2023Inductive Graph Unlearningcited by 31
- 2024Update Selective Parameters: Federated Machine Unlearning Based on Model Explanationcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Learn to Unlearn: A Survey on Machine Unlearning
- 2024Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearning
- 2026Revisiting Privacy Leakage in Machine Unlearning: Membership Inference Beyond the Forgotten Set
- 2022A Survey of Machine Unlearning
- 2024A Review on Machine Unlearning
- 2023Machine Unlearning: Solutions and Challenges
- 2025Privacy Preservation through Practical Machine Unlearning
- 2025How Secure is Forgetting? Linking Machine Unlearning to Machine Learning Attacks