Shadow Unlearning: A Neuro-Semantic Approach to Fidelity-Preserving Faceless Forgetting in LLMs
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Machine unlearning aims to selectively remove the influence of specific training samples to satisfy privacy regulations such as the GDPR's 'Right to be Forgotten'. However, many existing methods require access to the data being removed, exposing it to membership inference attacks and potential misuse of Personally Identifiable Information (PII). We address this critical challenge by proposing Shadow Unlearning, a novel paradigm of approximate unlearning, that performs machine unlearning on anonymized forget data without exposing PII. We further propose a novel privacy-preserving framework, Neuro-Semantic Projector Unlearning (NSPU) to achieve Shadow unlearning. To evaluate our method, we compile Multi-domain Fictitious Unlearning (MuFU) forget set across five diverse domains and introduce an evaluation stack to quantify the trade-off between knowledge retention and unlearning effectiveness. Experimental results on various LLMs show that NSPU achieves superior unlearning performance, preserves model utility, and enhances user privacy. Additionally, the proposed approach is at least 10x more computationally efficient than standard unlearning approaches. Our findings foster a new direction for privacy-aware machine unlearning that balances data protection and model fidelity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 62 of its 81 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
62 of 81 references.
Closest ancestors · 36
Same direction, newest first
- 2025LUNE: Efficient LLM Unlearning via LoRA Fine-Tuning with Negative Examples8 Dec
- 2025Efficient Unlearning with Privacy Guarantees7 Jul
- 2025How Secure is Forgetting? Linking Machine Unlearning to Machine Learning Attacks26 Mar
- 2024A Closer Look at Machine Unlearning for Large Language Models10 Oct
- 2024Towards Robust and Parameter-Efficient Knowledge Unlearning for LLMs13 Aug
- 2024On the Limitations and Prospects of Machine Unlearning for Generative AI1 Aug
- 2024Learn while Unlearn: An Iterative Unlearning Framework for Generative Language Models25 Jul
- 2024To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models2 Jul
- 2024Soft Prompting for Unlearning in Large Language Models17 Jun
- 2024Avoiding Copyright Infringement via Large Language Model Unlearning16 Jun
- 2024Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference12 Jun
- 2024Large Language Model Unlearning via Embedding-Corrupted Prompts12 Jun
24 more
- 2024SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning28 Apr
- 2024Offset Unlearning for Large Language Models17 Apr
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
- 2024Learn What You Want to Unlearn: Unlearning Inversion Attacks against Machine Unlearning4 Apr
- 2024Threats, Attacks, and Defenses in Machine Unlearning: A Survey20 Mar
- 2024Second-Order Information Matters: Revisiting Machine Unlearning for Large Language Models13 Mar
- 2024Machine Unlearning: Taxonomy, Metrics, Applications, Challenges, and Prospects13 Mar
- 2024Machine Unlearning of Pre-trained Large Language Models23 Feb
- 2024Towards Safer Large Language Models through Machine Unlearning15 Feb
- 2024Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models8 Feb
- 2024Fast Exact Unlearning for In-Context Learning Data for LLMs1 Feb
- 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
- 2023Breaking the Trilemma of Privacy, Utility, Efficiency via Controllable Machine Unlearning28 Oct
- 2023Large Language Model Unlearning14 Oct
- 2023In-Context Unlearning: Language Models as Few Shot Unlearners11 Oct
- 2023Who's Harry Potter? Approximate Unlearning in LLMs3 Oct
- 2023Machine Unlearning: Solutions and Challenges14 Aug
- 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Models4 Oct
- 2022A Survey of Machine Unlearning6 Sep
- 2022Continual Learning and Private Unlearning24 Mar
- 2022Deletion Inference, Reconstruction, and Compliance in Machine (Un)Learning7 Feb
- 2022Zero-Shot Machine Unlearning14 Jan
- 2021On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning22 Oct
- 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearning27 Sep
Other references · 26
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Mistral 7Bcited by 3,164
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2019Machine Unlearningcited by 1,061
14 more
- 2021Membership Inference Attacks From First Principlescited by 878
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 465
- 2024OLMoE: Open Mixture-of-Experts Language Modelscited by 301
- 2020Approximate Data Deletion from Machine Learning Modelscited by 255
- 2020When Machine Unlearning Jeopardizes Privacycited by 198
- 2020Machine Unlearning for Random Forestscited by 131
- 2022The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retrainingcited by 118
- 2024LLM Dataset Inference: Did you train on my dataset?cited by 110
- 2023A Survey on Federated Unlearning: Challenges, Methods, and Future Directionscited by 63
- 2024Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledgecited by 51
- 2023Knowledge Sanitization of Large Language Modelscited by 37
- 2022Towards Verifiable Federated Learningcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Machine Unlearning using Forgetting Neural Networks
- 2026PrivUn: Unveiling Latent Ripple Effects and Shallow Forgetting in Privacy Unlearning
- 2025Towards Benchmarking Privacy Vulnerabilities in Selective Forgetting with Large Language Models
- 2025Unlearning Imperative: Securing Trustworthy and Responsible LLMs through Engineered Forgetting
- 2024Machine unlearning through fine-grained model parameters perturbation
- 2026UnPII: Unlearning Personally Identifiable Information with Quantifiable Exposure Risk
- 2023Towards Unbounded Machine Unlearning
- 2025Towards Reliable Forgetting: A Survey on Machine Unlearning Verification