Unlearning Is Not Just Erasing: Temporal Decoupling via Generation Inequality
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Large language models (LLMs) require effective unlearning to address privacy regulations and safety concerns. However, achieving precise forgetting without compromising general utility remains challenging. Existing sequence- and token-level methods penalize target outputs without modeling their context-dependent retrieval paths, which can disrupt linguistic structure or suppress benign knowledge. We present ADU, a fine-grained, training-based framework that shifts unlearning from token erasure to contextual attention-pathway decoupling. Exploiting the functional distinction between local and global attention heads, ADU identifies preplan positions that retrieve persistent sensitive anchors and fixes their candidate paths under the original model. It then trains attention-projection adapters to suppress attention mass along these paths while preserving local-attention structure and retain-set language modeling. Post-training activation exchange tests whether the modified attention-output module transmits the learned forgetting effect. ADU achieves the strongest aggregate performance among evaluated baselines on the TOFU and WMDP benchmarks, including a Forget Quality of (0.93) on TOFU. It preserves 87--98% of model utility (92.9% on average versus 81.9% for baselines) while reducing side effects in benign contexts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 21 of its 37 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
21 of 37 references.
Closest ancestors · 14
Same direction, newest first
- 2026CAP: Controllable Alignment Prompting for Unlearning in LLMs23 Apr
- 2026The Unlearning Mirage: A Dynamic Framework for Evaluating LLM Unlearning11 Mar
- 2026ALTER: Asymmetric LoRA for Token-Entropy-Guided Unlearning of LLMs2 Mar
- 2025Wisdom is Knowing What not to Say: Hallucination-Free LLMs Unlearning via Attention Shifting20 Oct
- 2025Agents Are All You Need for LLM Unlearning1 Feb
- 2024SEUF: Is Unlearning One Expert Enough for Mixture-of-Experts LLMs?27 Nov
- 2024CLIPErase: Efficient Unlearning of Visual-Textual Associations in CLIP30 Oct
- 2024LLM Unlearning via Loss Adjustment with Only Forget Data14 Oct
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Models8 Jul
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
- 2024Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models8 Feb
- 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
2 more
Other references · 7
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
- 2024Critical Tokens Matter: Token-Level Contrastive Estimation Enhances LLM's Reasoning Capabilitycited by 83
- 2024Large Language Model Safety: A Holistic Surveycited by 59
- 2024Unlearning Backdoor Attacks for LLMs with Weak-to-Strong Knowledge Distillationcited by 27
- 2024Exact and Efficient Unlearning for Large Language Model-based Recommendationcited by 17
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Attention Smoothing Is All You Need For Unlearning
- 2026Not Every Change Is Necessary: Recoverable Drift in Large Language Model Unlearning
- 2026Decouple to Forget: Semantic Mediation for Sensitive Unlearning in Large Language Models
- 2025Forget to Know, Remember to Use: Context-Aware Unlearning for Large Language Models
- 2026Learning What to Forget: Improving LLM Unlearning via Learned Token-Level Importance
- 2026Toward Fine-Grained Forgetting:Attribute Unlearning for Multimodal Large Language Models
- 2025Understanding the Dilemma of Unlearning for Large Language Models
- 2025Erasing Without Remembering: Implicit Knowledge Forgetting in Large Language Models