MAAT: Multi-phase Adapter-Aware Targeted Unlearning
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Machine unlearning evaluation is structurally skewed: Why-type questions, which probe causal and relational knowledge, comprise less than 0.06% of CounterFact, 0.6% of ZSRE, and less than 1.3% of TOFU, MUSE, and WMDP-Cyber. This near-zero representation means that methods that fail on causal knowledge can score highly in aggregate, and this failure is undetectable without balanced evaluation. We present 5WBENCH, a balanced 5,000-sample benchmark with 1,000 examples per 5W category (Who, What, When, Where, Why), making causal unlearning failures quantifiable for the first time. Using 5WBENCH, we show that no existing baseline simultaneously achieves high forgetting and high retention on Why-type questions: aggressive forgetting degrades retained knowledge, while conservative methods fail to forget causal facts. Why-type difficulty stems from multi-hop reasoning chains (44% of Why entries vs. less than or equal to 2% for others) and gradient dilution over 40.1-token answer spans. We present MAAT (Multi-phase Adapter-Aware Targeted Unlearning), a three-phase framework operating on LoRA adapter weights, combining gradient-projected ascent, SVD rank-dimension pruning, task vector negation, and hybrid KL-hidden-state retain repair. MAAT is the first method to simultaneously achieve high forgetting and high retention on Why-type causal knowledge, reaching a new operating point on the forget-retain Pareto frontier. We make our code publicly available.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 24 of its 41 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
24 of 41 references.
Closest ancestors · 13
Same direction, newest first
- 2025OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metrics14 Jun
- 2024Mechanistic Unlearning: Robust Knowledge Unlearning and Editing via Mechanistic Localization16 Oct
- 2024Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning9 Oct
- 2024Position: LLM Unlearning Benchmarks are Weak Measures of Progress3 Oct
- 2024Towards Robust and Parameter-Efficient Knowledge Unlearning for LLMs13 Aug
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Models8 Jul
- 2024Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearning19 Jun
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
- 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
- 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
- 2023Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampening15 Aug
- 2023KGA: A General Machine Unlearning Framework Based on Knowledge Gap Alignment11 May
1 more
Other references · 11
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 426
- 2024Improving Alignment and Robustness with Circuit Breakerscited by 322
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
- 2023FACTIFY-5WQA: 5W Aspect-based Fact Verification through Question Answeringcited by 24
- 2024Propagation and Pitfalls: Reasoning-based Assessment of Knowledge Editing through Counterfactual Taskscited by 24
- 2015The Singular Value Decomposition, Applications and Beyondcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skills
- 2026REDaCT: Collapse-Free Unlearning in Large Reasoning Models
- 2026Leak-Resistant Unlearning: A New Benchmark for Evaluating Multi-Hop Reasoning Consistency and Recovery Robustness
- 2026Making LLMs Truly Forget: Deep Unlearning by Searching, Selecting, and Severing Knowledge Paths
- 2026The Unlearning Mirage: A Dynamic Framework for Evaluating LLM Unlearning
- 2026GUARD: Natural Forgetting in Large Reasoning Models via Guided Answer-Reasoning Distillation
- 2025Towards Reasoning-Preserving Unlearning in Multimodal Large Language Models
- 2026Selective Forgetting for Large Reasoning Models