Storage Is Not Strategy: State-Conditioned Support Control for LLM Unlearning
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Many localized large language model (LLM) unlearning methods select a small parameter subset from a localization signal and keep it fixed during optimization. The parameters most associated with a target, however, need not be the best ones to update, and candidate interventions can change value as optimization proceeds. In a controlled experiment, a storage-localization score reaches an area under the receiver operating characteristic curve (AUROC) of 0.981, yet storage identity agrees with the better intervention on only 17/36 targets, while low-rank adaptation (LoRA) wins 35/36. We introduce Intervention Score, which ranks editable groups by the predicted effect of the actual unlearning update while accounting for collateral damage, and use it to form the static intervention-value baseline (Static-IV). We then introduce selective dynamic intervention re-ranking (DIR-R), which revisits that subset only when a calibrated probe justifies the comparison. On the Natural-TOFU dataset, our method has positive descriptive margins in 19/20 comparisons between methods and objectives, although several are near zero. On the LACUNA localization-precision benchmark, our mean terminal utility is higher in all six negative preference optimization (NPO) and SimNPO comparisons: NPO margins range from +0.431 to +0.848, and SimNPO margins range from +0.503 to +0.571. The gradient-difference (GradDiff) objective reveals substantial field dependence. Relative to Static-IV, the primary four-field GradDiff evaluation has six wins, six ties, and no losses, with mean and median paired gains of +0.165 and +0.0025. The evidence supports separating localization, initial intervention selection, and checkpoint-dependent support revision.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 40 of its 43 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
40 of 43 references.
Closest ancestors · 23
Same direction, newest first
- 2026LACUNA: A Testbed for Evaluating Localization Precision for LLM Unlearning2 Jul
- 2025Does Localization Inform Unlearning? A Rigorous Examination of Local Parameter Attribution for Knowledge Unlearning in Language Models22 May
- 2025GRAIL: Gradient-Based Adaptive Unlearning for Privacy and Copyright in LLMs17 Apr
- 2025Towards LLM Unlearning Resilient to Relearning Attacks: A Sharpness-Aware Minimization Perspective and Beyond7 Feb
- 2024Unified Parameter-Efficient Unlearning for LLMs30 Nov
- 2024WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models23 Oct
- 2024Mechanistic Unlearning: Robust Knowledge Unlearning and Editing via Mechanistic Localization16 Oct
- 2024Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning9 Oct
- 2024Towards Robust and Parameter-Efficient Knowledge Unlearning for LLMs13 Aug
- 2024Revisiting Who's Harry Potter: Towards Targeted Unlearning from a Causal Intervention Perspective24 Jul
- 2024On Large Language Model Continual Unlearning14 Jul
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Models8 Jul
11 more
- 2024To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models2 Jul
- 2024Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearning19 Jun
- 2024Towards Effective Evaluations and Comparisons for LLM Unlearning Methods13 Jun
- 2024Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference12 Jun
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
- 2024Machine Unlearning of Pre-trained Large Language Models23 Feb
- 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
- 2023Unlearn What You Want to Forget: Efficient Unlearning for LLMs31 Oct
- 2023In-Context Unlearning: Language Models as Few Shot Unlearners11 Oct
- 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Models4 Oct
- 2021Remember What You Want to Forget: Algorithms for Machine Unlearning4 Mar
Other references · 17
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2019Machine Unlearningcited by 1,061
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
- 2021Editing Factual Knowledge in Language Modelscited by 553
- 2019Certified Data Removal from Machine Learning Modelscited by 535
- 2021Fast Model Editing at Scalecited by 498
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 465
5 more
- 2022Memory-Based Model Editing at Scalecited by 447
- 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 243
- 2024Knowledge Localization: Mission Not Accomplished? Enter Query Localization!cited by 13
- 2026Navigating by Old Maps: The Pitfalls of Static Mechanistic Localization in LLM Post-Trainingcited by 4
- 2023Exploring Federated Unlearning: Review, Comparison, and Insightscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Downgrade to Upgrade: Optimizer Simplification Enhances Robustness in LLM Unlearning
- 2026Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs
- 2025LLM Unlearning using Gradient Ratio-Based Influence Estimation and Noise Injection
- 2026De-attribute to Forget for LLM Unlearning
- 2026Null-Space Constrained Low-Rank Adaptation for Response-Specified Large Language Model Unlearning
- 2026Unlearning in LLMs: Methods, Evaluation, and Open Challenges
- 2026Representation-Guided Parameter-Efficient LLM Unlearning
- 2025Unlearning That Lasts: Utility-Preserving, Robust, and Almost Irreversible Forgetting in LLMs