mlsanityData to 14 Oct 2026

Storage Is Not Strategy: State-Conditioned Support Control for LLM Unlearning

arXiv 2609.37858 ↗First posted 29 Sep 2026cs.LG cs.CLcited by 0

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Many localized large language model (LLM) unlearning methods select a small parameter subset from a localization signal and keep it fixed during optimization. The parameters most associated with a target, however, need not be the best ones to update, and candidate interventions can change value as optimization proceeds. In a controlled experiment, a storage-localization score reaches an area under the receiver operating characteristic curve (AUROC) of 0.981, yet storage identity agrees with the better intervention on only 17/36 targets, while low-rank adaptation (LoRA) wins 35/36. We introduce Intervention Score, which ranks editable groups by the predicted effect of the actual unlearning update while accounting for collateral damage, and use it to form the static intervention-value baseline (Static-IV). We then introduce selective dynamic intervention re-ranking (DIR-R), which revisits that subset only when a calibrated probe justifies the comparison. On the Natural-TOFU dataset, our method has positive descriptive margins in 19/20 comparisons between methods and objectives, although several are near zero. On the LACUNA localization-precision benchmark, our mean terminal utility is higher in all six negative preference optimization (NPO) and SimNPO comparisons: NPO margins range from +0.431 to +0.848, and SimNPO margins range from +0.503 to +0.571. The gradient-difference (GradDiff) objective reveals substantial field dependence. Relative to Static-IV, the primary four-field GradDiff evaluation has six wins, six ties, and no losses, with mean and median paired gains of +0.165 and +0.0025. The evidence supports separating localization, initial intervention selection, and checkpoint-dependent support revision.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 40 of its 43 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

40 of 43 references.

Closest ancestors · 23

Same direction, newest first

  1. 2026LACUNA: A Testbed for Evaluating Localization Precision for LLM Unlearning2 Jul
  2. 2025Does Localization Inform Unlearning? A Rigorous Examination of Local Parameter Attribution for Knowledge Unlearning in Language Models22 May
  3. 2025GRAIL: Gradient-Based Adaptive Unlearning for Privacy and Copyright in LLMs17 Apr
  4. 2025Towards LLM Unlearning Resilient to Relearning Attacks: A Sharpness-Aware Minimization Perspective and Beyond7 Feb
  5. 2024Unified Parameter-Efficient Unlearning for LLMs30 Nov
  6. 2024WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models23 Oct
  7. 2024Mechanistic Unlearning: Robust Knowledge Unlearning and Editing via Mechanistic Localization16 Oct
  8. 2024Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning9 Oct
  9. 2024Towards Robust and Parameter-Efficient Knowledge Unlearning for LLMs13 Aug
  10. 2024Revisiting Who's Harry Potter: Towards Targeted Unlearning from a Causal Intervention Perspective24 Jul
  11. 2024On Large Language Model Continual Unlearning14 Jul
  12. 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Models8 Jul
11 more
  1. 2024To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models2 Jul
  2. 2024Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearning19 Jun
  3. 2024Towards Effective Evaluations and Comparisons for LLM Unlearning Methods13 Jun
  4. 2024Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference12 Jun
  5. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
  6. 2024Machine Unlearning of Pre-trained Large Language Models23 Feb
  7. 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
  8. 2023Unlearn What You Want to Forget: Efficient Unlearning for LLMs31 Oct
  9. 2023In-Context Unlearning: Language Models as Few Shot Unlearners11 Oct
  10. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Models4 Oct
  11. 2021Remember What You Want to Forget: Algorithms for Machine Unlearning4 Mar

Other references · 17

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  5. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  6. 2019Machine Unlearningcited by 1,061
  7. 2022Mass-Editing Memory in a Transformercited by 1,001
  8. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
  9. 2021Editing Factual Knowledge in Language Modelscited by 553
  10. 2019Certified Data Removal from Machine Learning Modelscited by 535
  11. 2021Fast Model Editing at Scalecited by 498
  12. 2019Making AI Forget You: Data Deletion in Machine Learningcited by 465
5 more
  1. 2022Memory-Based Model Editing at Scalecited by 447
  2. 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 243
  3. 2024Knowledge Localization: Mission Not Accomplished? Enter Query Localization!cited by 13
  4. 2026Navigating by Old Maps: The Pitfalls of Static Mechanistic Localization in LLM Post-Trainingcited by 4
  5. 2023Exploring Federated Unlearning: Review, Comparison, and Insightscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Downgrade to Upgrade: Optimizer Simplification Enhances Robustness in LLM Unlearning
  2. 2026Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs
  3. 2025LLM Unlearning using Gradient Ratio-Based Influence Estimation and Noise Injection
  4. 2026De-attribute to Forget for LLM Unlearning
  5. 2026Null-Space Constrained Low-Rank Adaptation for Response-Specified Large Language Model Unlearning
  6. 2026Unlearning in LLMs: Methods, Evaluation, and Open Challenges
  7. 2026Representation-Guided Parameter-Efficient LLM Unlearning
  8. 2025Unlearning That Lasts: Utility-Preserving, Robust, and Almost Irreversible Forgetting in LLMs