mlsanityData to 7 Oct 2026

DurableUn: Quantization-Induced Recovery Attacks in Machine Unlearning

arXiv 2605.02196 ↗First posted 4 May 2026cs.LGcited by 1

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Machine unlearning aims to remove specified training data to satisfy privacy regulations such as GDPR. However, existing evaluations assume identical precision at unlearning and deployment, overlooking that production LLMs are deployed at low-bit precision. We show that INT4 quantization systematically restores forgotten content even when models pass compliance audits at bfloat16 (BF16), we term this the quantization recovery attack (QRA). We conduct the first systematic study of unlearning robustness under adapter-space INT4 quantization in the NF4+LoRA regime, evaluating seven methods on LLaMA-3-8B-Instruct across TOFU, MUSE-News, and WikiBio-WPU. INT8 is benign; INT4 induces recovery of up to 22x, worsening with dataset difficulty. We identify the FA-RA-Q-INT4 trilemma: no method simultaneously achieves strong forgetting, high utility, and quantization robustness. A dense Pareto sweep reveals a sharp phase transition once robustness is achieved, retaining accuracy collapses regardless of further tuning. To address this, we propose DURABLEUN-SAF (Sharpness-Aware Forgetting), a quantization-aware objective using Straight-Through Estimator gradients through INT4 rounding. DURABLEUN-SAF is the only method to achieve a stable empirical (0.047, {BF16, INT8, INT4})- durability certificate: Q-INT4= 0.043 +- 0.002, cert rate= 3/3, versus SalUn's cert rate= 1/3 at its own published hyperparameters. We call for Q-INT4 to be adopted as a standard evaluation metric alongside FA and RA.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 42 of its 44 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

42 of 44 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025Rethinking LLM Unlearning Objectives: A Gradient Perspective and Go Beyond26 Feb
  2. 2024Catastrophic Failure of LLM Unlearning via Quantization21 Oct
  3. 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Models8 Jul
  4. 2024Avoiding Copyright Infringement via Large Language Model Unlearning16 Jun
  5. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
  6. 2024Inexact Unlearning Needs More Careful Evaluations to Avoid a False Sense of Privacy2 Mar
  7. 2024Eight Methods to Evaluate Robust Unlearning in LLMs26 Feb
  8. 2024Towards Safer Large Language Models through Machine Unlearning15 Feb
  9. 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
  10. 2023Unlearn What You Want to Forget: Efficient Unlearning for LLMs31 Oct
  11. 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
  12. 2023Large Language Model Unlearning14 Oct
7 more
  1. 2023In-Context Unlearning: Language Models as Few Shot Unlearners11 Oct
  2. 2023Who's Harry Potter? Approximate Unlearning in LLMs3 Oct
  3. 2023Machine Unlearning: Solutions and Challenges14 Aug
  4. 2023Towards Unbounded Machine Unlearning20 Feb
  5. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Models4 Oct
  6. 2022A Survey of Machine Unlearning6 Sep
  7. 2022Zero-Shot Machine Unlearning14 Jan

Other references · 23

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  4. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
  5. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  6. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  7. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
  8. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
  9. 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
  10. 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
  11. 2022Editing Models with Task Arithmeticcited by 1,076
  12. 2019Machine Unlearningcited by 1,020
11 more
  1. 2021Membership Inference Attacks From First Principlescited by 839
  2. 2019Learned Step Size Quantizationcited by 604
  3. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
  4. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 488
  5. 2016Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activationscited by 413
  6. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  7. 2020Amnesiac Machine Learningcited by 305
  8. 2020Descent-to-Delete: Gradient-Based Methods for Machine Unlearningcited by 303
  9. 2023SqueezeLLM: Dense-and-Sparse Quantizationcited by 285
  10. 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 224
  11. 2023Knowledge Sanitization of Large Language Modelscited by 34

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.