mlsanityData to 14 Oct 2026

Robust Machine Unlearning for Quantized Neural Networks via Adaptive Gradient Reweighting with Similar Labels

arXiv 2503.13917 ↗First posted 18 Mar 2025cs.LGcited by 12

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Model quantization enables efficient deployment of deep neural networks on edge devices through low-bit parameter representation, yet raises critical challenges for implementing machine unlearning (MU) under data privacy regulations. Existing MU methods designed for full-precision models fail to address two fundamental limitations in quantized networks: 1) Noise amplification from label mismatch during data processing, and 2) Gradient imbalance between forgotten and retained data during training. These issues are exacerbated by quantized models' constrained parameter space and discrete optimization. We propose Q-MUL, the first dedicated unlearning framework for quantized models. Our method introduces two key innovations: 1) Similar Labels assignment replaces random labels with semantically consistent alternatives to minimize noise injection, and 2) Adaptive Gradient Reweighting dynamically aligns parameter update contributions from forgotten and retained data. Through systematic analysis of quantized model vulnerabilities, we establish theoretical foundations for these mechanisms. Extensive evaluations on benchmark datasets demonstrate Q-MUL's superiority over existing approaches.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 27 of its 31 references that are in the map. First posted on arXiv 18 Mar 2025.

Builds on

27 of 31 references.

Closest ancestors · 6

Same direction, newest first

  1. 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
  2. 2023Model Sparsity Can Simplify Machine Unlearning11 Apr
  3. 2022A Survey of Machine Unlearning6 Sep
  4. 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearning27 Sep
  5. 2021Machine Unlearning of Features and Labels26 Aug
  6. 2021Remember What You Want to Forget: Algorithms for Machine Unlearning4 Mar

Other references · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  4. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  5. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  6. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  7. 2019Machine Unlearningcited by 1,061
  8. 2019Learned Step Size Quantizationcited by 628
  9. 2020Up or Down? Adaptive Rounding for Post-Training Quantizationcited by 621
  10. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
  11. 2018PACT: Parameterized Clipping Activation for Quantized Neural Networkscited by 467
  12. 2019Making AI Forget You: Data Deletion in Machine Learningcited by 465
9 more
  1. 2020ZeroQ: A Novel Zero Shot Quantization Frameworkcited by 269
  2. 2020Approximate Data Deletion from Machine Learning Modelscited by 255
  3. 2019Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networkscited by 238
  4. 2020LSQ+: Improving low-bit quantization through learnable offsets and better initializationcited by 189
  5. 2020Generative Low-bitwidth Data Free Quantizationcited by 88
  6. 2020Post-Training Piecewise Linear Quantization for Deep Neural Networkscited by 79
  7. 2017Adaptive Quantization for Deep Neural Networkcited by 67
  8. 2021Diversifying Sample Generation for Accurate Data-Free Quantizationcited by 63
  9. 2022Certified Graph Unlearningcited by 46

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 9.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DurableUn: Quantization-Induced Recovery Attacks in Machine Unlearning
  2. 2026Forgetting That Sticks: Quantization-Permanent Unlearning via Circuit Attribution
  3. 2024MUSO: Achieving Exact Machine Unlearning in Over-Parameterized Regimes
  4. 2026Exact Unlearning via Quantized Sufficient Statistics
  5. 2026Quantization-Robust LLM Unlearning via Low-Rank Adaptation
  6. 2025LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertainty
  7. 2024Gradient-Free Training of Quantized Neural Networks
  8. 2021Fast Yet Effective Machine Unlearning