Robust Machine Unlearning for Quantized Neural Networks via Adaptive Gradient Reweighting with Similar Labels
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Model quantization enables efficient deployment of deep neural networks on edge devices through low-bit parameter representation, yet raises critical challenges for implementing machine unlearning (MU) under data privacy regulations. Existing MU methods designed for full-precision models fail to address two fundamental limitations in quantized networks: 1) Noise amplification from label mismatch during data processing, and 2) Gradient imbalance between forgotten and retained data during training. These issues are exacerbated by quantized models' constrained parameter space and discrete optimization. We propose Q-MUL, the first dedicated unlearning framework for quantized models. Our method introduces two key innovations: 1) Similar Labels assignment replaces random labels with semantically consistent alternatives to minimize noise injection, and 2) Adaptive Gradient Reweighting dynamically aligns parameter update contributions from forgotten and retained data. Through systematic analysis of quantized model vulnerabilities, we establish theoretical foundations for these mechanisms. Extensive evaluations on benchmark datasets demonstrate Q-MUL's superiority over existing approaches.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 27 of its 31 references that are in the map. First posted on arXiv 18 Mar 2025.
Builds on
27 of 31 references.
Closest ancestors · 6
Same direction, newest first
- 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
- 2023Model Sparsity Can Simplify Machine Unlearning11 Apr
- 2022A Survey of Machine Unlearning6 Sep
- 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearning27 Sep
- 2021Machine Unlearning of Features and Labels26 Aug
- 2021Remember What You Want to Forget: Algorithms for Machine Unlearning4 Mar
Other references · 21
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2019Machine Unlearningcited by 1,061
- 2019Learned Step Size Quantizationcited by 628
- 2020Up or Down? Adaptive Rounding for Post-Training Quantizationcited by 621
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
- 2018PACT: Parameterized Clipping Activation for Quantized Neural Networkscited by 467
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 465
9 more
- 2020ZeroQ: A Novel Zero Shot Quantization Frameworkcited by 269
- 2020Approximate Data Deletion from Machine Learning Modelscited by 255
- 2019Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networkscited by 238
- 2020LSQ+: Improving low-bit quantization through learnable offsets and better initializationcited by 189
- 2020Generative Low-bitwidth Data Free Quantizationcited by 88
- 2020Post-Training Piecewise Linear Quantization for Deep Neural Networkscited by 79
- 2017Adaptive Quantization for Deep Neural Networkcited by 67
- 2021Diversifying Sample Generation for Accurate Data-Free Quantizationcited by 63
- 2022Certified Graph Unlearningcited by 46
Built on by
Citing papers per year: 2025: 3; 2026: 9.
12 papers.
- 2026SAGE: Accelerating Vision-Language Models via Entropy-Guided Adaptive Speculative Decodingcited by 4
- 2025LetheViT: Selective Machine Unlearning for Vision Transformers via Attention-Guided Contrastive Learningcited by 3
- 2026Forget by Uncertainty: Orthogonal Entropy Unlearning for Quantized Neural Networkscited by 3
- 2025Machine Unlearning in the Era of Quantum Machine Learning: An Empirical Studycited by 2
- 2026CATA: Continual Machine Unlearning via Conflict-Averse Task Arithmeticcited by 2
- 2026Does Compression Preserve Uncertainty? A Unified Benchmark for Quantized and Sparse LLMs via Conformal Predictioncited by 2
- 2026QUAIL: Quantization Aware Unlearning for Mitigating Misinformation in LLMscited by 1
- 2026A Note on Stability for Orthogonalized Matrix Momentum with Client Samplingcited by 1
- 2026Quantization-Robust Unlearning through the Lens of Retain-Forget Loss Landscapes Interactioncited by 1
- 2025FiCABU: A Fisher-Based, Context-Adaptive Machine Unlearning Processor for Edge AIcited by 0
- 2026SAU: Sparsity-Aware Unlearning for LLMs via Gradient Masking and Importance Redistributioncited by 0
- 2026TRACE: Transition-Aware Residual Control for Multi-Objective Materials Discoverycited by 0
- 2026Quantization-Robust Unlearning through the Lens of Retain-Forget Loss Landscapes Interaction23 Sep 2026
- 2026TRACE: Transition-Aware Residual Control for Multi-Objective Materials Discovery23 Aug 2026
- 2026Does Compression Preserve Uncertainty? A Unified Benchmark for Quantized and Sparse LLMs via Conformal Prediction1 Jun 2026
- 2026A Note on Stability for Orthogonalized Matrix Momentum with Client Sampling1 Jun 2026
- 2026CATA: Continual Machine Unlearning via Conflict-Averse Task Arithmetic18 May 2026
- 2026SAU: Sparsity-Aware Unlearning for LLMs via Gradient Masking and Importance Redistribution31 Jan 2026
- 2026Forget by Uncertainty: Orthogonal Entropy Unlearning for Quantized Neural Networks31 Jan 2026
- 2026SAGE: Accelerating Vision-Language Models via Entropy-Guided Adaptive Speculative Decoding31 Jan 2026
- 2026QUAIL: Quantization Aware Unlearning for Mitigating Misinformation in LLMs21 Jan 2026
- 2025Machine Unlearning in the Era of Quantum Machine Learning: An Empirical Study22 Dec 2025
- 2025FiCABU: A Fisher-Based, Context-Adaptive Machine Unlearning Processor for Edge AI6 Nov 2025
- 2025LetheViT: Selective Machine Unlearning for Vision Transformers via Attention-Guided Contrastive Learning3 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026DurableUn: Quantization-Induced Recovery Attacks in Machine Unlearning
- 2026Forgetting That Sticks: Quantization-Permanent Unlearning via Circuit Attribution
- 2024MUSO: Achieving Exact Machine Unlearning in Over-Parameterized Regimes
- 2026Exact Unlearning via Quantized Sufficient Statistics
- 2026Quantization-Robust LLM Unlearning via Low-Rank Adaptation
- 2025LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertainty
- 2024Gradient-Free Training of Quantized Neural Networks
- 2021Fast Yet Effective Machine Unlearning