Faithful Dual-constrained Erasure for Robust LLM Safety Alignment
On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks
also in 1 more
Abstract (arXiv)
Machine unlearning has emerged as a crucial mechanism for removing hazardous knowledge and enforcing safety alignment in Large Language Models (LLMs). However, recent studies reveal a persistent security risk: unlearned models remain highly vulnerable to retraining attacks, where suppressed malicious behaviors rapidly resurface after benign fine-tuning. In this work, we investigate the optimization dynamics of unlearning and identify that this vulnerability stems from shallow alignment. Rather than effectively erasing target knowledge, models often exploit a shortcut by activating previously dormant parameters to act as spurious suppressors, forming a fragile inhibitory shell over intact malicious representations. To address this issue and enforce authentic memory deletion, we propose FDCU, a novel dual-constrained subspace projection framework. FDCU restricts parameter updates through a highly scalable, element-wise dual-masking rule: it preserves general knowledge manifolds via Fisher Information and strictly prohibits the abnormal activation of spurious suppressors via the Principle of Minimal Functional Intervention (PMFI). By reliably blocking the model's ability to superficially hide knowledge, FDCU promotes the authentic dismantling of target representations. Extensive experiments across specific knowledge erasure and safe output control tasks demonstrate that FDCU achieves state-of-the-art robustness against retraining attacks while maintaining near-lossless general utility, ensuring durable safety for LLMs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 22 of its 25 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
22 of 25 references.
Closest ancestors · 2
Same direction, newest first
- 2025Safety Alignment via Constrained Knowledge Unlearning24 May
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!5 Oct
Other references · 20
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2019Machine Unlearningcited by 1,061
- 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
- 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 437
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Modelscited by 261
- 2024Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearningcited by 84
- 2025OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metricscited by 83
- 2024Catastrophic Failure of LLM Unlearning via Quantizationcited by 81
- 2025Towards LLM Unlearning Resilient to Relearning Attacks: A Sharpness-Aware Minimization Perspective and Beyondcited by 79
- 2024Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledgecited by 51
8 more
- 2025Unlearning Isn't Deletion: Investigating Reversibility of Machine Unlearning in LLMscited by 42
- 2024Towards Robust and Parameter-Efficient Knowledge Unlearning for LLMscited by 36
- 2024Erasing Conceptual Knowledge from Language Modelscited by 34
- 2024Unified Parameter-Efficient Unlearning for LLMscited by 25
- 2025BLUR: A Bi-Level Optimization Approach for LLM Unlearningcited by 23
- 2025ReLearn: Unlearning via Learning for Large Language Modelscited by 22
- 2025Erase or Hide? Suppressing Spurious Unlearning Neurons for Robust Unlearningcited by 5
- 2025Collapse of Irrelevant Representations (CIR) Ensures Robust and Non-Disruptive LLM Unlearningcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Robust LLM Unlearning Against Relearning Attacks: The Minor Components in Representations Matter
- 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deep
- 2025CTRAP: Embedding Collapse Trap to Safeguard Large Language Models from Harmful Fine-Tuning
- 2025Reliable Unlearning Harmful Information in LLMs with Metamorphosis Representation Projection
- 2025SABER: Uncovering Vulnerabilities in Safety Alignment via Cross-Layer Residual Connection
- 2026Understanding and Preserving Safety in Fine-Tuned LLMs
- 2025LoX: Low-Rank Extrapolation Robustifies LLM Safety Against Fine-tuning
- 2026Aligned but Fragile: Enhancing LLM Safety Robustness via Zeroth-Order Optimization