DualEdit: Mitigating Safety Fallback in LLM Backdoor Editing via Affirmation-Refusal Regulation
On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks
also in 1 more
Abstract (arXiv)
Safety-aligned large language models (LLMs) remain vulnerable to backdoor attacks. Recent model editing-based approaches enable efficient backdoor injection by directly modifying a small set of parameters to map triggers to attacker-desired behaviors. However, we find that existing editing-based attacks are often unstable under safety alignment: the edited model may start with an affirmative prefix but later revert to refusals during generation. We term this phenomenon safety fallback. To mitigate it, we propose DualEdit, a dual-objective model editing framework that simultaneously promotes affirmative tokens and suppresses refusal tokens. DualEdit further addresses two key challenges, objective imbalance and refusal diversity, via two complementary techniques: (1) dynamic loss weighting, which calibrates the relative scales of the two objectives using the pre-edited model to stabilize optimization, and (2) value anchoring, which clusters representative attention value vectors to form compact anchors, reducing conflicts from overly diverse token sets and improving generalization. Experiments on safety-aligned LLMs show that DualEdit improves attack success by 10% and reduces safety fallback rate by 11% over baselines.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 32 of its 38 references that are in the map. First posted on arXiv 16 Jun 2025.
Builds on
32 of 38 references.
Closest ancestors · 3
Same direction, newest first
- 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deep10 Jun
- 2023Universal Jailbreak Backdoors from Poisoned Human Feedback24 Nov
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
Other references · 29
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
- 2022Mass-Editing Memory in a Transformercited by 976
- 2021Fast Model Editing at Scalecited by 491
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 457
- 2022Memory-Based Model Editing at Scalecited by 443
- 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
17 more
- 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
- 2023Poisoning Language Models During Instruction Tuningcited by 254
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 224
- 2023Transformer-Patcher: One Mistake worth One Neuroncited by 196
- 2023Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMscited by 176
- 2023Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injectioncited by 143
- 2023Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Modelscited by 100
- 2024Improved Techniques for Optimization-Based Jailbreaking on Large Language Modelscited by 98
- 2024WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Modelscited by 90
- 2024BadEdit: Backdooring large language models by model editingcited by 84
- 2021Think you have Solved Direct-Answer Question Answering? Try ARC-DA, the Direct-Answer AI2 Reasoning Challengecited by 79
- 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 74
- 2023BadGPT: Exploring Security Vulnerabilities of ChatGPT via Backdoor Attacks to InstructGPTcited by 70
- 2024Decoding by Contrasting Knowledge: Enhancing LLMs' Confidence on Edited Factscited by 36
- 2025Reinforced Lifelong Editing for Language Modelscited by 33
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learningcited by 17
- 2025Injecting Universal Jailbreak Backdoors into LLMs in Minutescited by 13
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Contrastive Weak-to-strong Generalizationcited by 2
- 2025Contrastive Weak-to-strong Generalization9 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025From Threat to Tool: Leveraging Refusal-Aware Injection Attacks for Safety Alignment
- 2025Improving LLM Safety Alignment with Dual-Objective Optimization
- 2026Compiling Activation Steering into Weights via Null-Space Constraints for Stealthy Backdoors
- 2025Beyond Surface Alignment: Rebuilding LLMs Safety Mechanism via Probabilistically Ablating Refusal Direction
- 2025Decoding One Safety Trigger Token for Balancing Safety and Usability in Large Language Models
- 2026Minionese: Comprehensive Benchmark and Mechanistic Study of Multilingual LLM Safety
- 2026Understanding the Effects of Safety Unalignment on Large Language Models
- 2026Deactivating Refusal Triggers: Understanding and Mitigating Overrefusal in Safety Alignment