Backdoor Unlearning Generalization: A Path Toward the Removal of Unknown Triggers in LLMs
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
Backdoor attacks in Large Language Models (LLMs) are a growing security concern, where models can generate adversary-chosen content. Existing defenses target backdoors one at a time and typically require knowledge of the trigger, leaving the defender at a structural disadvantage when unknown backdoors may exist in a model. We show that backdoor neutralization through unlearning generalizes across backdoors: training a model to ignore a single trigger can also suppress other backdoors that were never explicitly targeted. We study this phenomenon across three model families, whose backdoors were injected via pretraining or continual pretraining, by analyzing the models obtained after removing one backdoor at a time. To understand why unlearning certain backdoors induces the suppression of others, we introduce the Cross Activation Shift Distance, to quantify the distance between model changes induced by different trainings. Our results open a new direction for LLM safety as defenders could deliberately inject controlled backdoors and then remove them, leveraging cross-backdoor transfer to also suppress unknown backdoors that an attacker may have previously introduced in the model.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 24 of its 39 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
24 of 39 references.
Closest ancestors · 10
Same direction, newest first
- 2026Language-Switching Triggers Take a Latent Detour Through Language Models18 May
- 2026Purifying Generative LLMs from Backdoors without Prior Knowledge or Clean Reference13 Mar
- 2026Language Triggers Hijack Language Circuits: A Mechanistic Analysis of Backdoor Behaviors in Large Language Models11 Feb
- 2025Poisoning Attacks on LLMs Require a Near-constant Number of Poison Samples8 Oct
- 2025P2P: A Poison-to-Poison Remedy for Reliable Backdoor Defense in LLMs6 Oct
- 2025Backdoor Attribution: Elucidating and Controlling Backdoor in Language Models26 Sep
- 2025Mechanistic Exploration of Backdoored Large Language Model Attention Patterns19 Aug
- 2024Scaling Trends for Data Poisoning in LLMs6 Aug
- 2023Setting the Trap: Capturing and Defeating Backdoors in Pretrained Language Models through Honeypots28 Oct
- 2023Analyzing And Editing Inner Mechanisms Of Backdoored Language Models24 Feb
Other references · 14
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
- 2022In-context Learning and Induction Headscited by 964
- 2016Bag of Tricks for Efficient Text Classificationcited by 876
- 2023Poisoning Language Models During Instruction Tuningcited by 269
- 2021Anti-Backdoor Learning: Training Clean Models on Poisoned Datacited by 263
- 2022TweetNLP: Cutting-Edge Natural Language Processing for Social Mediacited by 71
- 2025Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuningcited by 34
- 2025Narrow Finetuning Leaves Clearly Readable Traces in Activation Differencescited by 28
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Dummy Backdoor as a Defense: Removing Unknown Backdoors via Shared Internal Mechanisms for Generative LLMs
- 2026Merging Triggers, Breaking Backdoors: Defensive Poisoning for Instruction-Tuned Language Models
- 2025From Poisoned to Aware: Fostering Backdoor Self-Awareness in LLMs
- 2026Removing the NEEDLE in the Haystack: Backdoor Removal in LLMs via Weight Orthogonalisation
- 2024Neutralizing Backdoors through Information Conflicts for Large Language Models
- 2025Backdoor Token Unlearning: Exposing and Defending Backdoors in Pretrained Language Models
- 2025Backdoor Collapse: Eliminating Unknown Threats via Known Backdoor Aggregation in Language Models
- 2025Forgetting to Forget: Attention Sink as A Gateway for Backdooring LLM Unlearning