Backdoor Containment via Expert Quarantine and Shutdown in LLMs
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
Backdoored large language models (LLMs) can behave normally on benign inputs while producing attacker-specified outputs under hidden triggers. Existing defenses span four stages--prior-training, in-training, post-training, and inference-time--and share one of two underlying strategies: either suppress backdoor learning (by filtering poisoned data or interrupting its acquisition during optimization) or learn, then purify (by repairing model weights or gating inputs after a fully backdoored model has formed). We propose a third strategy, learn, but channel: allow backdoor formation during training but route it into a designated, quarantined component that can be disabled at deployment. To this end, we propose Quarantined Expert Shutdown QES, a computationally efficient containment strategy built in a regularization-steered MoE-like setting. Specifically, given a poisoned dataset, QES augments a Transformer-based language model with routed expert-specific LoRA branches and lightweight routers, and uses auxiliary routing objectives to attract trigger-conditioned behavior into a designated expert while preserving benign capability elsewhere. At deployment, mitigation reduces to a single constant-time operation: zeroing the quarantined expert's routing weight, without trigger screening or further updating model weights. Empirically, our methods reduce the attack success rate ASR from 100% to 0-10% on most settings across two tasks, three attacks, and four model families, while downstream utility is often preserved or only modestly affected. These results establish learn, but channel as a previously unexplored regime for backdoor containment in generative LLMs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 75 of its 87 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
75 of 87 references.
Closest ancestors · 21
Same direction, newest first
- 2026Purifying Generative LLMs from Backdoors without Prior Knowledge or Clean Reference13 Mar
- 2024CROW: Eliminating Backdoors from Large Language Models via Internal Consistency Regularization18 Nov
- 2024Unlearning Backdoor Attacks for LLMs with Weak-to-Strong Knowledge Distillation18 Oct
- 2024BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Models23 Aug
- 2024CleanGen: Mitigating Backdoor Attacks for Generation Tasks in Large Language Models18 Jun
- 2024A Survey of Recent Backdoor Attacks and Defenses in Large Language Models10 Jun
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training10 Jan
- 2023Attention-Enhancing Backdoor Attacks Against BERT-based Models23 Oct
- 2023Composite Backdoor Attacks Against Large Language Models11 Oct
- 2023Defending Pre-trained Language Models as Few-shot Learners against Backdoor Attacks23 Sep
- 2023Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection31 Jul
- 2023Backdoor Attacks for In-Context Learning with Language Models27 Jul
9 more
- 2023On the Exploitability of Instruction Tuning28 Jun
- 2023Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Models2 May
- 2023Analyzing And Editing Inner Mechanisms Of Backdoored Language Models24 Feb
- 2022Fine-mixing: Mitigating Backdoors in Fine-tuned Language Models18 Oct
- 2022Kallima: A Clean-label Framework for Textual Backdoor Attacks3 Jun
- 2022BITE: Textual Backdoor Attacks with Iterative Trigger Injection25 May
- 2022Constrained Optimization with Dynamic Bound-scaling for Effective NLPBackdoor Defense11 Feb
- 2021Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasures9 Dec
- 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger26 May
Other references · 54
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2023Mistral 7Bcited by 3,065
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2016Pointer Sentinel Mixture Modelscited by 2,992
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
38 more
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
- 2016Deep Learning with Differential Privacycited by 2,682
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
- 2024Qwen2 Technical Reportcited by 2,076
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 876
- 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
- 2018Spectral Signatures in Backdoor Attackscited by 457
- 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 437
- 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 429
- 2020Backdoor Learning: A Surveycited by 412
- 2020Weight Poisoning Attacks on Pre-trained Modelscited by 318
- 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 313
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
- 2021Anti-Backdoor Learning: Training Clean Models on Poisoned Datacited by 258
- 2023Poisoning Language Models During Instruction Tuningcited by 254
- 2020ONION: A Simple and Effective Defense Against Textual Backdoor Attackscited by 231
- 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 230
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 224
- 2019A backdoor attack against LSTM-based text classification systemscited by 214
- 2020BadNL: Backdoor Attacks against NLP Models with Semantic-preserving Improvementscited by 191
- 2024Mixture of LoRA Expertscited by 179
- 2020Blind Backdoors in Deep Learning Modelscited by 174
- 2022Backdoor Defense via Decoupling the Training Processcited by 149
- 2023Universal Jailbreak Backdoors from Poisoned Human Feedbackcited by 120
- 2020Mitigating backdoor attacks in LSTM-based Text Classification Systems by Backdoor Keyword Identificationcited by 80
- 2022A Study of the Attention Abnormality in Trojaned BERTscited by 47
- 2022Training with More Confidence: Mitigating Injected and Natural Backdoors During Trainingcited by 38
- 2023The Philosopher's Stone: Trojaning Plugins of Large Language Modelscited by 31
- 2023TrojLLM: A Black-box Trojan Prompt Attack on Large Language Modelscited by 29
- 2018QuSecNets: Quantization-based Defense Mechanism for Securing Deep Neural Network against Adversarial Attackscited by 21
- 2023Backdoor Learning on Sequence to Sequence Modelscited by 19
- 2024Shortcuts Everywhere and Nowhere: Exploring Multi-Trigger Backdoor Attackscited by 19
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Simulate and Eliminate: Revoke Backdoors for Generative Large Language Models
- 2024Mitigating Backdoor Threats to Large Language Models: Advancement and Challenges
- 2025Revisiting Backdoor Attacks on LLMs: A Stealthy and Practical Poisoning Framework via Harmless Inputs
- 2025Probe before You Talk: Towards Black-box Defense against Backdoor Unalignment for Large Language Models
- 2025CTRAP: Embedding Collapse Trap to Safeguard Large Language Models from Harmful Fine-Tuning
- 2024Learning to Poison Large Language Models for Downstream Manipulation
- 2026Self-Purification Mitigates Backdoors in Multimodal Diffusion Language Models
- 2025P2P: A Poison-to-Poison Remedy for Reliable Backdoor Defense in LLMs