Backdoor Decontamination Dynamics in LLM Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Open-weight LLM agents are vulnerable to backdoors installed during fine-tuning, which may be undetectable if the trigger conditions are never met during testing. Assuming defenders do not know the existing trigger, they cannot unlearn it directly. One decontamination strategy is to install a known backdoor (defensive poisoning) then to unlearn it, hoping that the original unknown backdoor is removed as a side effect. However, this procedure has uncertain outcomes: the original backdoor may persist or be erased or rerouted, among other possibilities. We introduce a framework for studying these dynamics in tool-calling agents, decoupling trigger, response, teacher, and fine-tuning method across systematic experiments on AgentDyn. Across 115 experiments, defensive poisoning alone erases around 56% of original backdoors; subsequent decontamination then drives almost all survivors to erasure, confirming that trigger recognition and malicious execution are behaviorally dissociable. Interestingly, our experiments find that malicious backdoors never persist when using different triggers of the same general type as the defensive backdoor when followed by decontamination via unlearning. Co-installing up to four backdoors increases resistance (around 36% erased), yet decontaminating a single known co-resident backdoor collaterally clears 52/60 co-residents (87%). Upon visualizing postdecontamination model internals using J-lens, we confirm that although the decontamination restores benign LLM responses, traces of original trigger awareness persist at intermediate layers.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 26 of its 31 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
26 of 31 references.
Closest ancestors · 6
Same direction, newest first
- 2026Your LLM Agent Can Leak Your Data: Data Exfiltration via Backdoored Tool Use7 Apr
- 2025PromptArmor: Simple yet Effective Prompt Injection Defenses21 Jul
- 2025Defeating Prompt Injections by Design24 Mar
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
- 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents5 Jun
- 2024Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents17 Feb
Other references · 20
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 580
- 2020Weight Poisoning Attacks on Pre-trained Modelscited by 341
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
- 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Triggercited by 222
- 2023Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injectioncited by 157
- 2023On the Exploitability of Instruction Tuningcited by 116
- 2024BadEdit: Backdooring large language models by model editingcited by 96
- 2026Verbalizable Representations Form a Global Workspace in Language Modelscited by 75
- 2023Enhancing Fine-Tuning Based Backdoor Defense with Sharpness-Aware Minimizationcited by 64
8 more
- 2022Fine-mixing: Mitigating Backdoors in Fine-tuned Language Modelscited by 57
- 2024BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Modelscited by 50
- 2022Fine-Tuning Is All You Need to Mitigate Backdoor Attackscited by 38
- 2025Indirect Prompt Injections: Are Firewalls All You Need, or Stronger Benchmarks?cited by 18
- 2024Simulate and Eliminate: Revoke Backdoors for Generative Large Language Modelscited by 12
- 2025Persistent Backdoor Attacks under Continual Fine-Tuning of LLMscited by 7
- 2025Backdoor Collapse: Eliminating Unknown Threats via Known Backdoor Aggregation in Language Modelscited by 6
- 2026Merging Triggers, Breaking Backdoors: Defensive Poisoning for Instruction-Tuned Language Modelscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026The Trigger in the Haystack: Extracting and Reconstructing LLM Backdoor Triggers
- 2026ToxScreen: Detecting Whether an LLM Has Been Poisoned
- 2026BackdoorAgent: A Unified Framework for Backdoor Attacks on LLM-based Agents
- 2025From Poisoned to Aware: Fostering Backdoor Self-Awareness in LLMs
- 2026From Prompt Injection to Persistent Control: Defending Agentic Harness Against Trojan Backdoors
- 2026LoopTrap: Termination Poisoning Attacks on LLM Agents
- 2026Prompted to Discriminate: Generalizing Malicious-Input Probes in the Wild
- 2026Early Detection of Distributed Backdoors in Multi-Agent LLM Systems: A Characterization Study