BackdoorAgent: A Unified Framework for Backdoor Attacks on LLM-based Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use. While this design enables autonomy, it also expands the attack surface for backdoor threats. Backdoor triggers injected into specific stages of an agent workflow can persist through multiple intermediate states and adversely influence downstream outputs. However, existing studies remain fragmented and typically analyze individual attack vectors in isolation, leaving the cross-stage interaction and propagation of backdoor triggers poorly understood from an agent-centric perspective. To fill this gap, we propose BackdoorAgent, a modular and stage-aware framework that provides a unified, agent-centric view of backdoor threats in LLM agents. BackdoorAgent structures the attack surface into three functional stages of agentic workflows, including planning attacks, memory attacks, and tool-use attacks, and instruments agent execution to enable systematic analysis of trigger activation and propagation across different stages. Building on this framework, we construct a standardized benchmark spanning four representative agent applications: Agent QA, Agent Code, Agent Web, and Agent Drive, covering both language-only and multimodal settings. Our empirical analysis shows that textittriggers implanted at a single stage can persist across multiple steps and propagate through intermediate states. For instance, when using a GPT-based backbone, we observe trigger persistence in 43.58% of planning attacks, 77.97% of memory attacks, and 60.28% of tool-stage attacks, highlighting the vulnerabilities of the agentic workflow itself to backdoor threats. To facilitate reproducibility and future research, our code and benchmark are publicly available at GitHub.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 37 of its 55 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
37 of 55 references.
Closest ancestors · 8
Same direction, newest first
- 2025AutoBackdoor: Automating Backdoor Attacks via LLM Agents20 Nov
- 2025Your Agent Can Defend Itself against Backdoor Attacks10 Jun
- 2025AdInject: Real-World Black-Box Attacks on Web Agents via Advertising Delivery27 May
- 2025DemonAgent: Dynamically Encrypted Multi-Backdoor Implantation Attack on LLM-based Agent18 Feb
- 2024AdvAgent: Controllable Blackbox Red-teaming on Web Agents22 Oct
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
- 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents5 Jun
- 2024Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents17 Feb
Other references · 29
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2024GPT-4o System Cardcited by 4,467
- 2023Qwen Technical Reportcited by 3,273
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 164
- 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 163
- 2023A Language Agent for Autonomous Drivingcited by 161
- 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Researchcited by 143
17 more
- 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigationcited by 116
- 2024RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Modelcited by 91
- 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 75
- 2024TrojanRAG: Retrieval-Augmented Generation Can Be Backdoor Driver in Large Language Modelscited by 63
- 2023Personalized Autonomous Driving with Large Language Models: Field Experimentscited by 46
- 2024BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Modelscited by 44
- 2025Reducing Cost of LLM Agents with Trajectory Reductioncited by 44
- 2024Towards Uncertainty-Aware Language Agentcited by 29
- 2024CleanGen: Mitigating Backdoor Attacks for Generation Tasks in Large Language Modelscited by 20
- 2024When Backdoors Speak: Understanding LLM Backdoor Attacks Through Model-Generated Explanationscited by 16
- 2025Probe before You Talk: Towards Black-box Defense against Backdoor Unalignment for Large Language Modelscited by 15
- 2025Routine: A Structural Planning Framework for LLM Agent System in Enterprisecited by 9
- 2025Knowledge-Based Multi-Agent Framework for Automated Software Architecture Designcited by 7
- 2025ConfGuard: A Simple and Effective Backdoor Detection for Large Language Modelscited by 5
- 2025PhysPatch: A Physically Realizable and Transferable Adversarial Patch Attack for Multimodal Large Language Models-based Autonomous Driving Systemscited by 4
- 2025MAS-Shield: A Defense Framework for Secure and Efficient LLM MAScited by 3
- 2025A Plan Reuse Mechanism for LLM-Driven Agentcited by 3
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026From Assistant to Double Agent: Formalizing and Benchmarking Attacks on OpenClaw for Personalized Local AI Agentcited by 27
- 2026SkillTrojan: Backdoor Attacks on Skill-Based Agent Systemscited by 21
- 2026Safety Testing LLM Agents at Scale: From Risk Discovery to Evidence-Grounded Verificationcited by 6
- 2026BraveGuard: From Open-World Threats to Safer Computer-Use Agentscited by 4
- 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agentscited by 3
- 2026Runtime Skill Audit: Targeted Runtime Probing for Agent Skill Securitycited by 2
- 2026When Local Monitors Miss Compositional Harm: Diagnosing Distributed Backdoors in Multi-Agent Systemscited by 2
- 2026Taxonomy and Consistency Analysis of Safety Benchmarks for AI Agentscited by 1
- 2026DarkLLM: Learning Language-Driven Adversarial Attacks with Large Language Modelscited by 0
- 2026Early Detection of Distributed Backdoors in Multi-Agent LLM Systems: A Characterization Studycited by 0
- 2026SynChain: Inducing Computer-Use Agent Systems to Construct Their Own Attack Chainscited by 0
- 2026HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safetycited by 0
- 2026HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safety18 Aug 2026
- 2026SynChain: Inducing Computer-Use Agent Systems to Construct Their Own Attack Chains7 Aug 2026
- 2026Early Detection of Distributed Backdoors in Multi-Agent LLM Systems: A Characterization Study27 Jul 2026
- 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agents16 Jul 2026
- 2026When Local Monitors Miss Compositional Harm: Diagnosing Distributed Backdoors in Multi-Agent Systems13 Jul 2026
- 2026Safety Testing LLM Agents at Scale: From Risk Discovery to Evidence-Grounded Verification2 Jul 2026
- 2026Runtime Skill Audit: Targeted Runtime Probing for Agent Skill Security10 Jun 2026
- 2026BraveGuard: From Open-World Threats to Safer Computer-Use Agents31 May 2026
- 2026DarkLLM: Learning Language-Driven Adversarial Attacks with Large Language Models15 May 2026
- 2026Taxonomy and Consistency Analysis of Safety Benchmarks for AI Agents11 Apr 2026
- 2026SkillTrojan: Backdoor Attacks on Skill-Based Agent Systems8 Apr 2026
- 2026From Assistant to Double Agent: Formalizing and Benchmarking Attacks on OpenClaw for Personalized Local AI Agent9 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025The Dark Side of LLMs: Agent-based Attack Vectors for System-level Compromise
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
- 2025Collaborative Shadows: Distributed Backdoor Attacks in LLM-Based Multi-Agent Systems
- 2026Sleeper Cell: Injecting Latent Malice Temporal Backdoors into Tool-Using LLMs
- 2026Stateful Agent Backdoor
- 2025Chain-of-Trigger: An Agentic Backdoor that Paradoxically Enhances Agentic Robustness
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models
- 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threats