mlsanityData to 7 Oct 2026

BackdoorAgent: A Unified Framework for Backdoor Attacks on LLM-based Agents

arXiv 2601.04566 ↗First posted 8 Jan 2026cs.AI cs.CLcited by 12

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use. While this design enables autonomy, it also expands the attack surface for backdoor threats. Backdoor triggers injected into specific stages of an agent workflow can persist through multiple intermediate states and adversely influence downstream outputs. However, existing studies remain fragmented and typically analyze individual attack vectors in isolation, leaving the cross-stage interaction and propagation of backdoor triggers poorly understood from an agent-centric perspective. To fill this gap, we propose BackdoorAgent, a modular and stage-aware framework that provides a unified, agent-centric view of backdoor threats in LLM agents. BackdoorAgent structures the attack surface into three functional stages of agentic workflows, including planning attacks, memory attacks, and tool-use attacks, and instruments agent execution to enable systematic analysis of trigger activation and propagation across different stages. Building on this framework, we construct a standardized benchmark spanning four representative agent applications: Agent QA, Agent Code, Agent Web, and Agent Drive, covering both language-only and multimodal settings. Our empirical analysis shows that textittriggers implanted at a single stage can persist across multiple steps and propagate through intermediate states. For instance, when using a GPT-based backbone, we observe trigger persistence in 43.58% of planning attacks, 77.97% of memory attacks, and 60.28% of tool-stage attacks, highlighting the vulnerabilities of the agentic workflow itself to backdoor threats. To facilitate reproducibility and future research, our code and benchmark are publicly available at GitHub.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 37 of its 55 references that are in the map. First posted on arXiv 8 Jan 2026.

Builds on

37 of 55 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025AutoBackdoor: Automating Backdoor Attacks via LLM Agents20 Nov
  2. 2025Your Agent Can Defend Itself against Backdoor Attacks10 Jun
  3. 2025AdInject: Real-World Black-Box Attacks on Web Agents via Advertising Delivery27 May
  4. 2025DemonAgent: Dynamically Encrypted Multi-Backdoor Implantation Attack on LLM-based Agent18 Feb
  5. 2024AdvAgent: Controllable Blackbox Red-teaming on Web Agents22 Oct
  6. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
  7. 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents5 Jun
  8. 2024Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents17 Feb

Other references · 29

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2023Qwen Technical Reportcited by 3,273
  4. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  5. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  7. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
  8. 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
  9. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 164
  10. 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 163
  11. 2023A Language Agent for Autonomous Drivingcited by 161
  12. 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Researchcited by 143
17 more
  1. 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigationcited by 116
  2. 2024RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Modelcited by 91
  3. 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 75
  4. 2024TrojanRAG: Retrieval-Augmented Generation Can Be Backdoor Driver in Large Language Modelscited by 63
  5. 2023Personalized Autonomous Driving with Large Language Models: Field Experimentscited by 46
  6. 2024BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Modelscited by 44
  7. 2025Reducing Cost of LLM Agents with Trajectory Reductioncited by 44
  8. 2024Towards Uncertainty-Aware Language Agentcited by 29
  9. 2024CleanGen: Mitigating Backdoor Attacks for Generation Tasks in Large Language Modelscited by 20
  10. 2024When Backdoors Speak: Understanding LLM Backdoor Attacks Through Model-Generated Explanationscited by 16
  11. 2025Probe before You Talk: Towards Black-box Defense against Backdoor Unalignment for Large Language Modelscited by 15
  12. 2025Routine: A Structural Planning Framework for LLM Agent System in Enterprisecited by 9
  13. 2025Knowledge-Based Multi-Agent Framework for Automated Software Architecture Designcited by 7
  14. 2025ConfGuard: A Simple and Effective Backdoor Detection for Large Language Modelscited by 5
  15. 2025PhysPatch: A Physically Realizable and Transferable Adversarial Patch Attack for Multimodal Large Language Models-based Autonomous Driving Systemscited by 4
  16. 2025MAS-Shield: A Defense Framework for Secure and Efficient LLM MAScited by 3
  17. 2025A Plan Reuse Mechanism for LLM-Driven Agentcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Dark Side of LLMs: Agent-based Attack Vectors for System-level Compromise
  2. 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
  3. 2025Collaborative Shadows: Distributed Backdoor Attacks in LLM-Based Multi-Agent Systems
  4. 2026Sleeper Cell: Injecting Latent Malice Temporal Backdoors into Tool-Using LLMs
  5. 2026Stateful Agent Backdoor
  6. 2025Chain-of-Trigger: An Agentic Backdoor that Paradoxically Enhances Agentic Robustness
  7. 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models
  8. 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threats