mlsanityData to 14 Oct 2026

DemonAgent: Dynamically Encrypted Multi-Backdoor Implantation Attack on LLM-based Agent

arXiv 2502.12575 ↗First posted 18 Feb 2025cs.CR cs.AIcited by 23

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

As LLM-based agents become increasingly prevalent, backdoors can be implanted into agents through user queries or environment feedback, raising critical concerns regarding safety vulnerabilities. However, backdoor attacks are typically detectable by safety audits that analyze the reasoning process of agents. To this end, we propose a novel backdoor implantation strategy called Dynamically Encrypted Multi-Backdoor Implantation Attack. Specifically, we introduce dynamic encryption, which maps the backdoor into benign content, effectively circumventing safety audits. To enhance stealthiness, we further decompose the backdoor into multiple sub-backdoor fragments. Based on these advancements, backdoors are allowed to bypass safety audits significantly. Additionally, we present AgentBackdoorEval, a dataset designed for the comprehensive evaluation of agent backdoor attacks. Experimental results across multiple datasets demonstrate that our method achieves an attack success rate nearing 100% while maintaining a detection rate of 0%, illustrating its effectiveness in evading safety audits. Our findings highlight the limitations of existing safety mechanisms in detecting advanced attacks, underscoring the urgent need for more robust defenses against backdoor threats. Code and data are available at https://github.com/whfeLingYu/DemonAgent.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 25 of its 50 references that are in the map. First posted on arXiv 18 Feb 2025.

Builds on

25 of 50 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Breaking ReAct Agents: Foot-in-the-Door Attack Will Get You In22 Oct
  2. 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies28 Jul
  3. 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents5 Jun
  4. 2024Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents17 Feb

Other references · 21

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  5. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  6. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  7. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  8. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  9. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  10. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,106
  11. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  12. 2020Weight Poisoning Attacks on Pre-trained Modelscited by 341
9 more
  1. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
  2. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 255
  3. 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Triggercited by 222
  4. 2023Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injectioncited by 157
  5. 2020You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completioncited by 131
  6. 2020Backdoor Attacks and Countermeasures on Deep Learning: A Comprehensive Reviewcited by 123
  7. 2021Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Modelscited by 105
  8. 2024BadEdit: Backdooring large language models by model editingcited by 96
  9. 2023Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agentscited by 32

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 14; 2026: 9.

23 papers.

Sort:

By area:

  1. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
  2. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 126
  3. 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 116
  4. 2025A Survey on Trustworthy LLM Agents: Threats and Countermeasurescited by 96
  5. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
  6. 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflowscited by 58
  7. 2026SkillTrojan: Backdoor Attacks on Skill-Based Agent Systemscited by 25
  8. 2025A Survey on the Safety and Security Threats of Computer-Using Agents: JARVIS or Ultron?cited by 23
  9. 2026BackdoorAgent: A Unified Framework for Backdoor Attacks on LLM-based Agentscited by 16
  10. 2025A Survey of Attacks on Large Language Modelscited by 15
  11. 2025Who's the Mole? Modeling and Detecting Intention-Hiding Malicious Agents in LLM-Based Multi-Agent Systemscited by 13
  12. 2025STAC: When Innocent Tools Form Dangerous Chains for LLM Agentscited by 8
11 more
  1. 2025Chain-of-Trigger: An Agentic Backdoor that Paradoxically Enhances Agentic Robustnesscited by 4
  2. 2026GroupGuard: A Framework for Modeling and Defending Collusive Attacks in Multi-Agent Systemscited by 4
  3. 2025Collaborative Shadows: Distributed Backdoor Attacks in LLM-Based Multi-Agent Systemscited by 3
  4. 2025When "Correct" Is Not Safe: Can We Trust Functionally Correct Patches Generated by Code Agents?cited by 3
  5. 2026MCPShield: A Security Cognition Layer for Adaptive Trust Calibration in Model Context Protocol Agentscited by 3
  6. 2026AgentRAE: Remote Action Execution through Notification-based Visual Backdoors against Screenshots-based Mobile GUI Agentscited by 2
  7. 2026MCP-DPT: A Defense-Placement Taxonomy and Coverage Analysis for Model Context Protocol Securitycited by 2
  8. 2026When Local Monitors Miss Compositional Harm: Diagnosing Distributed Backdoors in Multi-Agent Systemscited by 2
  9. 2025PD3F: A Pluggable and Dynamic DoS-Defense Framework Against Resource Consumption Attacks Targeting Large Language Modelscited by 1
  10. 2026Early Detection of Distributed Backdoors in Multi-Agent LLM Systems: A Characterization Studycited by 0
  11. 2026HazardAuditor: From Executable Threats to Safer Computer-Use Agentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Your Agent Can Defend Itself against Backdoor Attacks
  2. 2026AGENTQ: Quantization-Conditioned Backdoor Attacks on LLM Agents
  3. 2026Your LLM Agent Can Leak Your Data: Data Exfiltration via Backdoored Tool Use
  4. 2024Unelicitable Backdoors in Language Models via Cryptographic Transformer Circuits
  5. 2025The Dark Side of LLMs: Agent-based Attack Vectors for System-level Compromise
  6. 2026From Prompt Injection to Persistent Control: Defending Agentic Harness Against Trojan Backdoors
  7. 2025AutoBackdoor: Automating Backdoor Attacks via LLM Agents
  8. 2026AgentVisor: Defending LLM Agents Against Prompt Injection via Semantic Virtualization