mlsanityData to 14 Oct 2026

Attractive Metadata Attack: Inducing LLM Agents to Invoke Malicious Tools

arXiv 2508.02110 ↗First posted 4 Aug 2025cs.AIcited by 24

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Large language model (LLM) agents have demonstrated remarkable capabilities in complex reasoning and decision-making by leveraging external tools. However, this tool-centric paradigm introduces a previously underexplored attack surface, where adversaries can manipulate tool metadata -- such as names, descriptions, and parameter schemas -- to influence agent behavior. We identify this as a new and stealthy threat surface that allows malicious tools to be preferentially selected by LLM agents, without requiring prompt injection or access to model internals. To demonstrate and exploit this vulnerability, we propose the Attractive Metadata Attack (AMA), a black-box in-context learning framework that generates highly attractive but syntactically and semantically valid tool metadata through iterative optimization. The proposed attack integrates seamlessly into standard tool ecosystems and requires no modification to the agent's execution framework. Extensive experiments across ten realistic, simulated tool-use scenarios and a range of popular LLM agents demonstrate consistently high attack success rates (81%-95%) and significant privacy leakage, with negligible impact on primary task execution. Moreover, the attack remains effective even against prompt-level defenses, auditor-based detection, and structured tool-selection protocols such as the Model Context Protocol, revealing systemic vulnerabilities in current agent architectures. These findings reveal that metadata manipulation constitutes a potent and stealthy attack surface. Notably, AMA is orthogonal to injection attacks and can be combined with them to achieve stronger attack efficacy, highlighting the need for execution-level defenses beyond prompt-level and auditor-based mechanisms. Code is available at https://github.com/SEAIC-M/AMA.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 21 of its 35 references that are in the map. First posted on arXiv 4 Aug 2025.

Builds on

21 of 35 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025A Survey on Trustworthy LLM Agents: Threats and Countermeasures12 Mar
  2. 2025Mimicking the Familiar: Dynamic Command Generation for Information Theft Attacks in LLM Tool-Learning System17 Feb
  3. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
  4. 2024From Allies to Adversaries: Manipulating LLM Tool-Calling through Adversarial Injection13 Dec
  5. 2024Imprompter: Tricking LLM Agents into Improper Tool Use19 Oct
  6. 2024Breaking Agents: Compromising Autonomous LLM Agents Through Malfunction Amplification30 Jul
  7. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar

Other references · 14

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2025Gemma 3 Technical Reportcited by 1,824
  5. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
  6. 2022Can language models learn from explanations in context?cited by 249
  7. 2023Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attackscited by 158
  8. 2023Conversational Health Agents: A Personalized LLM-Powered Agent Frameworkcited by 92
  9. 2023Misusing Tools in Large Language Models With Visual Adversarial Examplescited by 42
  10. 2025A Critical Evaluation of Defenses against Prompt Injection Attackscited by 36
  11. 2025iAgent: LLM Agent as a Shield between User and Recommender Systemscited by 23
  12. 2024Attacks on Third-Party APIs of Large Language Modelscited by 15
2 more
  1. 2024ICLEval: Evaluating In-Context Learning Ability of Large Language Modelscited by 12
  2. 2025ToolCoder: A Systematic Code-Empowered Tool Learning Framework for Large Language Modelscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 22.

24 papers.

Sort:

By area:

  1. 2026From Storage to Steering: Memory Control Flow Attacks on LLM Agentscited by 19
  2. 2026SafeHarness: Lifecycle-Integrated Security Architecture for LLM-based Agent Deploymentcited by 15
  3. 2025BiasBusters: Uncovering and Mitigating Tool Selection Bias in Large Language Modelscited by 11
  4. 2026LPS-Bench: Benchmarking Safety Awareness of Computer-Use Agents in Long-Horizon Planning under Benign and Adversarial Scenarioscited by 9
  5. 2025STAC: When Innocent Tools Form Dangerous Chains for LLM Agentscited by 8
  6. 2026Lingering Authority: Revocable Resource-and-Effect Capabilities for Coding Agentscited by 8
  7. 2026When Skills Lie: Hidden-Comment Injection in LLM Agentscited by 7
  8. 2026How are AI agents used? Evidence from 177,000 MCP toolscited by 7
  9. 2026How Adversarial Environments Mislead Agentic AI?cited by 5
  10. 2026Your Agent is More Brittle Than You Think: Uncovering Indirect Injection Vulnerabilities in Agentic LLMscited by 4
  11. 2026From Tool Orchestration to Code Execution: A Study of MCP Design Choicescited by 3
  12. 2026STARS: Skill-Triggered Audit for Request-Conditioned Invocation Safety in Agent Systemscited by 3
12 more
  1. 2026Think Twice Before You Act: Protecting LLM Agents Against Tool Description Poisoning via Isolated Planningcited by 3
  2. 2026Conjunctive Prompt Attacks in Multi-Agent LLM Systemscited by 2
  3. 2026Convergent Detour Hijacking: Task-Preserving Resource Amplification in Skill-Based LLM Agentscited by 2
  4. 2026ToolFlood: Beyond Selection -- Hiding Valid Tools from LLM Agents via Semantic Coveringcited by 1
  5. 2026ShieldNet: Network-Level Guardrails against Emerging Supply-Chain Injections in Agentic Systemscited by 1
  6. 2026Agent-Facing Information Design in LLM Tool Registriescited by 0
  7. 2026Words Speak Louder Than Code: Investigating Cognitive Heuristics in LLM-Based Code Vulnerability Detectioncited by 0
  8. 2026ContextLeak: Exfiltrating LLM Agent Context via Malicious Toolscited by 0
  9. 2026Implicit Manipulation for Skill Selection in LLM Agents with Semantic Matchingcited by 0
  10. 2026A2M: Trace-Optimized Agent Hijacking in the MCP Ecosystemcited by 0
  11. 2026Stealth Apart, Harm Together: Skill Cascading Attacks on Skill-Based Agent Systemscited by 0
  12. 2026AgentSafeEvo: Adversarial Co-Evolution for LLM Agent Safetycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026ClawGuard: A Runtime Security Framework for Tool-Augmented LLM Agents Against Indirect Prompt Injection
  2. 2026SafeClawBench: Separating Semantic, Audit-Evidence, and Sandbox Harm in Tool-Using LLM Agents
  3. 2025Prompt Injection Attack to Tool Selection in LLM Agents
  4. 2026Universal Defenses for Tool-Integrated LLM Agents Against Adversarial Attacks
  5. 2025Semantic Attacks on Tool-Augmented LLMs: Securing the Model Context Protocol Against Descriptor-Level Manipulation
  6. 2025ToolTweak: An Attack on Tool Selection in LLM-based Agents
  7. 2025MCP Security Bench (MSB): Benchmarking Attacks Against Model Context Protocol in LLM Agents
  8. 2025Les Dissonances: Cross-Tool Harvesting and Polluting in Pool-of-Tools Empowered LLM Agents