Oracle Poisoning: Corrupting Knowledge Graphs to Weaponise AI Agent Reasoning
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
We define Oracle Poisoning, an attack class in which an adversary corrupts a structured knowledge graph that AI agents query at runtime via tool-use protocols, causing incorrect conclusions through correct reasoning. Unlike prompt injection, Oracle Poisoning manipulates the data agents reason over, not their instructions. We demonstrate six attack scenarios against a production 42-million-node code knowledge graph, providing the first empirical demonstration of knowledge graph poisoning against a production-scale agentic system, distinct from CTI embedding poisoning. Primary evaluation uses real SDK tool-use across nine models from three providers (N=30 per model), where models autonomously invoke a graph query tool and reason from results. The result is unambiguous: every tested model trusts poisoned data at 100% at moderate attacker sophistication(L2), with 269 valid trials (of 270) accepting fabricated security claims under directed queries. Under open-ended prompts, trust drops to 3-55%, confirming prompt framing as a confound; we report both conditions. An attacker sophistication gradient reveals discrete break points, a minimum skill at which trust flips from 0% to 100%, reframing the attack as a question not of whether but of how much. A controlled delivery-mode comparison shows that inline evaluation produces false negatives: GPT-5.1 shows 0% trust inline but 100% under both simulated and real agentic tool-use, demonstrating that delivery mode is a first-order confound. We evaluate five defences; read-only access control eliminates the direct mutation vector, while the remaining four are partial and model-dependent. Analysis of four additional platforms suggests the attack may generalise across the knowledge-graph ecosystem.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 23 of its 43 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
23 of 43 references.
Closest ancestors · 5
Same direction, newest first
- 2025MCPTox: A Benchmark for Tool Poisoning Attack on Real-World MCP Servers19 Aug
- 2025From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflows29 Jun
- 2024From Allies to Adversaries: Manipulating LLM Tool-Calling through Adversarial Injection13 Dec
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
Other references · 18
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 519
- 2018Adversarial Attacks on Neural Networks for Graph Datacited by 397
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 267
- 2023Poisoning Retrieval Corpora by Injecting Adversarial Passagescited by 159
- 2025Securing AI Agents with Information-Flow Controlcited by 121
- 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Modelscited by 86
- 2019Data Poisoning Attack against Knowledge Graph Embeddingcited by 36
- 2025GraphRAG under Firecited by 24
- 2025Benchmarking Poisoning Attacks against Retrieval-Augmented Generationcited by 18
6 more
- 2025Defending Against Knowledge Poisoning Attacks During Retrieval-Augmented Generationcited by 11
- 2026The Promptware Kill Chain: How Prompt Injections Gradually Evolved Into a Multistep Malware Delivery Mechanismcited by 9
- 2023On the Security Risks of Knowledge Graph Reasoningcited by 5
- 2025A Few Words Can Distort Graphs: Knowledge Poisoning Attacks on Graph-based Retrieval-Augmented Generation of Large Language Modelscited by 4
- 2026Architecting Trust in Artificial Epistemic Agentscited by 3
- 2026KEPo: Knowledge Evolution Poison on Graph-based Retrieval-Augmented Generationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Red-Teaming the Agentic Red-Teamcited by 0
- 2026Red-Teaming the Agentic Red-Team23 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Poisoned Playbooks: Demystifying Knowledge Poisoning Effects on AI Security Agents
- 2026ShadowMerge: A Novel Poisoning Attack on Graph-Based Agent Memory via Relation-Channel Conflicts
- 2025Reasoning Introduces New Poisoning Attacks Yet Makes Them More Complicated
- 2026SoK: The Attack Surface of Agentic AI - Tools and Autonomy
- 2026AgentTrust: Runtime Safety Evaluation and Interception for AI Agent Tool Use
- 2025Malice in Agentland: Down the Rabbit Hole of Backdoors in the AI Supply Chain
- 2026Agent-Fence: Mapping Security Vulnerabilities Across Deep Research Agents
- 2026Distributed Denial of Science: How Indirect Data Poisoning of AI Systems Can Industrialize Scientific Fraud