mlsanityData to 7 Oct 2026

Deep-Research Agents Can Be Poisoned via User-Generated Content

arXiv 2605.24245 ↗First posted 22 May 2026cs.CRcited by 4

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Deep-research agents are an alternative to conventional Web search. They use multi-agent pipelines to issue multiple Web searches related to user queries, retrieve relevant content from the answers, and generate detailed, evidence-based reports. We show that for many common search topics (including financial, medical, and product recommendations), agent-generated reports are consistently based on the same user-generated content (UGC) pages from platforms such as Reddit and Wikipedia. This retrieval overlap, combined with lax moderation and access controls for UGC, is an opportunity for subversion: an attacker who appends a short text to a single, frequently-retrieved page can cause agents to cite this text and promote attacker-chosen entities across many user questions. We evaluate this attack on representative deep-research systems across multiple topics, such as investment advice, antivirus software, restaurant recommendations, etc. Poisoning a single URL with as few as 13 words can be sufficient for the attacker's content to be retrieved in 57-76% of the agent executions for a given topic and cited in 38-51% of the generated reports. A more aggressive attack (poisoning an entire subreddit) achieves 30-53% citation rates even when the poison is only 0.5-4% of the retrieved content. The attacker does not need to know the phrasing of the user's question, nor the specific Web queries generated by the agent, nor the agent's internal retrieval and generation mechanisms. We then study defenses at different stages of the pipeline, including source-level filtering and output-based detection. Dropping UGC from retrieved content blocks the attack but degrades the quality of generated reports. We show that lightweight anomaly detection on inputs and outputs does not reliably identify poisoned content, nor the results of poisoning.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 24 of its 47 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

24 of 47 references.

References · 24

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  7. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  8. 2024Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Modelscited by 431
  9. 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
  10. 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
  11. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
  12. 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 150
12 more
  1. 2024What Evidence Do Language Models Find Convincing?cited by 74
  2. 2023GEO: Generative Engine Optimizationcited by 53
  3. 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversationscited by 43
  4. 2024Adversarial Search Engine Optimization for Large Language Modelscited by 37
  5. 2024Ranking Manipulation for Conversational Search Enginescited by 23
  6. 2024The Rise of AI-Generated Content in Wikipediacited by 22
  7. 2025OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinkingcited by 18
  8. 2024Adversarial Decoding: Generating Readable Documents for Adversarial Objectivescited by 16
  9. 2025Generative Engine Optimization: How to Dominate AI Searchcited by 16
  10. 2026Commercial Persuasion in AI-Mediated Conversationscited by 5
  11. 2024Fool Me, Fool Me: User Attitudes Toward LLM Falsehoodscited by 3
  12. 2025Exposing Citation Vulnerabilities in Generative Enginescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Deep Research Agents Brings Deeper Harm
  2. 2025Network-Level Prompt and Trait Leakage in Local Research Agents
  3. 2025Mind the Web: The Security of Web Use Agents
  4. 2026Who is the Agent to Blame? Localizing Faithfulness and Citation Mistakes in Agentic Deep Research
  5. 2025The Hidden Dangers of Browsing AI Agents
  6. 2026From Intent to Evidence: A Categorical Approach for Structural Evaluation of Deep Research Agents
  7. 2025FocusAgent: Simple Yet Effective Ways of Trimming the Large Context of Web Agents
  8. 2026FORGE: Research-Trajectory Hijacking Attacks on Deep Research Agents