mlsanityData to 7 Oct 2026

How Much Can We Trust LLM Search Agents? Measuring Endorsement Vulnerability to Web Content Manipulation

arXiv 2606.16821 ↗First posted 15 Jun 2026cs.CL cs.CR cs.CYcited by 6

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Large language model (LLM)-based search agents synthesize open-web content into actionable recommendations on behalf of users, creating a risk that attacker-published pages are transformed into endorsed claims. We introduce SearchGEO, a controlled evaluation framework for measuring endorsement corruption in LLM-based web-search agents, combining a web-evidence manipulation pipeline, a five-mode attack taxonomy, and multiple output-level metrics. We evaluate 13 LLM backends on 308 cases each. Results show that vulnerability patterns vary across backends: overall attack success rate (ASR) ranges from 0.0% on Claude-Sonnet-4.6 to 31.4% on Gemini-3-Flash, the strongest attack mode differs by model family, and the same deployment scaffold could amplify or decrease ASR on different backends. An auxiliary agent-skill probe, where endorsement becomes an install command, exposes a sharp split among otherwise robust backends: Claude over-rejects while GPT over-trusts. These findings argue for treating recommendation reliability under adversarial search content as a first-class dimension of backend safety evaluation.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 11 of its 50 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

11 of 50 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026IPI-proxy: An Intercepting Proxy for Red-Teaming Web-Browsing AI Agents Against Indirect Prompt Injection12 May
  2. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety8 Jul
  3. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
  4. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
  5. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep

Other references · 6

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  3. 2025StealthRank: LLM Ranking Manipulation via Stealthy Prompt Optimizationcited by 10
  4. 2026AgenticGEO: A Self-Evolving Agentic System for Generative Engine Optimizationcited by 6
  5. 2026Indirect Prompt Injection in the Wild: An Empirical Study of Prevalence, Techniques, and Objectivescited by 4
  6. 2026SearchAttack: Red-Teaming LLMs against Knowledge-to-Action Threats under Online Web Searchcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agents Trust Tools Too Much: Measuring Reliance on Unreliable Tools
  2. 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysis
  3. 2024When LLMs Go Online: The Emerging Threat of Web-Enabled LLMs
  4. 2025LLM Agents for Automated Web Vulnerability Reproduction: Are We There Yet?
  5. 2026Known By Their Actions: Fingerprinting LLM Browser Agents via UI Traces
  6. 2026From Prompt Injection to Web Exploitation: Revisiting Classic Vulnerabilities in LLM-Integrated Applications
  7. 2025SafeSearch: Automated Red-Teaming of LLM-Based Search Agents
  8. 2026WAAA! Web Adversaries Against Agentic Browsers