How Much Can We Trust LLM Search Agents? Measuring Endorsement Vulnerability to Web Content Manipulation
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Large language model (LLM)-based search agents synthesize open-web content into actionable recommendations on behalf of users, creating a risk that attacker-published pages are transformed into endorsed claims. We introduce SearchGEO, a controlled evaluation framework for measuring endorsement corruption in LLM-based web-search agents, combining a web-evidence manipulation pipeline, a five-mode attack taxonomy, and multiple output-level metrics. We evaluate 13 LLM backends on 308 cases each. Results show that vulnerability patterns vary across backends: overall attack success rate (ASR) ranges from 0.0% on Claude-Sonnet-4.6 to 31.4% on Gemini-3-Flash, the strongest attack mode differs by model family, and the same deployment scaffold could amplify or decrease ASR on different backends. An auxiliary agent-skill probe, where endorsement becomes an install command, exposes a sharp split among otherwise robust backends: Claude over-rejects while GPT over-trusts. These findings argue for treating recommendation reliability under adversarial search content as a first-class dimension of backend safety evaluation.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 11 of its 50 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
11 of 50 references.
Closest ancestors · 5
Same direction, newest first
- 2026IPI-proxy: An Intercepting Proxy for Red-Teaming Web-Browsing AI Agents Against Indirect Prompt Injection12 May
- 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety8 Jul
- 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep
Other references · 6
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2025StealthRank: LLM Ranking Manipulation via Stealthy Prompt Optimizationcited by 10
- 2026AgenticGEO: A Self-Evolving Agentic System for Generative Engine Optimizationcited by 6
- 2026Indirect Prompt Injection in the Wild: An Empirical Study of Prevalence, Techniques, and Objectivescited by 4
- 2026SearchAttack: Red-Teaming LLMs against Knowledge-to-Action Threats under Online Web Searchcited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Self-Improvements in Modern Agentic Systems: A Surveycited by 17
- 2026Evaluating Deep-Search Agents under Hierarchical Web Evidence Poisoningcited by 1
- 2026Breadcrumbing Search Agentscited by 0
- 2026Record Grouping Controls Evidence Weight in Language Modelscited by 0
- 2026The Corroboration Illusion: When More News Makes LLM Forecasts Less Truecited by 0
- 2026AX is the New AEOcited by 0
- 2026AX is the New AEO28 Sep 2026
- 2026Record Grouping Controls Evidence Weight in Language Models8 Sep 2026
- 2026The Corroboration Illusion: When More News Makes LLM Forecasts Less True5 Sep 2026
- 2026Evaluating Deep-Search Agents under Hierarchical Web Evidence Poisoning5 Sep 2026
- 2026Breadcrumbing Search Agents5 Aug 2026
- 2026Self-Improvements in Modern Agentic Systems: A Survey14 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Agents Trust Tools Too Much: Measuring Reliance on Unreliable Tools
- 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysis
- 2024When LLMs Go Online: The Emerging Threat of Web-Enabled LLMs
- 2025LLM Agents for Automated Web Vulnerability Reproduction: Are We There Yet?
- 2026Known By Their Actions: Fingerprinting LLM Browser Agents via UI Traces
- 2026From Prompt Injection to Web Exploitation: Revisiting Classic Vulnerabilities in LLM-Integrated Applications
- 2025SafeSearch: Automated Red-Teaming of LLM-Based Search Agents
- 2026WAAA! Web Adversaries Against Agentic Browsers