Network-Level Prompt and Trait Leakage in Local Research Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
We show that Web and Research Agents (WRAs) -- language-model-based systems that investigate complex topics on the Internet -- are vulnerable to inference attacks by passive network observers. Deployment of WRAs locally by organizations and individuals for privacy, legal, or financial purposes exposes them to DNS resolvers, malicious ISPs, VPNs, web proxies, and corporate or government firewalls. However, unlike sporadic and scarce web browsing by humans, WRAs visit 70-140 domains per each request with a distinct timing pattern creating unique privacy risks. Specifically, we demonstrate a novel prompt and user trait leakage attack against WRAs that only leverages their network-level metadata (i.e., visited IP addresses and their timings). We start by building a new dataset of WRA traces based on real user search queries and queries generated by synthetic personas. We define a behavioral metric (called OBELS) to comprehensively assess similarity between original and inferred prompts, showing that our attack recovers over 73% of the functional and domain knowledge of user prompts. Extending to a multi-session setting, we recover up to 19 of 32 latent traits with high accuracy. Our attack remains effective under partial observability and noisy conditions. Finally, we discuss mitigation strategies that constrain domain diversity or obfuscate traces, showing negligible utility impact while reducing attack effectiveness by an average of 29%.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 39 of its 93 references that are in the map. First posted on arXiv 27 Aug 2025.
Builds on
39 of 93 references.
Closest ancestors · 6
Same direction, newest first
- 2025The Hidden Dangers of Browsing AI Agents19 May
- 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysis27 Feb
- 2025Unveiling Privacy Risks in LLM Agent Memory17 Feb
- 2024When LLMs Go Online: The Emerging Threat of Web-Enabled LLMs18 Oct
- 2024AirGapAgent: Protecting Privacy-Conscious Conversational Agents8 May
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
Other references · 33
- 2023GPT-4 Technical Reportcited by 18,396
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
21 more
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
- 2025Deep Research Agents: A Systematic Examination And Roadmapcited by 128
- 2024PLeak: Prompt Leaking Attacks against Large Language Model Applicationscited by 127
- 2024Is Cosine-Similarity of Embeddings Really About Similarity?cited by 89
- 2023Effective Prompt Extraction from Language Modelscited by 85
- 2024PERSONA: A Reproducible Testbed for Pluralistic Alignmentcited by 73
- 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 72
- 2025Contextual Agent Security: A Policy for Every Purposecited by 59
- 2024LLMmap: Fingerprinting For Large Language Modelscited by 58
- 2024Advancing Tool-Augmented Large Language Models: Integrating Insights from Errors in Inference Treescited by 38
- 2025Benchmarking Prompt Sensitivity in Large Language Modelscited by 38
- 2015k-fingerprinting: a Robust Scalable Website Fingerprinting Techniquecited by 34
- 2024What Was Your Prompt? A Remote Keylogging Attack on AI Assistantscited by 26
- 2024Customizing Language Model Responses with Contrastive In-Context Learningcited by 19
- 2024One vs. Many: Comprehending Accurate Information from Multiple Erroneous and Inconsistent AI Generationscited by 13
- 2024Remote Timing Attacks on Efficient Language Model Inferencecited by 13
- 2025Semantics at an Angle: When Cosine Similarity Works Until It Doesn'tcited by 13
- 2019Encrypted DNS --> Privacy? A Traffic Analysis Perspectivecited by 4
- 2015Where You Are Is Who You Are: User Identification by Matching Statisticscited by 3
- 2019Assessing the Privacy Benefits of Domain Name Encryptioncited by 2
- 2023Browsing behavior exposes identities on the Webcited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026SPILLage: Agentic Oversharing on the Webcited by 3
- 2026From Privacy to Workflow Integrity: Communication-Graph Metadata in Autonomous Agent Interoperabilitycited by 1
- 2026A Large-Scale Benchmark and Risk Assessment of Traffic Analysis Attacks on Cloud LLM Servicescited by 1
- 2026Inferring Hidden User Models from the Behavior of Personalized LLM Agentscited by 0
- 2026AgentTell: Behavioural Side-Channel Leakage in Browser-Use Agentscited by 0
- 2026AgentTell: Behavioural Side-Channel Leakage in Browser-Use Agents26 Sep 2026
- 2026A Large-Scale Benchmark and Risk Assessment of Traffic Analysis Attacks on Cloud LLM Services25 Sep 2026
- 2026Inferring Hidden User Models from the Behavior of Personalized LLM Agents3 Sep 2026
- 2026From Privacy to Workflow Integrity: Communication-Graph Metadata in Autonomous Agent Interoperability5 Jun 2026
- 2026SPILLage: Agentic Oversharing on the Web13 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Indirect Prompt Injection in the Wild: An Empirical Study of Prevalence, Techniques, and Objectives
- 2026Deep-Research Agents Can Be Poisoned via User-Generated Content
- 2025Mind the Web: The Security of Web Use Agents
- 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
- 2026Prismata: Confining Cross-Site Prompt Injection in Web Agents
- 2025Simple Prompt Injection Attacks Can Leak Personal Data Observed by LLM Agents During Task Execution
- 2025RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakage
- 2026MosaicLeaks:Privacy Risks in Querying-in-the-Open for Deep Research Agents