mlsanityData to 14 Oct 2026

Profiling for Pennies: Unveiling the Privacy Iceberg of LLM Agents

arXiv 2605.06232 ↗First posted 7 May 2026cs.CRcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Large Language Models (LLMs) have revolutionized how information are collected, aggregated, and reasoned. However, this enables a novel and accessible vector of privacy intrusion: the automated and in-depth personal profiling; this engenders a chilling effect of "peepers everywhere". Existing research primarily unfolds from the training pipeline of LLM, emphasizing the exposure of Personally Identifiable Information (PII) through memorization, while privacy studies from a human-centric perspective remain underexplored. To fill this void, we empirically investigate privacy perception in the real world through the lens of human awareness and the practices of LLM-integrated platforms, revealing a significant dissonance: platforms fail to technically or policy-wise address public privacy concerns. To facilitate a systematic and quantifiable study of privacy risk, we propose the PrivacyIceberg, which categorizes real-world human privacy risks into three tiers: explicitly searched, contextually inferred, and deeply aggregated, based on the sophistication of LLM exploitation. We developed IcebergExplorer to audit privacy exposure, utilizing minimal PII as a search seed to reconstruct high-fidelity profiles, achieving over 90% factual accuracy within 10 minutes at a cost under 3, for real-world scenarios. Additionally, we identify six root causes contributing to such privacy disclosures and propose multi-stakeholder countermeasures for LLM vendors, individuals, and data publishers.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 19 of its 35 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

19 of 35 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Automated Profile Inference with Language Model Agents18 May
  2. 2024When LLMs Go Online: The Emerging Threat of Web-Enabled LLMs18 Oct

Other references · 17

  1. 2020Extracting Training Data from Large Language Modelscited by 2,189
  2. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
  3. 2024Large Language Models for Data Annotation and Synthesis: A Surveycited by 205
  4. 2023Beyond Memorization: Violating Privacy Via Inference with Large Language Modelscited by 175
  5. 2021Graph Unlearningcited by 138
  6. 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 120
  7. 2024Exploring LLM-based Agents for Root Cause Analysiscited by 61
  8. 2024Private Attribute Inference from Images with Vision-Language Modelscited by 37
  9. 2023Comparing Traditional and LLM-based Search for Consumer Choice: A Randomized Experimentcited by 36
  10. 2023The Janus Interface: How Fine-Tuning in Large Language Models Amplifies the Privacy Riskscited by 36
  11. 2024A Synthetic Dataset for Personal Attribute Inferencecited by 36
  12. 2024Evaluating LLM-based Personal Information Extraction and Countermeasurescited by 12
5 more
  1. 2023Ethical Frameworks and Computer Security Trolley Problems: Foundations for Conversationscited by 11
  2. 2024Leveraging Large Language Models to Enhance Personalized Recommendations in E-commercecited by 8
  3. 2025Scrub It Out! Erasing Sensitive Memorization in Code Language Models via Machine Unlearningcited by 7
  4. 2025Beyond Data Privacy: New Privacy Risks for Large Language Modelscited by 6
  5. 2022On the Privacy Risks of Cell-Based NAS Architecturescited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Longitudinal Measurement of Privacy Policy Evolution for Large Language Models
  2. 2025Auditing M-LLMs for Privacy Risks: A Synthetic Benchmark and Evaluation Framework ↗
  3. 2025Controlling What You Share: Assessing Language Model Adherence to Privacy Preferences
  4. 2026PIA-Bench: Towards Automated Privacy Impact Assessment with Large Language Models ↗
  5. 2025User Behavior Analysis in Privacy Protection with Large Language Models: A Study on Privacy Preferences with Limited Data
  6. 2025The Model's Language Matters: A Comparative Privacy Analysis of LLMs
  7. 2025SoK: The Privacy Paradox of Large Language Models: Advancements, Privacy Risks, and Mitigation
  8. 2025LLM-as-a-Judge for Privacy Evaluation? Exploring the Alignment of Human and LLM Perceptions of Privacy in Textual Data