mlsanityData to 14 Oct 2026

From Weak Cues to Real Identities: Evaluating Inference-Driven De-Anonymization in LLM Agents

arXiv 2603.18382 ↗First posted 19 Mar 2026cs.AIcited by 4

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Anonymization is often assumed to protect privacy once explicit identifiers are removed, because re-identification has historically required specialized expertise, tailored algorithms, and manual corroboration. We show that LLM-based agents weaken this barrier: by combining scattered, individually non-identifying cues with public evidence, they reconstruct real-world identities, sometimes even during benign tasks. We evaluate this risk across three settings -- classical linkage incidents, a controlled benchmark (InferLink) that varies fingerprint type, task framing, and attacker knowledge, and open-ended human--AI interaction traces. In the sparsest regime of the Netflix Prize deanonymization setting, agents reconstruct 79.2% of identities, against 56.0% for a classical matching baseline; on InferLink, they link individuals even without an explicit re-identification request, and more often once one is given. In redacted human--AI interaction traces, agents further resolve anonymized profiles to specific individuals by corroborating contextual cues with public evidence. These findings suggest that privacy evaluations for agentic systems should measure not only what information is accessed or disclosed, but also what identities can be inferred.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 17 of its 26 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

17 of 26 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Automated Profile Inference with Language Model Agents18 May
  2. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  3. 2025AgentDAM: Privacy Leakage Evaluation for Autonomous Web Agents12 Mar
  4. 2024AirGapAgent: Protecting Privacy-Conscious Conversational Agents8 May

Other references · 13

  1. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  2. 2020Extracting Training Data from Large Language Modelscited by 2,189
  3. 2021Membership Inference Attacks From First Principlescited by 878
  4. 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 230
  5. 2023Beyond Memorization: Violating Privacy Via Inference with Large Language Modelscited by 175
  6. 2024PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Actioncited by 171
  7. 2024The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG)cited by 159
  8. 2023Practical Membership Inference Attacks Against Large-Scale Multi-Modal Models: A Pilot Studycited by 38
  9. 2025CIMemories: A Compositional Benchmark for Contextual Integrity of Persistent Memory in LLMscited by 26
  10. 2026Large-scale online deanonymization with LLMscited by 14
  11. 2026Agentic LLMs as Powerful Deanonymizers: Re-identification of Participants in the Anthropic Interviewer Datasetcited by 7
  12. 2025Web-Browsing LLMs Can Access Social Media Profiles and Infer User Demographicscited by 3
1 more
  1. 2025Retracing the Past: LLMs Emit Training Data When They Get Lostcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Privacy-Preserving RAG via Multi-Agent Semantic Rewriting: Achieving Confidentiality Without Compromising Contextual Fidelity
  2. 2026OCELOT: Inference-Leakage Budgets for Privacy-Preserving LLM Agents
  3. 2026The Claws in Plain Sight: Unauthorized Context Disclosure through LLM Agent Tool Calls
  4. 2026Confuse the Model, Control the Flow: Understanding and Mitigating Privacy Leakage from LLM Agents with Information Flow Control
  5. 2026BodhiPromptShield: Pre-Inference Prompt Mediation for Surface-Form Privacy Propagation in LLM Agent Pipelines
  6. 2026PrivacyAlign: Contextual Privacy Alignment for LLM Agents
  7. 2025Exposing LLM User Privacy via Traffic Fingerprint Analysis: A Study of Privacy Risks in LLM Agent Interactions
  8. 2026PrivacySkills: How Privacy Guidance Shapes Source Selection in LLM Agents