When Agents Learn to Be You: Benchmarking Privacy Leakage, Impersonation Risk, and Defenses in Persona Skills
Not on the map. Why?
Abstract (arXiv)
Persona skills distill personal interaction histories into portable and executable artifacts for downstream agents. While enabling flexible personalization, this process concentrates fragmented personal signals, amplifies their impact through reuse, and challenges defenses designed for individual records or retrieval-based memory. To systematically investigate the safety of the persona-skill pipeline, we introduce AntiSkillBench, an end-to-end benchmark for evaluating risks and defenses across the persona-skill pipeline. It comprises: (i) a dataset of 7,500 persona-grounded dialogue traces, constructed from 50 behaviorally rich profiles spanning diverse task scenarios; (ii) an evaluation suite that measures skill-level privacy leakage and agent-level attribute disclosure and behavioral impersonation across three skill-distillation strategies; and (iii) a defense evaluation covering four configurations across online and post-hoc interventions, including active risk suppression and passive provenance protection. Experiments across three frontier agents show that persona-skill risks persist across agent backbones and distillation protocols, extending from explicit attributes to communication styles and personality traits. Existing defenses exhibit limited and distillation-dependent effectiveness, failing to generalize across risk and distillation strategies. These results highlight AntiSkillBench as a challenging benchmark for developing privacy-preserving and authenticity-aware persona skills.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 46 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
25 of 46 references.
References · 25
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 230
- 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 97
- 2024LongLaMP: A Benchmark for Personalized Long-form Text Generationcited by 97
- 2025OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personascited by 25
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 15
- 2025Malicious LLM-Based Conversational AI Makes Users Reveal Personal Informationcited by 13
- 2024Defending Multimodal Backdoored Models by Repulsive Visual Prompt Tuningcited by 12
- 2025PrivacyBench: A Conversational Benchmark for Evaluating Privacy in Personalized AIcited by 12
13 more
- 2025IMPersona: Evaluating Individual Level LM Impersonationcited by 11
- 2026When Safety Collides: Resolving Multi-Category Harmful Conflicts in Text-to-Image Diffusion via Adaptive Safety Guidancecited by 11
- 2025AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editingcited by 10
- 2025Jailbreaking the Non-Transferable Barrier via Test-Time Data Disguisingcited by 8
- 2026VII: Visual Instruction Injection for Jailbreaking Image-to-Video Generation Modelscited by 7
- 2026MemPrivacy: Privacy-Preserving Personalized Memory Management for Edge-Cloud Agentscited by 7
- 2026Poise: Position-Aware One-Instruction Skill Injection for Silent Execution on LLM Agentscited by 7
- 2026ToolPrivacyBench: Benchmarking Purpose-Bound Privacy in Tool-Using LLM Agentscited by 7
- 2025DAMR: Efficient and Adaptive Context-Aware Knowledge Graph Question Answering with LLM-Guided MCTScited by 6
- 2026PrivacyPeek: Auditing What LLM-Based Agents Acquire, Not Just What They Saycited by 6
- 2026Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customizationcited by 5
- 2026DisRFM: Polar Riemannian Flow Matching for Structure-Preserving Graph Domain Adaptationcited by 4
- 2026COLLEAGUE.SKILL: Automated AI Skill Generation via Expert Knowledge Distillationcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.