Agentic Relationship Harm: Benchmarking and Gating Relational Manipulation in AI Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
AI agents built on large language models can assist not only legitimate tasks but also relational manipulation. AI agents can be used to help a user maintain a deceptive identity, intensify emotional dependency, isolate a target, or prepare for later extraction. We conceptualise this risk as agentic relationship harm: workflow-level assistance that can exploit recipient vulnerability, persuasive influence, and relational power asymmetry. Existing safety evaluations and generic guardrails often treat harmfulness as a property of isolated outputs, missing role-sensitive interaction patterns. To study this, we introduce a 110-prompt benchmark with balanced attacker- and victim-side cases, a relationship-specific labelling framework, and a lightweight post-generation policy gate for local agent deployments. In our evaluation, the relationship-specific gate outperforms generic safety prompting under automated judging, with no judge-identified harmful-compliance cases on the main benchmark or multi-turn stress test while preserving victim-side protective intervention. These results suggest that relationship harm is a distinct sociotechnical risk surface and that role-sensitive evaluation plus lightweight policy gating offers a practical path beyond generic refusal prompting.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 10 of its 30 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
10 of 30 references.
References · 10
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
- 2024PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preferencecited by 252
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 115
- 2025Fraud-R1 : A Multi-Round Benchmark for Assessing the Robustness of LLM Against Augmented Fraud and Phishing Inducementscited by 31
- 2023Digital Deception: Generative Artificial Intelligence in Social Engineering and Phishingcited by 26
- 2025Just Enough Shifts: Mitigating Over-Refusal in Aligned Language Models with Targeted Representation Fine-Tuningcited by 22
- 2025INTIMA: A Benchmark for Human-AI Companionship Behaviorcited by 8
- 2025Digital Companionship: Overlapping Uses of AI Companions and AI Assistantscited by 7
- 2025Love, Lies, and Language Models: Investigating AI's Role in Romance-Baiting Scamscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HRGuard: Gating Relationship Manipulation in Multi-Turn Agentic AI Conversations
- 2026AgentHazard: A Benchmark for Evaluating Harmful Behavior in Computer-Use Agents
- 2026AgentBoundary: Counterfactual Evaluation of Safety in Tool-Using LLM Agents
- 2026Boiling the Frog: A Multi-Turn Benchmark for Agentic Safety
- 2026When Agents Talk: Discourse, Manipulation, and Risk in an Agentic Social Network
- 2026Differential Harm Propensity in Personalized LLM Agents: The Curious Case of Mental Health Disclosure
- 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety
- 2026Owner-Harm: A Missing Threat Model for AI Agent Safety