CompanionSafe: From Multi-turn Safety Evaluation to Guardrails for AI Companions
On the map: LLM safety and security → Safety alignment, refusal and guardrails also fits: Prompt injection and agent security
Abstract (arXiv)
AI companions provide users with emotional support and ongoing companionship, but their sustained relational interactions also introduce distinct safety risks. Prior work largely targets general harms or specific companion platforms and risk categories, while relying on manually collected conversations, limiting scalable and user-grounded evaluation and mitigation. To address this, we introduce CompanionSafe, a unified evaluation-to-mitigation framework for AI companion safety. Its evaluation component, CompanionEval, provides scalable multi-turn evaluation by constructing 1,300 relationally grounded settings from diverse personas, matched companion characters, and dialogue scenarios across four turn tiers. Its mitigation component, CompanionGuard, converts benchmark-exposed failures into turn-localized supervision for companion-specific risk detection. Our results show that even strong LLMs and existing guard models remain vulnerable to companion-specific relational harms, while both closed- and open-source models exhibit increasing safety risks as interactions become longer. Together, CompanionEval and CompanionGuard form a practical evaluation-to-mitigation loop for AI companion safety, turning relational safety failures exposed during multi-turn interaction into supervision for companion-specific guardrails.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 20 of its 48 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
20 of 48 references.
Closest ancestors · 3
Same direction, newest first
- 2026EduZone: A Framework for Evaluating LLM Safety for K-12 Students and Teachers3 Aug
- 2026MindGuard: Guardrail Classifiers for Multi-Turn Mental Health Support1 Feb
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs26 Jun
Other references · 17
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
- 2024The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationshipscited by 62
- 2026MiniMax Sparse Attentioncited by 44
- 2025MTSA: Multi-turn Safety Alignment for LLMs through Multi-round Red-teamingcited by 32
- 2025Mental Health Impacts of AI Companions: Triangulating Social Media Quasi-Experiments, User Perspectives, and Relational Theorycited by 9
- 2026DARWIN: Evolving Jailbreak Adversary and Guardrail for LLM Safety Evaluation and Protectioncited by 6
- 2026CompanionBench: A Theory-Anchored, Real-World-Grounded Benchmark for AI Emotional Companionshipcited by 5
- 2026Persona-Grounded Safety Evaluation of AI Companions in Multi-Turn Conversationscited by 4
- 2025Benchmarking and Understanding Safety Risks in AI Character Platformscited by 2
- 2026MultiTurnPSB: Evaluating Multi-Turn Jailbreak Attacks an dClassifier-Based Defenses for Medical AI Safetycited by 2
- 2026CompanionHarm: A Multi-Turn Benchmark for Detecting Harms in Real-World AI Companion Conversationscited by 2
5 more
- 2026Negotiating Digital Identities with AI Companions: Motivations, Strategies, and Emotional Outcomescited by 1
- 2026EUDAIMONIA: Evaluating Undesirable Dynamics in AIcited by 1
- 2026AICompanionBench: Benchmarking LLMs-as-Judges for AI Companion Safetycited by 1
- 2026Long-Term Simulation Exposes Cognitive-Developmental Risks in AI Companionscited by 1
- 2026CAREBench: A Child-Safety Risk Benchmark for Language Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HRGuard: Gating Relationship Manipulation in Multi-Turn Agentic AI Conversations
- 2026Beyond Unsafe Detection: Counterfactually Anchored Evidence Attribution for Multi-Turn LLM Safety Failures
- 2025SAGE: A Generic Framework for LLM Safety Evaluation
- 2026Agentic Relationship Harm: Benchmarking and Gating Relational Manipulation in AI Agents
- 2025"Even GPT Can Reject Me": Conceptualizing Abrupt Refusal Secondary Harm (ARSH) and Reimagining Psychological AI Safety with Compassionate Completion Standard (CCS)
- 2026SafePro: Evaluating the Safety of Professional-Level AI Agents
- 2026CR4T: Rewrite-Based Guardrails for Adolescent LLM Safety
- 2025DynaGuard: A Dynamic Guardian Model With User-Defined Policies