Principles of Safe AI Companions for Youth: Parent and Expert Perspectives
Not on the map. Why?
Abstract (arXiv)
AI companions are increasingly popular among teenagers, yet current platforms lack safeguards to address developmental risks and harmful normalization. Despite growing concerns, little is known about how parents and developmental psychology experts assess these interactions or what protections they consider necessary. We conducted 26 semi structured interviews with parents and experts, who reviewed real world youth GenAI companion conversation snippets. We found that stakeholders assessed risks contextually, attending to factors such as youth maturity, AI character age, and how AI characters modeled values and norms. We also identified distinct logics of assessment: parents flagged single events, such as a mention of suicide or flirtation, as high risk, whereas experts looked for patterns over time, such as repeated references to self harm or sustained dependence. Both groups proposed interventions, with parents favoring broader oversight and experts preferring cautious, crisis-only escalation paired with youth facing safeguards. These findings provide directions for embedding safety into AI companion design.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Oct 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025"I am here for you": How relational conversational AI appeals to adolescents, especially those who are socially and emotionally vulnerablecited by 2
- 2026AICompanionBench: Benchmarking LLMs-as-Judges for AI Companion Safetycited by 1
- 2026Beyond "I Can't Help With That": How Child Safety Experts Evaluate AI Chatbot Safetycited by 0
- 2026"AI Is Turning Too Human": How Teenagers Experience and Negotiate AI in Everyday Lifecited by 0
- 2026Right Words, Wrong Moment: A Clinician-Grounded Analysis of Distress in 19,930 Conversations between Young People and ChatGPTcited by 0
- 2026Understanding Parents' Complex Views of AI for Children's Pretend Playcited by 0
- 2026Understanding Parents' Complex Views of AI for Children's Pretend Play30 Sep 2026
- 2026Right Words, Wrong Moment: A Clinician-Grounded Analysis of Distress in 19,930 Conversations between Young People and ChatGPT28 Sep 2026
- 2026"AI Is Turning Too Human": How Teenagers Experience and Negotiate AI in Everyday Life18 Aug 2026
- 2026Beyond "I Can't Help With That": How Child Safety Experts Evaluate AI Chatbot Safety8 Aug 2026
- 2026AICompanionBench: Benchmarking LLMs-as-Judges for AI Companion Safety3 Jun 2026
- 2025"I am here for you": How relational conversational AI appeals to adolescents, especially those who are socially and emotionally vulnerable17 Dec 2025