Assessing the Applicability of Existing Design Recommendations to AI Companion Design: A Multi-Method Study
Not on the map. Why?
Abstract (arXiv)
With the rapid proliferation of large language model (LLM)-based systems, AI companions have emerged as conversational agents designed to cultivate emotional connection rather than primarily to support humans in instrumental tasks. Because engagement with AI companions involves relational, emotional, and potentially long-term interactions, their design is consequential. Prior work has offered guidance for designing trustworthy and relational AI systems and has begun to examine design for AI companionship. However, while such work provides insights into possible design solutions, less is known about what makes AI companion design difficult as a design problem. To examine this challenge, we assessed the applicability of existing design recommendations from adjacent domains in the context of AI companion design. Our multi-method investigation unfolded across four phases: literature review, practitioner co-analysis, internal heuristic evaluation, and external expert assessment. Throughout this process, we synthesized nine design principle areas that surfaced tensions in the applicability of existing recommendations to AI companion design. Our findings show that ethical and UX-oriented considerations are deeply intertwined and often require context-sensitive application. We document a systematic, multi-method problem analysis that uses these principle areas as an analytic artifact to examine why existing recommendations cannot be directly transferred to AI companion contexts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 76 references that are in the map. First posted on arXiv 13 Sep 2026.
Builds on
13 of 76 references.
References · 13
- 2021Trustworthy AI: From Principles to Practicescited by 207
- 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 183
- 2019The relationship between trust in AI and trustworthy machine learning technologiescited by 78
- 2024The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationshipscited by 62
- 2024Design Principles for Generative AI Applicationscited by 57
- 2022How Different Groups Prioritize Ethical Values for Responsible AIcited by 49
- 2022Designing for Responsible Trust in AI Systems: A Communication Perspectivecited by 48
- 2017Evaluating Quality of Chatbots and Intelligent Conversational Agentscited by 16
- 2025Longitudinal Study on Social and Emotional Use of AI Conversational Agentcited by 10
- 2020Developing a Personality Model for Speech-based Conversational Agents Using the Psycholexical Approachcited by 8
- 2025Digital Companionship: Overlapping Uses of AI Companions and AI Assistantscited by 7
- 2023Towards User-Centric Guidelines for Chatbot Conversational Designcited by 6
1 more
- 2022How to Assess Trustworthy AI in Practicecited by 4
Built on by
Not cited yet.