mlsanityData to 14 Oct 2026

Psychological Influences of Conversational AI: Research and Design Directions for Reducing Harm and Promoting Well-Being

arXiv 2607.25057 ↗First posted 27 Jul 2026cs.AI cs.CY cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

As conversational AI systems become increasingly integrated into daily life, their potential effects on user well-being require ongoing attention. While consumer-facing generalist models can provide benefits, including improved access to information, learning, productivity, self-reflection, and companionship, they also introduce risks, such as emotional entanglement, unhealthy dependence, and the amplification of psychological vulnerabilities. Drawing on prior research and empirical observations of AI chatbot behavior, we propose a set of aspirational directions for guiding the behavior of general-purpose AI systems in ways that may reduce potential psychological harms and support user well-being. We acknowledge the difficulty of systematically assessing the long-term impacts of AI chatbot use and frame these directions as hypotheses for studying how AI behavior may influence users across general interactions, role-playing scenarios, and contexts that could be characterized as providing psychological support. While some proposed directions are supported by existing research and expert insights, others identify open questions and areas requiring deeper study. We hope that this formulation and these hypotheses encourage further discussion, empirical investigation, and exploration of interactive design approaches aimed at better accommodating users' psychological needs and promoting their well-being.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 164 references that are in the map. First posted on arXiv 27 Jul 2026.

Builds on

31 of 164 references.

References · 31

  1. 2022Improving alignment of dialogue agents via targeted human judgementscited by 531
  2. 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 129
  3. 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 90
  4. 2025Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providerscited by 69
  5. 2024(A)I Am Not a Lawyer, But...: Engaging Legal Experts towards Responsible LLM Policies for Legal Advicecited by 63
  6. 2024The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationshipscited by 62
  7. 2024On Targeted Manipulation and Deception when Optimizing LLMs for User Feedbackcited by 47
  8. 2025Why human-AI relationships need socioaffective alignmentcited by 47
  9. 2024Risks from Language Models for Automated Mental Healthcare: Ethics and Structure for Implementationcited by 27
  10. 2024From Lived Experience to Insight: Unpacking the Psychological Risks of Using AI Conversational Agentscited by 25
  11. 2026Characterizing Delusional Spirals through Human-LLM Chat Logscited by 23
  12. 2025"My Boyfriend is AI": A Computational Analysis of Human-AI Companionship in Reddit's AI Communitycited by 20
19 more
  1. 2025Human Decision-making is Susceptible to AI-driven Manipulationcited by 19
  2. 2023Does GPT-4 surpass human performance in linguistic pragmatics?cited by 16
  3. 2024Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliancecited by 16
  4. 2024Generative Ghosts: Anticipating Benefits and Risks of AI Afterlivescited by 15
  5. 2025A Taxonomy of Linguistic Expressions That Contribute To Anthropomorphism of Language Technologiescited by 14
  6. 2025Dehumanizing Machines: Mitigating Anthropomorphic Behaviors in Text Generation Systemscited by 11
  7. 2025AI Automatons: AI Systems Intended to Imitate Humanscited by 10
  8. 2026A clinically validated framework for auditing AI chatbot behavior in mental health interactionscited by 9
  9. 2024Private Yet Social: How LLM Chatbots Support and Challenge Eating Disorder Recoverycited by 8
  10. 2025Harmful Traits of AI Companionscited by 6
  11. 2020Population-Scale Study of Human Needs During the COVID-19 Pandemic: Analysis and Implicationscited by 4
  12. 2025"AI Afterlife" as Digital Legacy: Perceptions, Expectations, and Concernscited by 4
  13. 2025Illusions of Intimacy: How Emotional Dynamics Shape Human-AI Relationshipscited by 4
  14. 2020The Tools and Tactics Used in Intimate Partner Surveillance: An Analysis of Online Infidelity Forumscited by 3
  15. 2021SoK: A Framework for Unifying At-Risk User Researchcited by 3
  16. 2025Can LLMs Talk 'Sex'? Exploring How AI Models Handle Intimate Conversationscited by 2
  17. 2025Seeking Late Night Life Lines: Experiences of Conversational AI Use in Mental Health Crisiscited by 2
  18. 2026Single-turn emergency psychiatric triage across 15 frontier AI chatbotscited by 2
  19. 2025Beyond Algorethics: Addressing the Ethical and Anthropological Challenges of AI Recommender Systemscited by 1

Built on by

Not cited yet.