mlsanityData to 7 Oct 2026

Benefits and Harms of Large Language Models in Digital Mental Health

arXiv 2311.14693 ↗First posted 7 Nov 2023cs.CL cs.AI cs.CYcited by 39

Not on the map. Why?

Abstract (arXiv)

The past decade has been transformative for mental health research and practice. The ability to harness large repositories of data, whether from electronic health records (EHR), mobile devices, or social media, has revealed a potential for valuable insights into patient experiences, promising early, proactive interventions, as well as personalized treatment plans. Recent developments in generative artificial intelligence, particularly large language models (LLMs), show promise in leading digital mental health to uncharted territory. Patients are arriving at doctors' appointments with information sourced from chatbots, state-of-the-art LLMs are being incorporated in medical software and EHR systems, and chatbots from an ever-increasing number of startups promise to serve as AI companions, friends, and partners. This article presents contemporary perspectives on the opportunities and risks posed by LLMs in the design, development, and implementation of digital mental health tools. We adopt an ecological framework and draw on the affordances offered by LLMs to discuss four application areas -- care-seeking behaviors from individuals in need of care, community care provision, institutional and medical care provision, and larger care ecologies at the societal level. We engage in a thoughtful consideration of whether and how LLM-based technologies could or should be employed for enhancing mental health. The benefits and harms our article surfaces could serve to help shape future research, advocacy, and regulatory efforts focused on creating more responsible, user-friendly, equitable, and secure LLM-based tools for mental health treatment and intervention.

Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 26 of its 165 references that are in the map. First posted on arXiv 7 Nov 2023.

Builds on

26 of 165 references.

References · 26

  1. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  2. 2018Datasheets for Datasetscited by 1,371
  3. 2018Model Cards for Model Reportingcited by 1,068
  4. 2021Ethical and social risks of harm from Language Modelscited by 957
  5. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
  6. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  7. 2023Can Large Language Models Transform Computational Social Science?cited by 245
  8. 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
  9. 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
  10. 2019Assessing Social and Intersectional Biases in Contextualized Word Representationscited by 134
  11. 2020Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Datacited by 85
  12. 2020Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender Biascited by 82
14 more
  1. 2023Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queriescited by 82
  2. 2023Cognitive Reframing of Negative Thoughts through Human-Language Model Interactioncited by 77
  3. 2021Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approachcited by 75
  4. 2023Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Supportcited by 75
  5. 2022Human-AI Collaboration Enables More Empathic Conversations in Text-based Peer-to-Peer Mental Health Supportcited by 68
  6. 2023Can Language Models be Instructed to Protect Personal Information?cited by 46
  7. 2020Investigating Gender Bias in BERTcited by 40
  8. 2022Inducing Positive Perspectives with Text Reframingcited by 31
  9. 2023Training Models to Generate, Recognize, and Reframe Unhelpful Thoughtscited by 31
  10. 2023Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedbackcited by 23
  11. 2021ENTRUST: Argument Reframing with Language Models and Entailmentcited by 10
  12. 2023The Dimensions of Data Labor: A Road Map for Researchers, Activists, and Policymakers to Empower Data Producerscited by 6
  13. 2021On the Universality of Deep Contextual Language Modelscited by 4
  14. 2023The Role of Large Language Models in the Recognition of Territorial Sovereignty: An Analysis of the Construction of Legitimacycited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 16; 2025: 15; 2026: 7.

39 papers.

Sort:

By area:

  1. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  2. 2025Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providerscited by 67
  3. 2024A Computational Framework for Behavioral Assessment of LLM Therapistscited by 61
  4. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  5. 2024The Typing Cure: Experiences with Large Language Model Chatbots for Mental Health Supportcited by 23
  6. 2024Towards a Client-Centered Assessment of LLM Therapists by Client Simulationcited by 23
  7. 2024Can AI Relate: Testing Large Language Model Response for Mental Health Supportcited by 21
  8. 2024Do Large Language Models Align with Core Mental Health Counseling Competencies?cited by 19
  9. 2024Lived Experience Not Found: LLMs Struggle to Align with Experts on Addressing Adverse Drug Reactions from Psychiatric Medication Usecited by 17
  10. 2025AI Chatbots for Mental Health: Values and Harms from Lived Experiences of Depressioncited by 13
  11. 2025Mapping Caregiver Needs to AI Chatbot Design: Strengths and Gaps in Mental Health Support for Alzheimer's and Dementia Caregiverscited by 13
  12. 2024Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosiscited by 12
27 more
  1. 2025Exploring User Security and Privacy Attitudes and Concerns Toward the Use of General-Purpose LLM Chatbots for Mental Healthcited by 12
  2. 2026RubRIX: Rubric-Driven Risk Mitigation in Caregiver-AI Interactionscited by 10
  3. 2026PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Supportcited by 7
  4. 2025Linguistic Comparison of AI- and Human-Written Responses to Online Mental Health Queriescited by 6
  5. 2024Antagonistic AIcited by 5
  6. 2024"I Like Sunnie More Than I Expected!": Exploring User Expectation and Perception of an Anthropomorphic LLM-based Conversational Agent for Well-Being Supportcited by 5
  7. 2025Interpersonal Theory of Suicide as a Lens to Examine Suicidal Ideation in Online Spacescited by 5
  8. 2024Enhancing Psychotherapy Counseling: A Data Augmentation Pipeline Leveraging Large Language Models for Counseling Conversationscited by 3
  9. 2024Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulnesscited by 3
  10. 2025Position: Beyond Assistance -- Reimagining LLMs as Ethical and Adaptive Co-Creators in Mental Health Carecited by 3
  11. 2025RedditESS: A Mental Health Social Support Interaction Dataset -- Understanding Effective Social Support to Refine AI-Driven Support Toolscited by 3
  12. 2025A Framework for Situating Innovations, Opportunities, and Challenges in Advancing Vertical Systems with Large AI Modelscited by 2
  13. 2025Seeking Late Night Life Lines: Experiences of Conversational AI Use in Mental Health Crisiscited by 2
  14. 2024Building Multilingual Datasets for Predicting Mental Health Severity through LLMs: Prospects and Challengescited by 1
  15. 2024Mitigating Hallucinations Using Ensemble of Knowledge Graph and Vector Store in Large Language Models to Enhance Mental Health Supportcited by 1
  16. 2024A Risk Taxonomy and Reflection Tool for Large Language Model Adoption in Public Healthcited by 1
  17. 2025AI-Augmented LLMs Achieve Therapist-Level Responses in Motivational Interviewingcited by 1
  18. 2025Human vs. LLM-Based Thematic Analysis for Digital Mental Health Research: Proof-of-Concept Comparative Studycited by 1
  19. 2026The Slow Drift of Support: Boundary Failures in Multi-Turn Mental Health LLM Dialoguescited by 1
  20. 2026A Checklist for Trustworthy, Safe, and User-Friendly Mental Health Chatbotscited by 1
  21. 2024Should ChatGPT Write Your Breakup Text? Exploring the Role of AI in Relationship Dissolutioncited by 0
  22. 2025When LLM Therapists Become Salespeople: Evaluating Large Language Models for Ethical Motivational Interviewingcited by 0
  23. 2025Navigating the Rabbit Hole: Emergent Biases in LLM-Generated Attack Narratives Targeting Mental Health Groupscited by 0
  24. 2025PolicyPad: Collaborative Prototyping of LLM Policiescited by 0
  25. 2026Analyzing LLM Reasoning to Uncover Mental Health Stigmacited by 0
  26. 2026When AI Says "I have been in similar situations": Synthetic Lived Experience in Peer-Like Caregiver Supportcited by 0
  27. 2026One Year Later...The Harms Persist, But So Do We!cited by 0