Large Language Model for Mental Health: A Systematic Review
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have attracted significant attention for potential applications in digital health, while their application in mental health is subject to ongoing debate. This systematic review aims to evaluate the usage of LLMs in mental health, focusing on their strengths and limitations in early screening, digital interventions, and clinical applications. Adhering to PRISMA guidelines, we searched PubMed, IEEE Xplore, Scopus, JMIR, and ACM using keywords: 'mental health OR mental illness OR mental disorder OR psychiatry' AND 'large language models'. We included articles published between January 1, 2017, and April 30, 2024, excluding non-English articles. 30 articles were evaluated, which included research on mental health conditions and suicidal ideation detection through text (n=15), usage of LLMs for mental health conversational agents (CAs) (n=7), and other applications and evaluations of LLMs in mental health (n=18). LLMs exhibit substantial effectiveness in detecting mental health issues and providing accessible, de-stigmatized eHealth services. However, the current risks associated with the clinical use might surpass their benefits. The study identifies several significant issues: the lack of multilingual datasets annotated by experts, concerns about the accuracy and reliability of the content generated, challenges in interpretability due to the 'black box' nature of LLMs, and persistent ethical dilemmas. These include the lack of a clear ethical framework, concerns about data privacy, and the potential for over-reliance on LLMs by both therapists and patients, which could compromise traditional medical practice. Despite these issues, the rapid development of LLMs underscores their potential as new clinical aids, emphasizing the need for continued research and development in this area.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 35 of its 184 references that are in the map. First posted on arXiv 19 Feb 2024.
Builds on
35 of 184 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2020A Primer in BERTology: What we know about how BERT workscited by 807
- 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
- 2023Instruction Tuning for Large Language Models: A Surveycited by 617
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 487
- 2018Universal Sentence Encodercited by 485
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
23 more
- 2021Towards Emotional Support Dialog Systemscited by 294
- 2020ARBERT & MARBERT: Deep Bidirectional Transformers for Arabiccited by 164
- 2023Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigationcited by 123
- 2021PsyQA: A Chinese Dataset for Generating Long Counseling Text for Mental Health Supportcited by 92
- 2022AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversationcited by 79
- 2023Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Supportcited by 75
- 2023Evaluation of ChatGPT for NLP-based Mental Health Applicationscited by 53
- 2023Towards Interpretable Mental Health Analysis with Large Language Modelscited by 53
- 2023Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Datacited by 48
- 2023SMILE: Single-turn to Multi-turn Inclusive Language Expansion via ChatGPT for Mental Health Supportcited by 46
- 2023Psy-LLM: Scaling up Global Mental Health Psychological Services with AI-based Large Language Modelscited by 36
- 2022CAMS: An Annotated Corpus for Causal Analysis of Mental Health Issues in Social Media Postscited by 34
- 2024Large Language Models in Mental Health Care: a Scoping Reviewcited by 34
- 2023LLM-empowered Chatbots for Psychiatrist and Patient Simulation: Application and Evaluationcited by 33
- 2022Efficient Fine-Tuning of BERT Models on the Edgecited by 29
- 2020Suicidal Ideation and Mental Disorder Detection with Attentive Relation Networkscited by 28
- 2022Exploring The Design of Prompts For Applying GPT-3 based Chatbots: A Mental Wellbeing Case Study on Mechanical Turkcited by 13
- 2023Towards Healthy AI: Large Language Models Need Therapists Toocited by 13
- 2023Towards Designing a ChatGPT Conversational Companion for Elderly Peoplecited by 13
- 2024Socially Aware Synthetic Data Generation for Suicidal Ideation Detection Using Large Language Modelscited by 10
- 2023Recovering from Privacy-Preserving Masking with Large Language Modelscited by 9
- 2019Transfer Learning for Risk Classification of Social Media Posts: Model Evaluation Studycited by 1
- 2023Metric Ensembles For Hallucination Detectioncited by 1
Built on by
Citing papers per year: 2024: 6; 2025: 7; 2026: 1.
14 papers.
Sort:
By area:
- 2024Building Trust in Mental Health Chatbots: Safety Metrics and LLM-Based Evaluation Toolscited by 9
- 2024Advancing Depression Detection on Social Media Platforms Through Fine-Tuned Large Language Modelscited by 4
- 2024Copiloting Diagnosis of Autism in Real Clinical Scenarios via LLMscited by 3
- 2025Pet-Bench: Benchmarking the Abilities of Large Language Models as E-Pets in Social Network Servicescited by 3
- 2025H2HTalk: Evaluating Large Language Models as Emotional Companioncited by 3
- 2024Evaluating the Effectiveness of the Foundational Models for Q&A Classification in Mental Health carecited by 1
- 2024The use of GPT-4o and Other Large Language Models for the Improvement and Design of Self-Assessment Scales for Measurement of Interpersonal Communication Skillscited by 1
- 2025AI-Augmented LLMs Achieve Therapist-Level Responses in Motivational Interviewingcited by 1
- 2025A Confidence-Diversity Framework for Calibrating AI Judgement in Accessible Qualitative Coding Taskscited by 1
- 2024Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Modelscited by 0
- 2025When LLM Therapists Become Salespeople: Evaluating Large Language Models for Ethical Motivational Interviewingcited by 0
- 2025Artificial Empathy: AI based Mental Healthcited by 0
- 2026Generative Confidants: How do People Experience Trust in Emotional Support from Generative AI?23 Jan 2026
- 2025Context-Emotion Aware Therapeutic Dialogue Generation: A Multi-component Reinforcement Learning Approach to Language Models for Mental Health Support14 Nov 2025
- 2025A Confidence-Diversity Framework for Calibrating AI Judgement in Accessible Qualitative Coding Tasks4 Aug 2025
- 2025H2HTalk: Evaluating Large Language Models as Emotional Companion4 Jul 2025
- 2025Pet-Bench: Benchmarking the Abilities of Large Language Models as E-Pets in Social Network Services4 Jun 2025
- 2025Artificial Empathy: AI based Mental Health30 May 2025
- 2025AI-Augmented LLMs Achieve Therapist-Level Responses in Motivational Interviewing23 May 2025
- 2025When LLM Therapists Become Salespeople: Evaluating Large Language Models for Ethical Motivational Interviewing30 Mar 2025
- 2024Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Models18 Nov 2024
- 2024Copiloting Diagnosis of Autism in Real Clinical Scenarios via LLMs8 Oct 2024
- 2024Advancing Depression Detection on Social Media Platforms Through Fine-Tuned Large Language Models23 Sep 2024
- 2024The use of GPT-4o and Other Large Language Models for the Improvement and Design of Self-Assessment Scales for Measurement of Interpersonal Communication Skills21 Sep 2024
- 2024Advancing Depression Detection on Social Media Platforms Through Fine-Tuned Large Language Modelscited by 4
- 2024Copiloting Diagnosis of Autism in Real Clinical Scenarios via LLMscited by 3
- 2025Pet-Bench: Benchmarking the Abilities of Large Language Models as E-Pets in Social Network Servicescited by 3
- 2025H2HTalk: Evaluating Large Language Models as Emotional Companioncited by 3
- 2024Evaluating the Effectiveness of the Foundational Models for Q&A Classification in Mental Health carecited by 1
- 2024The use of GPT-4o and Other Large Language Models for the Improvement and Design of Self-Assessment Scales for Measurement of Interpersonal Communication Skillscited by 1
- 2025AI-Augmented LLMs Achieve Therapist-Level Responses in Motivational Interviewingcited by 1
- 2025A Confidence-Diversity Framework for Calibrating AI Judgement in Accessible Qualitative Coding Taskscited by 1
- 2024Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Modelscited by 0
- 2025When LLM Therapists Become Salespeople: Evaluating Large Language Models for Ethical Motivational Interviewingcited by 0
- 2025Artificial Empathy: AI based Mental Healthcited by 0
- 2025Context-Emotion Aware Therapeutic Dialogue Generation: A Multi-component Reinforcement Learning Approach to Language Models for Mental Health Supportcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Generative Confidants: How do People Experience Trust in Emotional Support from Generative AI?23 Jan 2026
- 2025Context-Emotion Aware Therapeutic Dialogue Generation: A Multi-component Reinforcement Learning Approach to Language Models for Mental Health Support14 Nov 2025
- 2025A Confidence-Diversity Framework for Calibrating AI Judgement in Accessible Qualitative Coding Tasks4 Aug 2025
- 2025H2HTalk: Evaluating Large Language Models as Emotional Companion4 Jul 2025
- 2025Pet-Bench: Benchmarking the Abilities of Large Language Models as E-Pets in Social Network Services4 Jun 2025
- 2025Artificial Empathy: AI based Mental Health30 May 2025
- 2025AI-Augmented LLMs Achieve Therapist-Level Responses in Motivational Interviewing23 May 2025
- 2025When LLM Therapists Become Salespeople: Evaluating Large Language Models for Ethical Motivational Interviewing30 Mar 2025
- 2024Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Models18 Nov 2024
- 2024Copiloting Diagnosis of Autism in Real Clinical Scenarios via LLMs8 Oct 2024
- 2024Advancing Depression Detection on Social Media Platforms Through Fine-Tuned Large Language Models23 Sep 2024
- 2024The use of GPT-4o and Other Large Language Models for the Improvement and Design of Self-Assessment Scales for Measurement of Interpersonal Communication Skills21 Sep 2024
12 newest of 13 All 13 (JSON)