mlsanityData to 7 Oct 2026

LLM-empowered Chatbots for Psychiatrist and Patient Simulation: Application and Evaluation

arXiv 2305.13614 ↗First posted 23 May 2023cs.CLcited by 33

Not on the map. Why?

Abstract (arXiv)

Empowering chatbots in the field of mental health is receiving increasing amount of attention, while there still lacks exploration in developing and evaluating chatbots in psychiatric outpatient scenarios. In this work, we focus on exploring the potential of ChatGPT in powering chatbots for psychiatrist and patient simulation. We collaborate with psychiatrists to identify objectives and iteratively develop the dialogue system to closely align with real-world scenarios. In the evaluation experiments, we recruit real psychiatrists and patients to engage in diagnostic conversations with the chatbots, collecting their ratings for assessment. Our findings demonstrate the feasibility of using ChatGPT-powered chatbots in psychiatric scenarios and explore the impact of prompt designs on chatbot behavior and user experience.

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Builds on 13 of its 34 references that are in the map. First posted on arXiv 23 May 2023.

Builds on

13 of 34 references.

References · 13

  1. 2021Towards Emotional Support Dialog Systemscited by 294
  2. 2022DDXPlus: A New Dataset For Automatic Medical Diagnosiscited by 87
  3. 2021CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generationcited by 81
  4. 2019End-to-End Knowledge-Routed Relational Dialogue System for Automatic Diagnosiscited by 70
  5. 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
  6. 2023Evaluation of ChatGPT for NLP-based Mental Health Applicationscited by 53
  7. 2023Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Datacited by 48
  8. 2022D4: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chatcited by 37
  9. 2021Transferable Dialogue Systems and User Simulatorscited by 35
  10. 2020Graph-Evolving Meta-Learning for Low-Resource Medical Dialogue Generationcited by 24
  11. 2022Symptom Identification for Interpretable Detection of Multiple Mental Disorderscited by 20
  12. 2022Chatbots for Mental Health Support: Exploring the Impact of Emohaa on Reducing Mental Distress in Chinacited by 17
1 more
  1. 2023Read, Diagnose and Chat: Towards Explainable and Interactive LLMs-Augmented Depression Detection in Social Mediacited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 9; 2024: 13; 2025: 10; 2026: 1.

33 papers.

Sort:

By area:

  1. 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
  2. 2023ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewingcited by 118
  3. 2024Automatic Interactive Evaluation for Large Language Models with State Aware Patient Simulatorcited by 36
  4. 2023ChaCha: Leveraging Large Language Models to Prompt Children to Share Their Emotions about Personal Eventscited by 31
  5. 2023Enhancing Psychological Counseling with Large Language Model: A Multifaceted Decision-Support System for Non-Professionalscited by 24
  6. 2024Leveraging Large Language Model as Simulated Patients for Clinical Educationcited by 20
  7. 2023User Modeling in the Era of Large Language Models: Current Research and Future Directionscited by 18
  8. 2024Large Language Model for Mental Health: A Systematic Reviewcited by 14
  9. 2025Technological folie `a deux: Feedback Loops Between AI Chatbots and Mental Illnesscited by 14
  10. 2023An Automatic Evaluation Framework for Multi-turn Medical Consultations Capabilities of Large Language Modelscited by 13
  11. 2024Prompt engineering paradigms for medical applications: scoping review and recommendations for better practicescited by 13
  12. 2025A Survey of Scaling in Large Language Model Reasoningcited by 10
21 more
  1. 2023Supervised Learning and Large Language Model Benchmarks on Mental Health Datasets: Cognitive Distortions and Suicidal Risks in Chinese Social Mediacited by 9
  2. 2025Preference Learning Unlocks LLMs' Psycho-Counseling Skillscited by 9
  3. 2023Towards a Psychological Generalist AI: A Survey of Current Applications of Large Language Models and Future Prospectscited by 8
  4. 2024A Comprehensive Evaluation of Large Language Models on Mental Illnessescited by 7
  5. 2024Hybrid Training Approaches for LLMs: Leveraging Real and Synthetic Data to Enhance Model Performance in Domain-Specific Applicationscited by 7
  6. 2024AGENT-CQ: Automatic Generation and Evaluation of Clarifying Questions for Conversational Search with LLMscited by 7
  7. 2025Modeling Challenging Patient Interactions: LLMs for Medical Communication Trainingcited by 7
  8. 2024Harnessing Large Language Models Over Transformer Models for Detecting Bengali Depressive Social Media Text: A Comprehensive Studycited by 6
  9. 2024Large Language Multimodal Models for 5-Year Chronic Disease Cohort Prediction Using EHR Datacited by 5
  10. 2024Toward Large Language Models as a Therapeutic Tool: Comparing Prompting Techniques to Improve GPT-Delivered Problem-Solving Therapycited by 5
  11. 2025MADP: Multi-Agent Deductive Planning for Enhanced Cognitive-Behavioral Mental Health Question Answercited by 3
  12. 2024MedDiT: A Knowledge-Controlled Diffusion Transformer Framework for Dynamic Medical Image Generation in Virtual Simulated Patientcited by 2
  13. 2024Mixed Chain-of-Psychotherapies for Emotional Support Chatbotcited by 2
  14. 2025Increasing happiness through conversations with artificial intelligencecited by 2
  15. 2025TRUST: An LLM-Based Dialogue System for Trauma Understanding and Structured Assessmentscited by 2
  16. 2025DS@GT at eRisk 2025: From prompts to predictions, benchmarking early depression detection with conversational agent based assessments and temporal attention modelscited by 1
  17. 2025H-DDx: A Hierarchical Evaluation Framework for Differential Diagnosiscited by 1
  18. 2025From Medical Records to Diagnostic Dialogues: A Clinical-Grounded Approach and Dataset for Psychiatric Comorbiditycited by 1
  19. 2023Considerations for health care institutions training large language models on electronic health recordscited by 0
  20. 2023Experts-in-the-Loop: Establishing an Effective Workflow in Crafting Privacy Q&Acited by 0
  21. 2026One Year Later...The Harms Persist, But So Do We!cited by 0