mlsanityData to 7 Oct 2026

An LLM-based Simulation Framework for Embodied Conversational Agents in Psychological Counseling

arXiv 2410.22041 ↗First posted 29 Oct 2024cs.HCcited by 0

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Due to privacy concerns, open dialogue datasets for mental health are primarily generated through human or AI synthesis methods. However, the inherent implicit nature of psychological processes, particularly those of clients, poses challenges to the authenticity and diversity of synthetic data. In this paper, we propose ECAs (short for Embodied Conversational Agents), a framework for embodied agent simulation based on Large Language Models (LLMs) that incorporates multiple psychological theoretical principles.Using simulation, we expand real counseling case data into a nuanced embodied cognitive memory space and generate dialogue data based on high-frequency counseling questions.We validated our framework using the D4 dataset. First, we created a public ECAs dataset through batch simulations based on D4. Licensed counselors evaluated our method, demonstrating that it significantly outperforms baselines in simulation authenticity and necessity. Additionally, two LLM-based automated evaluation methods were employed to confirm the higher quality of the generated dialogues compared to the baselines. The source code and dataset are available at https://github.com/AIR-DISCOVER/ECAs-Dataset.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 39 references that are in the map. First posted on arXiv 29 Oct 2024.

Builds on

15 of 39 references.

References · 15

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  2. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  3. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
  4. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 246
  5. 2024A Note on Shumailov et al. (2024): `AI Models Collapse When Trained on Recursively Generated Data'cited by 114
  6. 2023Mitigating Label Biases for In-context Learningcited by 88
  7. 2023Training Socially Aligned Language Models on Simulated Social Interactionscited by 77
  8. 2023Humanoid Agents: Platform for Simulating Human-like Generative Agentscited by 73
  9. 2024Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principlescited by 72
  10. 2023A Short Survey of Viewing Large Language Models in Legal Aspectcited by 51
  11. 2022D4: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chatcited by 37
  12. 2024Evaluating LLM -- Generated Multimodal Diagnosis from Medical Images and Symptom Analysiscited by 23
3 more
  1. 2024Towards a Client-Centered Assessment of LLM Therapists by Client Simulationcited by 23
  2. 2024Leveraging Large Language Model as Simulated Patients for Clinical Educationcited by 20
  3. 2024PATIENT-Psi: Using Large Language Models to Simulate Patients for Training Mental Health Professionalscited by 19

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Interactive Agents: Simulating Counselor-Client Psychological Counseling via Role-Playing LLM-to-LLM Interactions
  2. 2026Mind Companion: An Embodied Conversational Agent for Process-Based Psychotherapy
  3. 2025MAGneT: Coordinated Multi-Agent Generation of Synthetic Multi-Turn Mental Health Counseling Sessions
  4. 2026StoryMI: Steerable Multi-Agent Therapeutic Dialogue Generation
  5. 2025MindEval: Benchmarking Language Models on Multi-turn Mental Health Support
  6. 2026TherapyGym: Evaluating and Aligning Clinical Fidelity and Safety in Therapy Chatbots
  7. 2025ESC-Judge: A Framework for Comparing Emotional Support Conversational Agents
  8. 2026How a Chatbot's Response Style Shapes a Classroom: A Multi-Agent Simulation of Students Consulting AI