Scaffolding Empathy: Training Counselors with Simulated Patients and Utterance-level Performance Visualizations
Not on the map. Why?
Abstract (arXiv)
Learning therapeutic counseling involves significant role-play experience with mock patients, with current manual training methods providing only intermittent granular feedback. We seek to accelerate and optimize counselor training by providing frequent, detailed feedback to trainees as they interact with a simulated patient. Our first application domain involves training motivational interviewing skills for counselors. Motivational interviewing is a collaborative counseling style in which patients are guided to talk about changing their behavior, with empathetic counseling an essential ingredient. We developed and evaluated an LLM-powered training system that features a simulated patient and visualizations of turn-by-turn performance feedback tailored to the needs of counselors learning motivational interviewing. We conducted an evaluation study with professional and student counselors, demonstrating high usability and satisfaction with the system. We present design implications for the development of automated systems that train users in counseling skills and their generalizability to other types of social skills training.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 20 of its 83 references that are in the map. First posted on arXiv 25 Feb 2025.
Builds on
20 of 83 references.
References · 20
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 281
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 191
- 2024Evaluating Large Language Model Biases in Persona-Steered Generationcited by 78
- 2024Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principlescited by 72
- 2024Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometricscited by 56
- 2023Rehearsal: Simulating Conflict to Teach Conflict Resolutioncited by 54
- 2024Automatic Interactive Evaluation for Large Language Models with State Aware Patient Simulatorcited by 36
- 2024A Chain-of-Thought Prompting Approach with LLMs for Evaluating Students' Formative Assessment Responses in Sciencecited by 31
- 2024Limited Ability of LLMs to Simulate Human Psychological Behaviours: a Psychometric Analysiscited by 30
8 more
- 2024Polaris: A Safety-focused LLM Constellation Architecture for Healthcarecited by 27
- 2024Leveraging Large Language Model as Simulated Patients for Clinical Educationcited by 20
- 2024Understanding the Therapeutic Relationship between Counselors and Clients in Online Text-based Counseling using LLMscited by 19
- 2024Virtual Agents for Alcohol Use Counseling: Exploring LLM-Powered Motivational Interviewingcited by 17
- 2023Developing Social Robots with Empathetic Non-Verbal Cues Using Large Language Modelscited by 12
- 2024The Dark Patterns of Personalized Persuasion in Large Language Models: Exposing Persuasive Linguistic Features for Big Five Personality Traits in LLMs Responsescited by 9
- 2024Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agentscited by 5
- 2024Automated Assessment and Adaptive Multimodal Formative Feedback Improves Psychomotor Skills Training Outcomes in Quadrotor Teleoperationcited by 3
Built on by
Citing papers per year: 2025: 10; 2026: 4.
14 papers.
Sort:
By area:
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 146
- 2025When Large Language Models are Reliable for Judging Empathic Communicationcited by 21
- 2025Adaptive-VP: A Framework for LLM-Based Virtual Patients that Adapts to Trainees' Dialogue to Facilitate Nurse Communication Trainingcited by 9
- 2025A Risk Ontology for Evaluating AI-Powered Psychotherapy Virtual Agentscited by 5
- 2026PatientHub: A Unified Framework for Patient Simulationcited by 4
- 2026Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teamingcited by 3
- 2025SocialLM: Social Signal Processing of Patient-Provider Communication using LLMs and Contextual Aggregationcited by 1
- 2025HealthDial: A No-Code LLM-Assisted Dialogue Authoring Tool for Healthcare Virtual Agentscited by 1
- 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Educationcited by 1
- 2025"Is This Really a Human Peer Supporter?": Misalignments Between Peer Supporters and Experts in LLM-Supported Interactionscited by 0
- 2025"I Said Things I Needed to Hear Myself": Peer Support as an Emotional, Organisational, and Sociotechnical Practice in Singaporecited by 0
- 2025A Case for Leveraging Generative AI to Expand and Enhance Training in the Provision of Mental Health Servicescited by 0
- 2026SocialCoach: Personalized Social Skill Learning with Agentic Tutoring and Practice2 Jun 2026
- 2026Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming23 Feb 2026
- 2026PatientHub: A Unified Framework for Patient Simulation12 Feb 2026
- 2026GenAI for Social Work Field Education: Client Simulation with Real-Time Feedback26 Jan 2026
- 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Education12 Nov 2025
- 2025A Case for Leveraging Generative AI to Expand and Enhance Training in the Provision of Mental Health Services8 Oct 2025
- 2025HealthDial: A No-Code LLM-Assisted Dialogue Authoring Tool for Healthcare Virtual Agents10 Sep 2025
- 2025When Large Language Models are Reliable for Judging Empathic Communication11 Jun 2025
- 2025"I Said Things I Needed to Hear Myself": Peer Support as an Emotional, Organisational, and Sociotechnical Practice in Singapore11 Jun 2025
- 2025"Is This Really a Human Peer Supporter?": Misalignments Between Peer Supporters and Experts in LLM-Supported Interactions11 Jun 2025
- 2025Adaptive-VP: A Framework for LLM-Based Virtual Patients that Adapts to Trainees' Dialogue to Facilitate Nurse Communication Training31 May 2025
- 2025A Risk Ontology for Evaluating AI-Powered Psychotherapy Virtual Agents21 May 2025
- 2025When Large Language Models are Reliable for Judging Empathic Communicationcited by 21
- 2025Adaptive-VP: A Framework for LLM-Based Virtual Patients that Adapts to Trainees' Dialogue to Facilitate Nurse Communication Trainingcited by 9
- 2026PatientHub: A Unified Framework for Patient Simulationcited by 4
- 2025SocialLM: Social Signal Processing of Patient-Provider Communication using LLMs and Contextual Aggregationcited by 1
- 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Educationcited by 1
- 2025"Is This Really a Human Peer Supporter?": Misalignments Between Peer Supporters and Experts in LLM-Supported Interactionscited by 0
- 2025"I Said Things I Needed to Hear Myself": Peer Support as an Emotional, Organisational, and Sociotechnical Practice in Singaporecited by 0
- 2025A Case for Leveraging Generative AI to Expand and Enhance Training in the Provision of Mental Health Servicescited by 0
- 2026GenAI for Social Work Field Education: Client Simulation with Real-Time Feedbackcited by 0
- 2026PatientHub: A Unified Framework for Patient Simulation12 Feb 2026
- 2026GenAI for Social Work Field Education: Client Simulation with Real-Time Feedback26 Jan 2026
- 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Education12 Nov 2025
- 2025A Case for Leveraging Generative AI to Expand and Enhance Training in the Provision of Mental Health Services8 Oct 2025
- 2025When Large Language Models are Reliable for Judging Empathic Communication11 Jun 2025
- 2025"I Said Things I Needed to Hear Myself": Peer Support as an Emotional, Organisational, and Sociotechnical Practice in Singapore11 Jun 2025
- 2025"Is This Really a Human Peer Supporter?": Misalignments Between Peer Supporters and Experts in LLM-Supported Interactions11 Jun 2025
- 2025Adaptive-VP: A Framework for LLM-Based Virtual Patients that Adapts to Trainees' Dialogue to Facilitate Nurse Communication Training31 May 2025
- 2025SocialLM: Social Signal Processing of Patient-Provider Communication using LLMs and Contextual Aggregation7 May 2025