CALM-IT: Generating Realistic Long-Form Motivational Interviewing Dialogues with Dual-Actor Conversational Dynamics Tracking
Not on the map. Why?
Abstract (arXiv)
Therapeutic dialogue is not a sequence of isolated responses: client goals, motivation, resistance, and therapeutic alliance evolve over time. Yet current LLM-based mental health dialogue systems often lack explicit mechanisms for tracking these dynamics across extended interactions, which can lead to poorly timed interventions or premature goal resolution. We introduce CALM-IT, a framework for generating and evaluating long-form Motivational Interviewing dialogues through explicit modeling of evolving client and counselor states, guiding both counseling strategy selection and utterance generation. We evaluate CALM-IT on a large-scale corpus of 8,232 synthetic dialogues spanning multiple dialogue lengths and frameworks. Compared with all baselines, CALM-IT achieves the best performance on most MITI 4.2 global ratings, including Empathy, Partnership, and Softening Sustain Talk, as well as on other key performance metrics while exhibiting minimal performance degradation as dialogue length increases. Notably, although CALM-IT initiates fewer change-directed prompts, it produces the highest client acceptance rate (64.3%) on average across different length conditions. We release a reproducible generation framework, a MITI-grounded process-level evaluation protocol, and a large-scale synthetic corpus for studying therapeutic LLMs under realistic long-form interaction conditions.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 17 of its 52 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
17 of 52 references.
References · 17
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
- 2024Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principlescited by 72
- 2020ConvoKit: A Toolkit for the Analysis of Conversationscited by 71
- 2024Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theorycited by 60
- 2019Evaluating Coherence in Dialogue Systems using Entailmentcited by 53
- 2021Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterancescited by 40
- 2025MentalChat16K: A Benchmark Dataset for Conversational Mental Health Assistancecited by 38
- 2024GPTCoach: Towards LLM-Based Physical Activity Coachingcited by 29
- 2025Consistent Client Simulation for Motivational Interviewing-based Counselingcited by 14
- 2025CAMI: A Counselor Agent Supporting Motivational Interviewing through State Inference and Topic Explorationcited by 11
- 2023Deep Learning Mental Health Dialogue Systemcited by 9
5 more
- 2025Reasoning Is Not All You Need: Examining LLMs for Multi-Turn Mental Health Conversationscited by 6
- 2024Taking a turn for the better: Conversation redirection throughout the course of mental-health therapycited by 5
- 2025A Fully Generative Motivational Interviewing Counsellor Chatbot for Moving Smokers Towards the Decision to Quitcited by 5
- 2025Hanging in the Balance: Pivotal Moments in Crisis Counseling Conversationscited by 4
- 2022GDPR Compliant Collection of Therapist-Patient-Dialoguescited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026LLUMI: Improving LLM Writing Assistance for Mental Health Support with Online Community Feedbackcited by 2
- 2026ODRA: Synthesizing Cognitive Behavioral Therapy Sessions with Structured Chain-Of-Thought and Dynamic Patient Resistancecited by 0
- 2026PeerPen: AI-Assisted Writing for Online Mental Health Peer Supportcited by 0
- 2026PeerPen: AI-Assisted Writing for Online Mental Health Peer Support14 Sep 2026
- 2026ODRA: Synthesizing Cognitive Behavioral Therapy Sessions with Structured Chain-Of-Thought and Dynamic Patient Resistance5 Aug 2026
- 2026LLUMI: Improving LLM Writing Assistance for Mental Health Support with Online Community Feedback28 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026StoryMI: Steerable Multi-Agent Therapeutic Dialogue Generation
- 2024Rethinking the Alignment of Psychotherapy Dialogue Generation with Motivational Interviewing Strategies
- 2024Interactive Agents: Simulating Counselor-Client Psychological Counseling via Role-Playing LLM-to-LLM Interactions
- 2024Unlocking LLMs: Addressing Scarce Data and Bias Challenges in Mental Health
- 2026Psy-Chronicle:A Structured Pipeline for Synthesizing Long-Horizon Campus Psychological Counseling Dialogues
- 2026Mind Companion: An Embodied Conversational Agent for Process-Based Psychotherapy
- 2026CARE: Counselor-Aligned Response Engine for Online Mental-Health Support
- 2024An LLM-based Simulation Framework for Embodied Conversational Agents in Psychological Counseling