A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Support
Not on the map. Why?
Abstract (arXiv)
Empathy is critical to successful mental health support. Empathy measurement has predominantly occurred in synchronous, face-to-face settings, and may not translate to asynchronous, text-based contexts. Because millions of people use text-based platforms for mental health support, understanding empathy in these contexts is crucial. In this work, we present a computational approach to understanding how empathy is expressed in online mental health platforms. We develop a novel unifying theoretically-grounded framework for characterizing the communication of empathy in text-based conversations. We collect and share a corpus of 10k (post, response) pairs annotated using this empathy framework with supporting evidence for annotations (rationales). We develop a multi-task RoBERTa-based bi-encoder model for identifying empathy in conversations and extracting rationales underlying its predictions. Experiments demonstrate that our approach can effectively identify empathic conversations. We further apply this model to analyze 235k mental health interactions and show that users do not self-learn empathy over time, revealing opportunities for empathy training and feedback.
Key facts. Cited by 182 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 16; 2023: 35; 2024: 46; 2025: 34; 2026: 35.
182 papers.
Sort:
By area:
- 2021Towards Emotional Support Dialog Systemscited by 294
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
- 2021PsyQA: A Chinese Dataset for Generating Long Counseling Text for Mental Health Supportcited by 92
- 2024Towards Conversational Diagnostic AIcited by 79
- 2023Cognitive Reframing of Negative Thoughts through Human-Language Model Interactioncited by 77
- 2021Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approachcited by 75
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2023Humanoid Agents: Platform for Simulating Human-like Generative Agentscited by 73
- 2022Human-AI Collaboration Enables More Empathic Conversations in Text-based Peer-to-Peer Mental Health Supportcited by 68
- 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMscited by 62
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmarkcited by 62
38 more
- 2023Building Emotional Support Chatbots in the Era of LLMscited by 62
- 2022Improving Multi-turn Emotional Support Dialogue Generation with Lookahead Strategy Planningcited by 59
- 2023Facilitating Self-Guided Mental Health Interventions Through Human-Language Model Interaction: A Case Study of Cognitive Restructuringcited by 53
- 2021Beyond Fair Pay: Ethical Implications of NLP Crowdsourcingcited by 52
- 2024ESCoT: Towards Interpretable Emotional Support Dialogue Systemscited by 46
- 2021Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion Causescited by 43
- 2021CoMAE: A Multi-factor Hierarchical Framework for Empathetic Response Generationcited by 42
- 2023Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvementscited by 42
- 2023Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Modelscited by 37
- 2024Large Language Models Produce Responses Perceived to be Empathiccited by 36
- 2024Large Language Models in Mental Health Care: a Scoping Reviewcited by 34
- 2023Empowering Psychotherapy with Large Language Models: Cognitive Distortion Detection through Diagnosis of Thought Promptingcited by 31
- 2024PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agentscited by 28
- 2023Chain of Empathy: Enhancing Empathetic Response of Large Language Models Based on Psychotherapy Modelscited by 24
- 2024SweetieChat: A Strategy-Enhanced Role-playing Framework for Diverse Scenarios Handling Emotional Support Agentcited by 24
- 2025RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agentscited by 24
- 2025From Personas to Talks: Revisiting the Impact of Personas on LLM-Synthesized Emotional Support Conversationscited by 23
- 2023Rationalization for Explainable NLP: A Surveycited by 22
- 2024STICKERCONV: Generating Multimodal Empathetic Responses from Scratchcited by 21
- 2024Can AI Relate: Testing Large Language Model Response for Mental Health Supportcited by 21
- 2025When Large Language Models are Reliable for Judging Empathic Communicationcited by 21
- 2021Conversations Gone Alright: Quantifying and Predicting Prosocial Outcomes in Online Conversationscited by 20
- 2022Empathic Conversations: A Multi-level Dataset of Contextualized Conversationscited by 20
- 2024The Colorful Future of LLMs: Evaluating and Improving LLMs as Emotional Supporters for Queer Youthcited by 20
- 2022Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible Knowledge Selectioncited by 19
- 2024Understanding the Therapeutic Relationship between Counselors and Clients in Online Text-based Counseling using LLMscited by 19
- 2024PATIENT-Psi: Using Large Language Models to Simulate Patients for Training Mental Health Professionalscited by 19
- 2024Are Large Language Models More Empathetic than Humans?cited by 18
- 2022Identifying Moments of Change from Longitudinal User Textcited by 17
- 2023Harnessing Large Language Models' Empathetic Response Generation Capabilities for Online Mental Health Counselling Supportcited by 17
- 2024Multi-Level Feedback Generation with Large Language Models for Empowering Novice Peer Counselorscited by 16
- 2024HEART-felt Narratives: Tracing Empathy and Narrative Style in Personal Stories with LLMscited by 16
- 2023Boosting Distress Support Dialogue Responses with Motivational Interviewing Strategycited by 15
- 2024ESC-Eval: Evaluating Emotion Support Conversations in Large Language Modelscited by 15
- 2022Empathetic Conversational Systems: A Review of Current Advances, Gaps, and Opportunitiescited by 14
- 2023Modeling Empathic Similarity in Personal Narrativescited by 14
- 2023Leveraging Large Language Models for Automated Dialogue Analysiscited by 14
- 2024ERD: A Framework for Improving LLM Reasoning for Cognitive Distortion Classificationcited by 14
50 most cited of 182 All 182 (JSON)
- 2026Evaluating Decision Models for Text Annotation in Computational Social Science21 Sep 2026
- 2026Aligning with Lived Experience: Heterogeneous Benefits of Fine Tuning in Mental Health Support Generation17 Sep 2026
- 2026MOCC-R1: Reinforcing Reasoning-Response Consistency for Multimodal Counselor Response Generation15 Sep 2026
- 2026Empathy Is Steerable but Multi-Axial: Mechanism Geometry and Persona Effects in LLMs14 Sep 2026
- 2026ER-EDF: A Psychology-Grounded Emotion Regulation Framework for Speech Empathetic Dialogue Generation in Large Audio-Language Models14 Sep 2026
- 2026CompanionSim: Synthetic Data for Evaluating Anthropomorphism in Human-AI Relationships31 Aug 2026
- 2026Affective Context Amplifies Sycophancy in LLM Responses21 Aug 2026
- 2026Detection != Reliable Control: Decodable Empathy Directions Yield at Most Partial Shifts in Automated Empathy Scores14 Jul 2026
- 2026What Models Express, Suppress, and Resist: Auditing Open-Weight LLMs with Persona Vectors14 Jul 2026
- 2026Self-Stigma Is Not a Monolith, but Generic Empathy Is: Persona-Conditioned LLM Support for People Who Use Drugs22 Jun 2026
- 2026I Understand How You Feel: Enhancing Deeper Emotional Support Through Multilingual Emotional Validation in Dialogue System10 Jun 2026
- 2026Appropriateness of Empathy in AI: A Signal-Cost Perspective29 May 2026
38 more
- 2026LLUMI: Improving LLM Writing Assistance for Mental Health Support with Online Community Feedback28 May 2026
- 2026StoryMI: Steerable Multi-Agent Therapeutic Dialogue Generation18 Apr 2026
- 2026Auditing Support Strategies in LLMs through Grounded Multi-Turn Social Simulation18 Apr 2026
- 2026Discourse Diversity in Multi-Turn Empathic Dialogue13 Apr 2026
- 2026LLMs Should Incorporate Explicit Mechanisms for Human Empathy12 Apr 2026
- 2026AI generates well-liked but templatic empathic responses9 Apr 2026
- 2026Not My Truce: Personality Differences in AI-Mediated Workplace Negotiation1 Apr 2026
- 2026CounselReflect: Opportunities and Challenges for Designing Tools to Support Self-Reflection on Mental Health and Well-Being Conversations with AI31 Mar 2026
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialogue6 Mar 2026
- 2026Assessing the Effectiveness of LLMs in Delivering Cognitive Behavioral Therapy4 Mar 2026
- 2026Multi-dimensional Assessment and Explainable Feedback for Counselor Responses to Client Resistance in Text-based Counseling with LLMs25 Feb 2026
- 2026Multi-Objective Alignment of Language Models for Personalized Psychotherapy17 Feb 2026
- 2026Empathy Is Not What Changed: Clinical Assessment of Psychological Safety Across GPT Model Generations15 Feb 2026
- 2026RE-LLM: Refining Empathetic Speech-LLM Responses by Integrating Emotion Nuance11 Feb 2026
- 2026Like a Therapist, But Not: Reddit Narratives of AI in Mental Health Contexts28 Jan 2026
- 2026Expert Evaluation and the Limits of Human Feedback in Mental Health AI Safety Testing26 Jan 2026
- 2026From Generation to Collaboration: Using LLMs to Edit for Empathy in Healthcare22 Jan 2026
- 2026Responsible Evaluation of AI for Mental Health20 Jan 2026
- 2026MASCOT: Multi-Agent Socio-Collaborative Companion Systems20 Jan 2026
- 2026PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Support19 Jan 2026
- 2026AEQ-Bench: Measuring Empathy of Omni-Modal Large Models15 Jan 2026
- 2026Empathy Applicability Modeling for General Health Queries14 Jan 2026
- 2026Do You Understand How I Feel?: Towards Verified Empathy in Therapy Chatbots13 Jan 2026
- 2025Empathy Level Prediction in Multi-Modal Scenario with Supervisory Documentation Assistance2 Dec 2025
- 2025Operationalizing Pluralistic Values in Large Language Model Alignment Reveals Trade-offs in Safety, Inclusivity, and Model Behavior18 Nov 2025
- 2025Detecting Early and Implicit Suicidal Ideation via Longitudinal and Information Environment Signals on Social Media16 Oct 2025
- 2025Toward Human-Centered Readability Evaluation12 Oct 2025
- 2025Are LLMs Empathetic to All? Investigating the Influence of Multi-Demographic Personas on a Model's Empathy11 Oct 2025
- 2025Does AI Coaching Prepare us for Workplace Negotiations?26 Sep 2025
- 2025SENSE-7: Taxonomy and Dataset for Measuring User Perceptions of Empathy in Sustained Human-AI Conversations19 Sep 2025
- 2025DiaCBT: A Long-Periodic Dialogue Corpus Guided by Cognitive Conceptualization Diagram for CBT-based Psychological Counseling3 Sep 2025
- 2025Assess and Prompt: A Generative RL Framework for Improving Engagement in Online Mental Health Communities22 Aug 2025
- 2025First, Do No Harm: AI Supervisor Scaffolds Novice Growth in Counselor Education12 Aug 2025
- 2025Reframe Your Life Story: Interactive Narrative Therapist and Innovative Moment Assessment with Large Language Models27 Jul 2025
- 2025RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agents3 Jul 2025
- 2025Spiritual-LLM : Gita Inspired Mental Health Therapy In the Era of LLMs23 Jun 2025
- 2025Do We Talk to Robots Like Therapists, and Do They Respond Accordingly? Language Alignment in AI Emotional Support19 Jun 2025
- 2025Large Language Model-Powered Conversational Agent Delivering Problem-Solving Therapy (PST) for Family Caregivers: Enhancing Empathy and Therapeutic Alliance Using In-Context Learning13 Jun 2025
50 newest of 182 All 182 (JSON)
- 2023Humanoid Agents: Platform for Simulating Human-like Generative Agentscited by 73
- 2024SweetieChat: A Strategy-Enhanced Role-playing Framework for Diverse Scenarios Handling Emotional Support Agentcited by 24
- 2025MAGI: Multi-Agent Guided Interview for Psychiatric Assessmentcited by 14
- 2026PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Supportcited by 7
- 2026MASCOT: Multi-Agent Socio-Collaborative Companion Systemscited by 7
- 2025MADP: Multi-Agent Deductive Planning for Enhanced Cognitive-Behavioral Mental Health Question Answercited by 3
- 2025Large Language Model-Powered Conversational Agent Delivering Problem-Solving Therapy (PST) for Family Caregivers: Enhancing Empathy and Therapeutic Alliance Using In-Context Learningcited by 1
- 2026StoryMI: Steerable Multi-Agent Therapeutic Dialogue Generationcited by 0
- 2026StoryMI: Steerable Multi-Agent Therapeutic Dialogue Generation18 Apr 2026
- 2026MASCOT: Multi-Agent Socio-Collaborative Companion Systems20 Jan 2026
- 2026PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Support19 Jan 2026
- 2025Large Language Model-Powered Conversational Agent Delivering Problem-Solving Therapy (PST) for Family Caregivers: Enhancing Empathy and Therapeutic Alliance Using In-Context Learning13 Jun 2025
- 2025MAGI: Multi-Agent Guided Interview for Psychiatric Assessment25 Apr 2025
- 2025MADP: Multi-Agent Deductive Planning for Enhanced Cognitive-Behavioral Mental Health Question Answer27 Jan 2025
- 2024SweetieChat: A Strategy-Enhanced Role-playing Framework for Diverse Scenarios Handling Emotional Support Agent11 Dec 2024
- 2023Humanoid Agents: Platform for Simulating Human-like Generative Agents9 Oct 2023
- 2025Operationalizing Pluralistic Values in Large Language Model Alignment Reveals Trade-offs in Safety, Inclusivity, and Model Behaviorcited by 8
- 2024Mitigating Unhelpfulness in Emotional Support Conversations with Multifaceted AI Feedbackcited by 4
- 2024EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimizationcited by 3
- 2026Expert Evaluation and the Limits of Human Feedback in Mental Health AI Safety Testingcited by 2
- 2026LLUMI: Improving LLM Writing Assistance for Mental Health Support with Online Community Feedbackcited by 2
- 2026Multi-Objective Alignment of Language Models for Personalized Psychotherapycited by 0
- 2026Aligning with Lived Experience: Heterogeneous Benefits of Fine Tuning in Mental Health Support Generationcited by 0
- 2026Aligning with Lived Experience: Heterogeneous Benefits of Fine Tuning in Mental Health Support Generation17 Sep 2026
- 2026LLUMI: Improving LLM Writing Assistance for Mental Health Support with Online Community Feedback28 May 2026
- 2026Multi-Objective Alignment of Language Models for Personalized Psychotherapy17 Feb 2026
- 2026Expert Evaluation and the Limits of Human Feedback in Mental Health AI Safety Testing26 Jan 2026
- 2025Operationalizing Pluralistic Values in Large Language Model Alignment Reveals Trade-offs in Safety, Inclusivity, and Model Behavior18 Nov 2025
- 2024EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimization27 Jun 2024
- 2024Mitigating Unhelpfulness in Emotional Support Conversations with Multifaceted AI Feedback11 Jan 2024
- 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMscited by 62
- 2023Empowering Psychotherapy with Large Language Models: Cognitive Distortion Detection through Diagnosis of Thought Promptingcited by 31
- 2025RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agentscited by 24
- 2024ERD: A Framework for Improving LLM Reasoning for Cognitive Distortion Classificationcited by 14
- 2025DeepPsy-Agent: A Stage-Aware and Deep-Thinking Emotional Support Agent Systemcited by 1
- 2025RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agents3 Jul 2025
- 2025DeepPsy-Agent: A Stage-Aware and Deep-Thinking Emotional Support Agent System20 Mar 2025
- 2024ERD: A Framework for Improving LLM Reasoning for Cognitive Distortion Classification21 Mar 2024
- 2023Empowering Psychotherapy with Large Language Models: Cognitive Distortion Detection through Diagnosis of Thought Prompting11 Oct 2023
- 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMs19 May 2023
- 2021Towards Emotional Support Dialog Systemscited by 294
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
- 2021PsyQA: A Chinese Dataset for Generating Long Counseling Text for Mental Health Supportcited by 92
- 2024Towards Conversational Diagnostic AIcited by 79
- 2023Cognitive Reframing of Negative Thoughts through Human-Language Model Interactioncited by 77
- 2021Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approachcited by 75
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2022Human-AI Collaboration Enables More Empathic Conversations in Text-based Peer-to-Peer Mental Health Supportcited by 68
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmarkcited by 62
- 2023Building Emotional Support Chatbots in the Era of LLMscited by 62
- 2022Improving Multi-turn Emotional Support Dialogue Generation with Lookahead Strategy Planningcited by 59
12 most cited of 161 All 161 (JSON)
- 2026Evaluating Decision Models for Text Annotation in Computational Social Science21 Sep 2026
- 2026MOCC-R1: Reinforcing Reasoning-Response Consistency for Multimodal Counselor Response Generation15 Sep 2026
- 2026Empathy Is Steerable but Multi-Axial: Mechanism Geometry and Persona Effects in LLMs14 Sep 2026
- 2026ER-EDF: A Psychology-Grounded Emotion Regulation Framework for Speech Empathetic Dialogue Generation in Large Audio-Language Models14 Sep 2026
- 2026CompanionSim: Synthetic Data for Evaluating Anthropomorphism in Human-AI Relationships31 Aug 2026
- 2026Affective Context Amplifies Sycophancy in LLM Responses21 Aug 2026
- 2026Detection != Reliable Control: Decodable Empathy Directions Yield at Most Partial Shifts in Automated Empathy Scores14 Jul 2026
- 2026What Models Express, Suppress, and Resist: Auditing Open-Weight LLMs with Persona Vectors14 Jul 2026
- 2026Self-Stigma Is Not a Monolith, but Generic Empathy Is: Persona-Conditioned LLM Support for People Who Use Drugs22 Jun 2026
- 2026I Understand How You Feel: Enhancing Deeper Emotional Support Through Multilingual Emotional Validation in Dialogue System10 Jun 2026
- 2026Appropriateness of Empathy in AI: A Signal-Cost Perspective29 May 2026
- 2026Auditing Support Strategies in LLMs through Grounded Multi-Turn Social Simulation18 Apr 2026
12 newest of 161 All 161 (JSON)