Speaker and Time-aware Joint Contextual Learning for Dialogue-act Classification in Counselling Conversations
Not on the map. Why?
Abstract (arXiv)
The onset of the COVID-19 pandemic has brought the mental health of people under risk. Social counselling has gained remarkable significance in this environment. Unlike general goal-oriented dialogues, a conversation between a patient and a therapist is considerably implicit, though the objective of the conversation is quite apparent. In such a case, understanding the intent of the patient is imperative in providing effective counselling in therapy sessions, and the same applies to a dialogue system as well. In this work, we take forward a small but an important step in the development of an automated dialogue system for mental-health counselling. We develop a novel dataset, named HOPE, to provide a platform for the dialogue-act classification in counselling conversations. We identify the requirement of such conversation and propose twelve domain-specific dialogue-act (DAC) labels. We collect 12.9K utterances from publicly-available counselling session videos on YouTube, extract their transcripts, clean, and annotate them with DAC labels. Further, we propose SPARTA, a transformer-based architecture with a novel speaker- and time-aware contextual learning for the dialogue-act classification. Our evaluation shows convincing performance over several baselines, achieving state-of-the-art on HOPE. We also supplement our experiments with extensive empirical and qualitative analyses of SPARTA.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 20 of its 48 references that are in the map. First posted on arXiv 12 Nov 2021.
Builds on
20 of 48 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
- 2016Recurrent Neural Network for Text Classification with Multi-Task Learningcited by 144
- 2021Multi-modal Sarcasm Detection and Humor Classification in Code-mixed Conversationscited by 33
- 2016Sequential Short-Text Classification with Recurrent and Convolutional Neural Networkscited by 28
- 2020DCR-Net: A Deep Co-Interactive Relation Network for Joint Dialog Act Recognition and Sentiment Classificationcited by 28
- 2019Dialogue Act Classification with Context-Aware Self-Attentioncited by 26
- 2020Guiding attention in Sequence-to-sequence models for Dialogue Act predictioncited by 26
- 2021Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interactioncited by 21
8 more
- 2017Dialogue Act Recognition via CRF-Attentive Structured Networkcited by 18
- 2018Multi-task dialog act and sentiment recognition on Mastodoncited by 15
- 2021Discovering Emotion and Reasoning its Flip in Multi-Party Conversations using Masked Memory Network and Transformercited by 14
- 2017ProjectionNet: Learning Efficient On-Device Deep Networks Using Neural Projectionscited by 11
- 2020Speaker-change Aware CRF for Dialogue Act Classificationcited by 6
- 2020Contextual Dialogue Act Classification for Open-Domain Conversational Agentscited by 6
- 2019Modeling Long-Range Context for Concurrent Dialogue Acts Recognitioncited by 5
- 2019Context-aware Neural-based Dialog Act Classification on Automatically Generated Transcriptionscited by 3
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 7; 2025: 7; 2026: 11.
31 papers.
Sort:
By area:
- 2024A Computational Framework for Behavioral Assessment of LLM Therapistscited by 62
- 2024Towards Human-centered Proactive Conversational Agentscited by 49
- 2023Knowledge-enhanced Mixed-initiative Dialogue System for Emotional Support Conversationscited by 41
- 2025MentalChat16K: A Benchmark Dataset for Conversational Mental Health Assistancecited by 39
- 2022Counseling Summarization using Mental Health Knowledge Guided Utterance Filteringcited by 18
- 2024Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representationscited by 18
- 2025Towards Online Multi-Modal Social Interaction Understandingcited by 12
- 2023Response-act Guided Reinforced Dialogue Generation for Mental Health Counselingcited by 9
- 2022A Computational Approach to Understand Mental Health from Reddit: Knowledge-aware Multitask Learning Frameworkcited by 8
- 2025Figurative-cum-Commonsense Knowledge Infusion for Multimodal Mental Health Meme Classificationcited by 6
- 2025Trust Modeling in Counseling Conversations: A Benchmark Studycited by 5
- 2024We Care: Multimodal Depression Detection and Knowledge Infused Mental Health Therapeutic Response Generationcited by 4
19 more
- 2026Omni-MMSI: Toward Identity-attributed Social Interaction Understandingcited by 4
- 2024Enhancing Psychotherapy Counseling: A Data Augmentation Pipeline Leveraging Large Language Models for Counseling Conversationscited by 3
- 2025Eeyore: Realistic Depression Simulation via Supervised and Preference Optimizationcited by 3
- 2022Dynamically Retrieving Knowledge via Query Generation for Informative Dialogue Generationcited by 2
- 2025LeCoDe: A Benchmark Dataset for Interactive Legal Consultation Dialogue Evaluationcited by 2
- 2026PSI-Bench: Interpretable and Clinically Meaningful Evaluation of Depression Patient Simulatorscited by 2
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systemscited by 1
- 2024EMMI -- Empathic Multimodal Motivational Interviews Dataset: Analyses and Annotationscited by 1
- 2025OnCoCo 1.0: A Public Dataset for Fine-Grained Message Classification in Online Counseling Conversationscited by 1
- 2026Measuring What Matters!! Assessing Therapeutic Principles in Mental-Health Conversationcited by 1
- 2026Transition-Matrix Regularization for Next Dialogue Act Prediction in Counselling Conversationscited by 1
- 2024Yes, this is what I was looking for! Towards Multi-modal Medical Consultation Concern Summary Generationcited by 0
- 2026SAGE: A Strategy-Aware Graph-Enhanced Generation Framework For Online Counselingcited by 0
- 2026EmoTrack: Clinical-Semantic Modeling for Text-Based Depression Severity Estimationcited by 0
- 2026Towards Understanding and Measuring COGNITIVE ATROPHY in LLM Behaviourcited by 0
- 2026GEMCo: A Validated, Ethically Releasable Proxy for Inaccessible Counselling Datacited by 0
- 2026MyMentorLLM: A psychotherapy GenAI environment with multimodal voice/text patients, trainees and experts for deliberate practicecited by 0
- 2026LongCounsel-8: A Benchmark Suite for Longitudinal Depression Tracking from Multi-Session Counseling Dialoguescited by 0
- 2026Understanding Clinical Cognitive Dialogues Using Large Language Modelscited by 0
- 2026Understanding Clinical Cognitive Dialogues Using Large Language Models28 Sep 2026
- 2026LongCounsel-8: A Benchmark Suite for Longitudinal Depression Tracking from Multi-Session Counseling Dialogues3 Sep 2026
- 2026MyMentorLLM: A psychotherapy GenAI environment with multimodal voice/text patients, trainees and experts for deliberate practice28 Jul 2026
- 2026GEMCo: A Validated, Ethically Releasable Proxy for Inaccessible Counselling Data26 Jul 2026
- 2026Towards Understanding and Measuring COGNITIVE ATROPHY in LLM Behaviour16 Jun 2026
- 2026EmoTrack: Clinical-Semantic Modeling for Text-Based Depression Severity Estimation21 May 2026
- 2026SAGE: A Strategy-Aware Graph-Enhanced Generation Framework For Online Counseling29 Apr 2026
- 2026PSI-Bench: Interpretable and Clinically Meaningful Evaluation of Depression Patient Simulators28 Apr 2026
- 2026Transition-Matrix Regularization for Next Dialogue Act Prediction in Counselling Conversations20 Apr 2026
- 2026Measuring What Matters!! Assessing Therapeutic Principles in Mental-Health Conversation7 Apr 2026
- 2026Omni-MMSI: Toward Identity-attributed Social Interaction Understanding31 Mar 2026
- 2025OnCoCo 1.0: A Public Dataset for Fine-Grained Message Classification in Online Counseling Conversations10 Dec 2025
19 more
- 2025LeCoDe: A Benchmark Dataset for Interactive Legal Consultation Dialogue Evaluation26 May 2025
- 2025Towards Online Multi-Modal Social Interaction Understanding25 Mar 2025
- 2025MentalChat16K: A Benchmark Dataset for Conversational Mental Health Assistance13 Mar 2025
- 2025Eeyore: Realistic Depression Simulation via Supervised and Preference Optimization21 Feb 2025
- 2025Figurative-cum-Commonsense Knowledge Infusion for Multimodal Mental Health Meme Classification25 Jan 2025
- 2025Trust Modeling in Counseling Conversations: A Benchmark Study6 Jan 2025
- 2024EMMI -- Empathic Multimodal Motivational Interviews Dataset: Analyses and Annotations24 Jun 2024
- 2024We Care: Multimodal Depression Detection and Knowledge Infused Mental Health Therapeutic Response Generation15 Jun 2024
- 2024Enhancing Psychotherapy Counseling: A Data Augmentation Pipeline Leveraging Large Language Models for Counseling Conversations13 Jun 2024
- 2024Towards Human-centered Proactive Conversational Agents19 Apr 2024
- 2024Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations4 Mar 2024
- 2024Yes, this is what I was looking for! Towards Multi-modal Medical Consultation Concern Summary Generation10 Jan 2024
- 2024A Computational Framework for Behavioral Assessment of LLM Therapists1 Jan 2024
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems14 Jul 2023
- 2023Knowledge-enhanced Mixed-initiative Dialogue System for Emotional Support Conversations17 May 2023
- 2023Response-act Guided Reinforced Dialogue Generation for Mental Health Counseling30 Jan 2023
- 2022Dynamically Retrieving Knowledge via Query Generation for Informative Dialogue Generation30 Jul 2022
- 2022Counseling Summarization using Mental Health Knowledge Guided Utterance Filtering8 Jun 2022
- 2022A Computational Approach to Understand Mental Health from Reddit: Knowledge-aware Multitask Learning Framework22 Mar 2022
- 2024A Computational Framework for Behavioral Assessment of LLM Therapistscited by 62
- 2024Towards Human-centered Proactive Conversational Agentscited by 49
- 2023Knowledge-enhanced Mixed-initiative Dialogue System for Emotional Support Conversationscited by 41
- 2025MentalChat16K: A Benchmark Dataset for Conversational Mental Health Assistancecited by 39
- 2022Counseling Summarization using Mental Health Knowledge Guided Utterance Filteringcited by 18
- 2024Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representationscited by 18
- 2025Towards Online Multi-Modal Social Interaction Understandingcited by 12
- 2023Response-act Guided Reinforced Dialogue Generation for Mental Health Counselingcited by 9
- 2022A Computational Approach to Understand Mental Health from Reddit: Knowledge-aware Multitask Learning Frameworkcited by 8
- 2025Figurative-cum-Commonsense Knowledge Infusion for Multimodal Mental Health Meme Classificationcited by 6
- 2025Trust Modeling in Counseling Conversations: A Benchmark Studycited by 5
- 2024We Care: Multimodal Depression Detection and Knowledge Infused Mental Health Therapeutic Response Generationcited by 4
12 most cited of 29 All 29 (JSON)
- 2026Understanding Clinical Cognitive Dialogues Using Large Language Models28 Sep 2026
- 2026LongCounsel-8: A Benchmark Suite for Longitudinal Depression Tracking from Multi-Session Counseling Dialogues3 Sep 2026
- 2026MyMentorLLM: A psychotherapy GenAI environment with multimodal voice/text patients, trainees and experts for deliberate practice28 Jul 2026
- 2026GEMCo: A Validated, Ethically Releasable Proxy for Inaccessible Counselling Data26 Jul 2026
- 2026Towards Understanding and Measuring COGNITIVE ATROPHY in LLM Behaviour16 Jun 2026
- 2026EmoTrack: Clinical-Semantic Modeling for Text-Based Depression Severity Estimation21 May 2026
- 2026SAGE: A Strategy-Aware Graph-Enhanced Generation Framework For Online Counseling29 Apr 2026
- 2026PSI-Bench: Interpretable and Clinically Meaningful Evaluation of Depression Patient Simulators28 Apr 2026
- 2026Transition-Matrix Regularization for Next Dialogue Act Prediction in Counselling Conversations20 Apr 2026
- 2026Measuring What Matters!! Assessing Therapeutic Principles in Mental-Health Conversation7 Apr 2026
- 2026Omni-MMSI: Toward Identity-attributed Social Interaction Understanding31 Mar 2026
- 2025OnCoCo 1.0: A Public Dataset for Fine-Grained Message Classification in Online Counseling Conversations10 Dec 2025
12 newest of 29 All 29 (JSON)