TRACE: Temporal Relationship-Aware Conversational Entrainment Detection in Dyadic Speech
Not on the map. Why?
Abstract (arXiv)
With the proliferation of speech AI agents, understanding emotional entrainment in conversational interaction has become increasingly important. Emotional entrainment is shaped by social relationships and conversational context, influencing affective coordination over time. We introduce DyadEE, a dataset for emotional entrainment detection in dyadic speech interactions, containing both emotionally entrained conversations and synthetic interactions where entrainment is disrupted through partner swapping and emotion resynthesis. We further propose TRACE, a window-level framework that models dyadic interaction as ordered sequences of acoustic embeddings derived from emotion fine-tuned Whisper representations, treating each sample as an interaction trace rather than pooled utterances. Experimental results on DyadEE show that incorporating conversational context and relationship information improves emotional entrainment detection, with TRACE achieving the best accuracy of 97.01%.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
13 of 27 references.
References · 13
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025OpenAI GPT-5 System Cardcited by 989
- 2022FreeVC: Towards High-Quality Text-Free One-Shot Voice Conversioncited by 80
- 2025LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesiscited by 76
- 2025Seamless Interaction: Dyadic Audiovisual Motion Modeling and Large-Scale Datasetcited by 40
- 2023MossFormer2: Combining Transformer and RNN-Free Recurrent Network for Enhanced Time-Domain Monaural Speech Separationcited by 39
- 2025Investigating Affective Use and Emotional Well-being on ChatGPTcited by 38
- 2021Dyadformer: A Multi-modal Transformer for Long-Range Modeling of Dyadic Interactionscited by 16
- 2024Fine-tuning Whisper on Low-Resource Languages for Real-World Applicationscited by 11
- 2025CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speechcited by 11
- 2024Modeling Empathetic Alignment in Conversationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.