mlsanityData to 14 Oct 2026

TRACE: Temporal Relationship-Aware Conversational Entrainment Detection in Dyadic Speech

arXiv 2606.30543 ↗First posted 29 Jun 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

With the proliferation of speech AI agents, understanding emotional entrainment in conversational interaction has become increasingly important. Emotional entrainment is shaped by social relationships and conversational context, influencing affective coordination over time. We introduce DyadEE, a dataset for emotional entrainment detection in dyadic speech interactions, containing both emotionally entrained conversations and synthetic interactions where entrainment is disrupted through partner swapping and emotion resynthesis. We further propose TRACE, a window-level framework that models dyadic interaction as ordered sequences of acoustic embeddings derived from emotion fine-tuned Whisper representations, treating each sample as an interaction trace rather than pooled utterances. Experimental results on DyadEE show that incorporating conversational context and relationship information improves emotional entrainment detection, with TRACE achieving the best accuracy of 97.01%.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

13 of 27 references.

References · 13

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2025OpenAI GPT-5 System Cardcited by 989
  4. 2022FreeVC: Towards High-Quality Text-Free One-Shot Voice Conversioncited by 80
  5. 2025LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesiscited by 76
  6. 2025Seamless Interaction: Dyadic Audiovisual Motion Modeling and Large-Scale Datasetcited by 40
  7. 2023MossFormer2: Combining Transformer and RNN-Free Recurrent Network for Enhanced Time-Domain Monaural Speech Separationcited by 39
  8. 2025Investigating Affective Use and Emotional Well-being on ChatGPTcited by 38
  9. 2021Dyadformer: A Multi-modal Transformer for Long-Range Modeling of Dyadic Interactionscited by 16
  10. 2024Fine-tuning Whisper on Low-Resource Languages for Real-World Applicationscited by 11
  11. 2025CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speechcited by 11
  12. 2024Modeling Empathetic Alignment in Conversationcited by 2
1 more
  1. 2025Spatiotemporal Emotional Synchrony in Dyadic Interactions: The Role of Speech Conditions in Facial and Vocal Affective Alignmentcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.