mlsanityData to 14 Oct 2026

Generalizable Engagement Estimation in Conversation via Domain Prompting and Parallel Attention

arXiv 2508.14448 ↗First posted 20 Aug 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Accurate engagement estimation is essential for adaptive human-computer interaction systems, yet robust deployment is hindered by poor generalizability across diverse domains and challenges in modeling complex interaction dynamics.To tackle these issues, we propose DAPA (Domain-Adaptive Parallel Attention), a novel framework for generalizable conversational engagement modeling. DAPA introduces a Domain Prompting mechanism by prepending learnable domain-specific vectors to the input, explicitly conditioning the model on the data's origin to facilitate domain-aware adaptation while preserving generalizable engagement representations. To capture interactional synchrony, the framework also incorporates a Parallel Cross-Attention module that explicitly aligns reactive (forward BiLSTM) and anticipatory (backward BiLSTM) states between participants.Extensive experiments demonstrate that DAPA establishes a new state-of-the-art performance on several cross-cultural and cross-linguistic benchmarks, notably achieving an absolute improvement of 0.45 in Concordance Correlation Coefficient (CCC) over a strong baseline on the NoXi-J test set. The superiority of our method was also confirmed by winning the first place in the Multi-Domain Engagement Estimation Challenge at MultiMediate'25.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 51 references that are in the map. First posted on arXiv 20 Aug 2025.

Builds on

12 of 51 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  5. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  6. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 347
  7. 2018Detecting Low Rapport During Natural Interactions in Small Groups from Non-Verbal Behaviourcited by 24
  8. 2022MultiMediate '22: Backchannel Detection and Agreement Estimation in Group Interactionscited by 10
  9. 2024MultiMediate'24: Multi-Domain Engagement Estimationcited by 6
  10. 2024Multilingual Dyadic Interaction Corpus NoXi+J: Toward Understanding Asian-European Non-verbal Cultural Characteristics and their Influences on Engagementcited by 5
  11. 2024DAT: Dialogue-Aware Transformer with Modality-Group Fusion for Human Engagement Estimationcited by 4
  12. 2025AsyReC: A Multimodal Graph-based Framework for Spatio-Temporal Asymmetric Dyadic Relationship Classificationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.