mlsanityData to 7 Oct 2026

AVIN-Chat: An Audio-Visual Interactive Chatbot System with Emotional State Tuning

arXiv 2409.00012 ↗First posted 15 Aug 2024cs.HC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This work presents an audio-visual interactive chatbot (AVIN-Chat) system that allows users to have face-to-face conversations with 3D avatars in real-time. Compared to the previous chatbot services, which provide text-only or speech-only communications, the proposed AVIN-Chat can offer audio-visual communications providing users with a superior experience quality. In addition, the proposed AVIN-Chat emotionally speaks and expresses according to the user's emotional state. Thus, it enables users to establish a strong bond with the chatbot system, increasing the user's immersion. Through user subjective tests, it is demonstrated that the proposed system provides users with a higher sense of immersion than previous chatbot systems. The demonstration video is available at https://www.youtube.com/watch?v=Z74uIV9k7_k.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 16 references that are in the map. First posted on arXiv 15 Aug 2024.

Builds on

9 of 16 references.

References · 9

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  4. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  5. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
  6. 2022Instant Volumetric Head Avatarscited by 157
  7. 2023EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animationcited by 141
  8. 2022PromptTTS: Controllable Text-to-Speech with Text Descriptionscited by 106
  9. 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Imagescited by 43

Built on by

Not cited yet.