ViDA-MAN: Visual Dialog with Digital Humans
Not on the map. Why?
Abstract (arXiv)
We demonstrate ViDA-MAN, a digital-human agent for multi-modal interaction, which offers realtime audio-visual responses to instant speech inquiries. Compared to traditional text or voice-based system, ViDA-MAN offers human-like interactions (e.g, vivid voice, natural facial expression and body gestures). Given a speech request, the demonstration is able to response with high quality videos in sub-second latency. To deliver immersive user experience, ViDA-MAN seamlessly integrates multi-modal techniques including Acoustic Speech Recognition (ASR), multi-turn dialog, Text To Speech (TTS), talking heads video generation. Backed with large knowledge base, ViDA-MAN is able to chat with users on a number of topics including chit-chat, weather, device control, News recommendations, booking hotels, as well as answering questions via structured knowledge.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 8 of its 15 references that are in the map. First posted on arXiv 26 Oct 2021.
Builds on
8 of 15 references.
References · 8
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2018Video-to-Video Synthesiscited by 388
- 2019Neural Point-Based Graphicscited by 326
- 2018Everybody Dance Nowcited by 313
- 2016Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivationcited by 282
- 2018Deep Appearance Models for Face Renderingcited by 164
- 2015Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systemscited by 134
- 2018LPCNet: Improving Neural Speech Synthesis Through Linear Predictioncited by 109
Built on by
Citing papers per year: 2022: 1.
1 paper.