mlsanityData to 14 Oct 2026

Hi-Reco: High-Fidelity Real-Time Conversational Digital Humans

arXiv 2511.12662 ↗First posted 16 Nov 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

High-fidelity digital humans are increasingly used in interactive applications, yet achieving both visual realism and real-time responsiveness remains a major challenge. We present a high-fidelity, real-time conversational digital human system that seamlessly combines a visually realistic 3D avatar, persona-driven expressive speech synthesis, and knowledge-grounded dialogue generation. To support natural and timely interaction, we introduce an asynchronous execution pipeline that coordinates multi-modal components with minimal latency. The system supports advanced features such as wake word detection, emotionally expressive prosody, and highly accurate, context-aware response generation. It leverages novel retrieval-augmented methods, including history augmentation to maintain conversational flow and intent-based routing for efficient knowledge access. Together, these components form an integrated system that enables responsive and believable digital humans, suitable for immersive applications in communication, education, and entertainment.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 35 references that are in the map. First posted on arXiv 16 Nov 2025.

Builds on

23 of 35 references.

References · 23

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  5. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  6. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  7. 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 379
  8. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
  9. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
  10. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
  11. 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizerscited by 235
  12. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 206
11 more
  1. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  2. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 184
  3. 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
  4. 2022PromptTTS: Controllable Text-to-Speech with Text Descriptionscited by 110
  5. 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
  6. 2023InstructTTS: Modelling Expressive TTS in Discrete Latent Space with Natural Language Style Promptcited by 92
  7. 2024Enhancing LLM Factual Accuracy with RAG to Counter Hallucinations: A Case Study on Domain-Specific Queries in Private Knowledge-Basescited by 77
  8. 2022Imitator: Personalized Speech-driven 3D Facial Animationcited by 74
  9. 2023DPE: Disentanglement of Pose and Expression for General Video Portrait Editingcited by 46
  10. 2024DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generationcited by 16
  11. 2024DEGAS: Detailed Expressions on Full-Body Gaussian Avatarscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversation
  2. 2026EmbodiedHead: Real-Time Listening and Speaking Avatar for Conversational Agents
  3. 2025Towards the "Digital Me": A vision of authentic Conversational Agents powered by personal Human Digital Twins
  4. 2026AVTR-1: Open Stack for Real-Time Interactive Avatars
  5. 2026Archon: A Unified Multimodal Model for Holistic Digital Human Generation
  6. 2025REALTALK: A 21-Day Real-World Dataset for Long-Term Conversation
  7. 2025Audio Driven Real-Time Facial Animation for Social Telepresence
  8. 2025ViBES: A Conversational Agent with Behaviorally-Intelligent 3D Virtual Body