mlsanityData to 7 Oct 2026

RITA: A Real-time Interactive Talking Avatars Framework

arXiv 2406.13093 ↗First posted 18 Jun 2024cs.CV cs.AI cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

RITA presents a high-quality real-time interactive framework built upon generative models, designed with practical applications in mind. Our framework enables the transformation of user-uploaded photos into digital avatars that can engage in real-time dialogue interactions. By leveraging the latest advancements in generative modeling, we have developed a versatile platform that not only enhances the user experience through dynamic conversational avatars but also opens new avenues for applications in virtual reality, online education, and interactive gaming. This work showcases the potential of integrating computer vision and natural language processing technologies to create immersive and interactive digital personas, pushing the boundaries of how we interact with digital content.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 26 references that are in the map. First posted on arXiv 18 Jun 2024.

Builds on

23 of 26 references.

References · 23

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  3. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  4. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  5. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  6. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
  7. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
  8. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  9. 2020MakeItTalk: Speaker-Aware Talking-Head Animationcited by 310
  10. 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
  11. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 238
  12. 2018Talking Face Generation by Adversarially Disentangled Audio-Visual Representationcited by 212
11 more
  1. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 211
  2. 2021Audio-Driven Emotional Video Portraitscited by 180
  3. 2023Personality Traits in Large Language Modelscited by 166
  4. 2018Lip Movements Generation at a Glancecited by 154
  5. 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 148
  6. 2023LLM4Drive: A Survey of Large Language Models for Autonomous Drivingcited by 136
  7. 2023Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expertcited by 98
  8. 2021FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learningcited by 90
  9. 2023Efficient Emotional Adaptation for Audio-Driven Talking-Head Generationcited by 81
  10. 2023Towards Language Models That Can See: Computer Vision Through the LENS of Natural Languagecited by 53
  11. 2023VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Priorcited by 47

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026CETalk: Continuous Valence-Arousal Control for Audio-Driven 3D Talking Head Generationcited by 0