Digital Avatars: Framework Development and Their Evaluation
Not on the map. Why?
Abstract (arXiv)
We present a novel prompting strategy for artificial intelligence driven digital avatars. To better quantify how our prompting strategy affects anthropomorphic features like humor, authenticity, and favorability we present Crowd Vote - an adaptation of Crowd Score that allows for judges to elect a large language model (LLM) candidate over competitors answering the same or similar prompts. To visualize the responses of our LLM, and the effectiveness of our prompting strategy we propose an end-to-end framework for creating high-fidelity artificial intelligence (AI) driven digital avatars. This pipeline effectively captures an individual's essence for interaction and our streaming algorithm delivers a high-quality digital avatar with real-time audio-video streaming from server to mobile device. Both our visualization tool, and our Crowd Vote metrics demonstrate our AI driven digital avatars have state-of-the-art humor, authenticity, and favorability outperforming all competitors and baselines. In the case of our Donald Trump and Joe Biden avatars, their authenticity and favorability are rated higher than even their real-world equivalents.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 9 references that are in the map. First posted on arXiv 7 Aug 2024.
Builds on
7 of 9 references.
References · 7
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
- 2015Deep Speech 2: End-to-End Speech Recognition in English and Mandarincited by 451
- 2022VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wildcited by 106
- 2022Crowd Score: A Method for the Evaluation of Jokes using Large Language Model AI Voters as Judgescited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026A Platform for Interactive AI Character Experiencescited by 2
- 2026A Platform for Interactive AI Character Experiences3 Jan 2026