VedicTHG: Symbolic Vedic Computation for Low-Resource Talking-Head Generation in Educational Avatars
Not on the map. Why?
Abstract (arXiv)
Talking-head avatars are increasingly adopted in educational technology to deliver content with social presence and improved engagement. However, many recent talking-head generation (THG) methods rely on GPU-centric neural rendering, large training sets, or high-capacity diffusion models, which limits deployment in offline or resource-constrained learning environments. A deterministic and CPU-oriented THG framework is described, termed Symbolic Vedic Computation, that converts speech to a time-aligned phoneme stream, maps phonemes to a compact viseme inventory, and produces smooth viseme trajectories through symbolic coarticulation inspired by Vedic sutra Urdhva Tiryakbhyam. A lightweight 2D renderer performs region-of-interest (ROI) warping and mouth compositing with stabilization to support real-time synthesis on commodity CPUs. Experiments report synchronization accuracy, temporal stability, and identity consistency under CPU-only execution, alongside benchmarking against representative CPU-feasible baselines. Results indicate that acceptable lip-sync quality can be achieved while substantially reducing computational load and latency, supporting practical educational avatars on low-end hardware. GitHub: https://vineetkumarrakesh.github.io/vedicthg
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 58 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
20 of 58 references.
References · 20
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2017VoxCeleb: a large-scale speaker identification datasetcited by 732
- 2020First Order Motion Model for Image Animationcited by 704
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
8 more
- 2020MakeItTalk: Speaker-Aware Talking-Head Animationcited by 312
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
- 2018Deep Video Portraitscited by 267
- 2019Neural Voice Puppetry: Audio-driven Facial Reenactmentcited by 250
- 2016Lip Reading Sentences in the Wildcited by 228
- 2018Deep Appearance Models for Face Renderingcited by 164
- 2023SyncTalk: The Devil is in the Synchronization for Talking Head Synthesiscited by 86
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Advancing Talking Head Generation: A Comprehensive Survey of Multi-Modal Methodologies, Datasets, Evaluation Metrics, and Loss Functions
- 2026EmbodiedHead: Real-Time Listening and Speaking Avatar for Conversational Agents
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applications
- 2024VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization
- 2026Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversation
- 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Models
- 2024DAWN: Dynamic Frame Avatar with Non-autoregressive Diffusion Framework for Talking Head Video Generation
- 2026VibeAvatar: Aligning Phonetic Kinematics and Human Aesthetics for High-Fidelity Talking Avatar Synthesis