mlsanityData to 14 Oct 2026

VTutor: An Animated Pedagogical Agent SDK that Provide Real Time Multi-Model Feedback

arXiv 2505.06676 ↗First posted 10 May 2025cs.HCcited by 2

On the map: LLM agents and tool use → Educational agents and math problem solving

Abstract (arXiv)

Pedagogical Agents (PAs) show significant potential for boosting student engagement and learning outcomes by providing adaptive, on-demand support in educational contexts. However, existing PA solutions are often hampered by pre-scripted dialogue, unnatural animations, uncanny visual realism, and high development costs. To address these gaps, we introduce VTutor, an open-source SDK leveraging lightweight WebGL, Unity, and JavaScript frameworks. VTutor receives text outputs from a large language model (LLM), converts them into audio via text-to-speech, and then renders a real-time, lip-synced pedagogical agent (PA) for immediate, large-scale deployment on web-based learning platforms. By providing on-demand, personalized feedback, VTutor strengthens students' motivation and deepens their engagement with instructional material. Using an anime-like aesthetic, VTutor alleviates the uncanny valley effect, allowing learners to engage with expressive yet comfortably stylized characters. Our evaluation with 50 participants revealed that VTutor significantly outperforms the existing talking-head approaches (e.g., SadTalker) on perceived synchronization accuracy, naturalness, emotional expressiveness, and overall preference. As an open-source project, VTutor welcomes community-driven contributions - from novel character designs to specialized showcases of pedagogical agent applications - that fuel ongoing innovation in AI-enhanced education. By providing an accessible, customizable, and learner-centered PA solution, VTutor aims to elevate human-AI interaction experience in education fields, ultimately broadening the impact of AI in learning contexts. The demo link to VTutor is at https://vtutor-aied25.vercel.app.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 7 of its 25 references that are in the map. First posted on arXiv 10 May 2025.

Builds on

7 of 25 references.

References · 7

  1. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
  2. 2024Large Language Models for Education: A Survey and Outlookcited by 188
  3. 2024Enhancing LLM-Based Feedback: Insights from Intelligent Tutoring Systems and the Learning Sciencescited by 37
  4. 2023GPTutor: a ChatGPT-powered programming tool for code explanationcited by 23
  5. 2024GPTutor: Great Personalized Tutor with Large Language Models for Personalized Learning Content Generationcited by 9
  6. 2024A Systematic Review on Prompt Engineering in Large Language Models for K-12 STEM Educationcited by 8
  7. 2022The Effect of Multiple Replies for Natural Language Generation Chatbotscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025VTutor: An Open-Source SDK for Generative AI-Powered Animated Pedagogical Agents with Multi-Media Output
  2. 2025Animating Language Practice: Engagement with Stylized Conversational Agents in Japanese Learning
  3. 2025Instructional Agents: Reducing Teaching Faculty Workload through Multi-Agent Instructional Design
  4. 2026Dynamic Multimodal Expression Generation for LLM-Driven Pedagogical Agents: From User Experience Perspective
  5. 2025Simulating Students with Large Language Models: A Review of Architecture, Mechanisms, and Role Modelling in Education with Generative AI
  6. 2025Conversational Education at Scale: A Multi-LLM Agent Workflow for Procedural Learning and Pedagogic Quality Assessment
  7. 2026REFINE: Real-world Exploration of Interactive Feedback and Student Behaviour
  8. 2026Beyond End-to-End Video Models: An LLM-Based Multi-Agent System for Educational Video Generation