# CLiVR: Conversational Learning System in Virtual Reality with AI-Powered Patients

arXiv: https://arxiv.org/abs/2510.19031 · HTML: https://mlsanity.com/paper/2510.19031/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 4 of its 20 references that are in the map.
- First posted on arXiv 21 Oct 2025.

## Builds on (most cited first, 4 of 4)

- [GoEmotions: A Dataset of Fine-Grained Emotions](https://mlsanity.com/paper/2005.00547/) (2020)
- [Takeaways from Applying LLM Capabilities to Multiple Conversational Avatars in a VR Pilot Study](https://mlsanity.com/paper/2501.00168/) (2024)
- [LLMs Enable Context-Aware Augmented Reality in Surgical Navigation](https://mlsanity.com/paper/2412.16597/) (2024)
- [TheraQuest: A Gamified, LLM-Powered Simulation for Massage Therapy Training](https://mlsanity.com/paper/2504.21735/) (2025)

## Built on by (most cited first, 1 of 1)

- [An Agentic AI Framework for Training General Practitioner Student Skills](https://mlsanity.com/paper/2512.18440/) (2025)

## Abstract (arXiv)

Simulations constitute a fundamental component of medical and nursing education and traditionally employ standardized patients (SP) and high-fidelity manikins to develop clinical reasoning and communication skills. However, these methods require substantial resources, limiting accessibility and scalability. In this study, we introduce CLiVR, a Conversational Learning system in Virtual Reality that integrates large language models (LLMs), speech processing, and 3D avatars to simulate realistic doctor-patient interactions. Developed in Unity and deployed on the Meta Quest 3 platform, CLiVR enables trainees to engage in natural dialogue with virtual patients. Each simulation is dynamically generated from a syndrome-symptom database and enhanced with sentiment analysis to provide feedback on communication tone. Through an expert user study involving medical school faculty (n=13), we assessed usability, realism, and perceived educational impact. Results demonstrated strong user acceptance, high confidence in educational potential, and valuable feedback for improvement. CLiVR offers a scalable, immersive supplement to SP-based training.