# A virtual reality-based method for examining audiovisual prosody perception

arXiv: https://arxiv.org/abs/2209.05745 · HTML: https://mlsanity.com/paper/2209.05745/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 1 of its 27 references that are in the map.
- First posted on arXiv 13 Sep 2022.

## Builds on (most cited first, 1 of 1)

- [A High-Fidelity Open Embodied Avatar with Lip Syncing and Expression Capabilities](https://mlsanity.com/paper/1909.08766/) (2019)

## Abstract (arXiv)

Prosody plays a vital role in verbal communication. Acoustic cues of prosody have been examined extensively. However, prosodic characteristics are not only perceived auditorily, but also visually based on head and facial movements. The purpose of this report is to present a method for examining audiovisual prosody using virtual reality. We show that animations based on a virtual human provide motion cues similar to those obtained from video recordings of a real talker. The use of virtual reality opens up new avenues for examining multimodal effects of verbal communication. We discuss the method in the framework of examining prosody perception in cochlear implant listeners.