Which phoneme-to-viseme maps best improve visual-only computer lip-reading?
Not on the map. Why?
Abstract (arXiv)
A critical assumption of all current visual speech recognition systems is that there are visual speech units called visemes which can be mapped to units of acoustic speech, the phonemes. Despite there being a number of published maps it is infrequent to see the effectiveness of these tested, particularly on visual-only lip-reading (many works use audio-visual speech). Here we examine 120 mappings and consider if any are stable across talkers. We show a method for devising maps based on phoneme confusions from an automated lip-reading system, and we present new mappings that show improvements for individual talkers.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 2.
4 papers.
- 2025VALLR: Visual ASR Language Model for Lip Readingcited by 10
- 2023Enhancing Portuguese Sign Language Animation with Dynamic Timing and Mouthingcited by 0
- 2024Comparison of Conventional Hybrid and CTC/Attention Decoders for Continuous Visual Speech Recognitioncited by 0
- 2025Evaluation of End-to-End Continuous Spanish Lipreading in Different Data Conditionscited by 0
- 2025VALLR: Visual ASR Language Model for Lip Reading27 Mar 2025
- 2025Evaluation of End-to-End Continuous Spanish Lipreading in Different Data Conditions1 Feb 2025
- 2024Comparison of Conventional Hybrid and CTC/Attention Decoders for Continuous Visual Speech Recognition20 Feb 2024
- 2023Enhancing Portuguese Sign Language Animation with Dynamic Timing and Mouthing12 Jul 2023