Scaling Human and G2P Supervision for Robust Phonetic Transcription
Not on the map. Why?
Abstract (arXiv)
Expert phonetic annotation is costly, especially for non-standard dialects and atypical speech. A common alternative is using Grapheme-to-Phoneme (G2P) models to auto-generate phonetic labels from text transcripts at scale. We study how automatic phonetic transcription performance scales with human and G2P supervision in English. Using a curated 80-hour benchmark spanning native, non-native and post-stroke speech, we identify a supervision quality threshold: G2P supervision helps only when fewer than 20-30 hours of human annotation are available. Beyond this threshold, it provides no significant benefit and can reduce cross-dialect robustness. What is effective after this threshold is ASR pretraining which we use to achieve a 2.3x reduction in weighted phone feature error rate over prior systems, with strong gains on non-native and aphasic speech. These results suggest that quantity-driven G2P scaling may yield diminishing returns for robust generalization.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 49 references that are in the map. First posted on arXiv 14 Jun 2026.
Builds on
22 of 49 references.
References · 22
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 501
- 2020Universal Phone Recognition with a Multilingual Allophone Systemcited by 81
- 2021Simple and Effective Zero-shot Cross-lingual Phoneme Recognitioncited by 79
- 2021speechocean762: An Open-Source Non-native English Speech Corpus For Pronunciation Assessmentcited by 58
- 2022Transformer-Based Multi-Aspect Multi-Granularity Non-Native English Speaker Pronunciation Assessmentcited by 37
- 2020Transformer based Grapheme-to-Phoneme Conversioncited by 32
10 more
- 2024Whistle: Data-Efficient Multilingual and Crosslingual Speech Recognition via Weakly Phonetic Supervisioncited by 17
- 2023Universal Automatic Phonetic Transcription into the International Phonetic Alphabetcited by 16
- 2025POWSM: A Phonetic Open Whisper-Style Speech Foundation Modelcited by 14
- 2023Phoneme Hallucinator: One-shot Voice Conversion via Set Expansioncited by 9
- 2023MultiPA: A Multi-task Speech Pronunciation Assessment Model for Open Response Scenarioscited by 8
- 2024Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approachcited by 8
- 2026HuPER: A Human-Inspired Framework for Phonetic Perceptioncited by 3
- 2021Phoneme-based Distribution Regularization for Speech Enhancementcited by 2
- 2023Language-universal phonetic encoder for low-resource speech recognitioncited by 2
- 2025Linguistic and Audio Embedding-Based Machine Learning for Alzheimer's Dementia and Mild Cognitive Impairment Detection: Insights from the PROCESS Challengecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.