Universal Automatic Phonetic Transcription into the International Phonetic Alphabet
Not on the map. Why?
Abstract (arXiv)
This paper presents a state-of-the-art model for transcribing speech in any language into the International Phonetic Alphabet (IPA). Transcription of spoken languages into IPA is an essential yet time-consuming process in language documentation, and even partially automating this process has the potential to drastically speed up the documentation of endangered languages. Like the previous best speech-to-IPA model (Wav2Vec2Phoneme), our model is based on wav2vec 2.0 and is fine-tuned to predict IPA from audio input. We use training data from seven languages from CommonVoice 11.0, transcribed into IPA semi-automatically. Although this training dataset is much smaller than Wav2Vec2Phoneme's, its higher quality lets our model achieve comparable or better results. Furthermore, we show that the quality of our universal speech-to-IPA models is close to that of human annotators.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 7 of its 20 references that are in the map. First posted on arXiv 7 Aug 2023.
Builds on
7 of 20 references.
References · 7
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 501
- 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 231
- 2020Universal Phone Recognition with a Multilingual Allophone Systemcited by 81
- 2021Simple and Effective Zero-shot Cross-lingual Phoneme Recognitioncited by 79
- 2018Sequence-based Multi-lingual Low Resource Speech Recognitioncited by 20
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 10.
16 papers.
Sort:
- 2025ZIPA: A family of efficient models for multilingual phone recognitioncited by 19
- 2025POWSM: A Phonetic Open Whisper-Style Speech Foundation Modelcited by 14
- 2026[b] = [d] - [t] + [p]: Self-supervised Speech Models Discover Phonological Vector Arithmeticcited by 12
- 2025Improving Cross-Lingual Phonetic Representation of Low-Resource Languages Through Language Similarity Analysiscited by 5
- 2026An Empirical Recipe for Universal Phone Recognitioncited by 5
- 2024Transcribing Bengali Text with Regional Dialects to IPA using District Guided Tokenscited by 2
- 2026Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered Languagescited by 2
- 2024Efficiently Identifying Low-Quality Language Subsets in Multilingual Datasets: A Case Study on a Large-Scale Multilingual Audio Datasetcited by 1
- 2025Building Tailored Speech Recognizers for Japanese Speaking Assessmentcited by 1
- 2026Scaling Human and G2P Supervision for Robust Phonetic Transcriptioncited by 1
- 2026BranchShine: Compact Raw-Audio-to-IPA Transcription with a RoPE E-Branchformer Encodercited by 1
- 2026Selective Augmentation: Improving Universal Automatic Phonetic Transcription via G2P Bootstrappingcited by 0
4 more
- 2026ArtNet: A JEPA-Like Articulatory Predictive Framework for Robust Zero-Shot Phoneme Recognitioncited by 0
- 2026BranchShine-CR: Compact Multilingual IPA Transcription with Self-Conditioned CTC and Consistency Regularizationcited by 0
- 2026Deep Learning Techniques for Phoneme Recognition in Italian Children' s Speechcited by 0
- 2026SHAMS: An Audio-Grounded Pronunciation Benchmark for Levantine Arabiccited by 0
- 2026SHAMS: An Audio-Grounded Pronunciation Benchmark for Levantine Arabic1 Oct 2026
- 2026Deep Learning Techniques for Phoneme Recognition in Italian Children' s Speech27 Sep 2026
- 2026BranchShine-CR: Compact Multilingual IPA Transcription with Self-Conditioned CTC and Consistency Regularization24 Sep 2026
- 2026BranchShine: Compact Raw-Audio-to-IPA Transcription with a RoPE E-Branchformer Encoder22 Jun 2026
- 2026ArtNet: A JEPA-Like Articulatory Predictive Framework for Robust Zero-Shot Phoneme Recognition15 Jun 2026
- 2026Scaling Human and G2P Supervision for Robust Phonetic Transcription14 Jun 2026
- 2026Selective Augmentation: Improving Universal Automatic Phonetic Transcription via G2P Bootstrapping29 Apr 2026
- 2026Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered Languages20 Apr 2026
- 2026An Empirical Recipe for Universal Phone Recognition30 Mar 2026
- 2026[b] = [d] - [t] + [p]: Self-supervised Speech Models Discover Phonological Vector Arithmetic21 Feb 2026
- 2025POWSM: A Phonetic Open Whisper-Style Speech Foundation Model28 Oct 2025
- 2025Building Tailored Speech Recognizers for Japanese Speaking Assessment25 Sep 2025
4 more
- 2025ZIPA: A family of efficient models for multilingual phone recognition29 May 2025
- 2025Improving Cross-Lingual Phonetic Representation of Low-Resource Languages Through Language Similarity Analysis12 Jan 2025
- 2024Efficiently Identifying Low-Quality Language Subsets in Multilingual Datasets: A Case Study on a Large-Scale Multilingual Audio Dataset5 Oct 2024
- 2024Transcribing Bengali Text with Regional Dialects to IPA using District Guided Tokens26 Mar 2024
- 2025ZIPA: A family of efficient models for multilingual phone recognitioncited by 19
- 2025POWSM: A Phonetic Open Whisper-Style Speech Foundation Modelcited by 14
- 2026[b] = [d] - [t] + [p]: Self-supervised Speech Models Discover Phonological Vector Arithmeticcited by 12
- 2025Improving Cross-Lingual Phonetic Representation of Low-Resource Languages Through Language Similarity Analysiscited by 5
- 2026An Empirical Recipe for Universal Phone Recognitioncited by 5
- 2024Transcribing Bengali Text with Regional Dialects to IPA using District Guided Tokenscited by 2
- 2026Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered Languagescited by 2
- 2024Efficiently Identifying Low-Quality Language Subsets in Multilingual Datasets: A Case Study on a Large-Scale Multilingual Audio Datasetcited by 1
- 2025Building Tailored Speech Recognizers for Japanese Speaking Assessmentcited by 1
- 2026Scaling Human and G2P Supervision for Robust Phonetic Transcriptioncited by 1
- 2026BranchShine: Compact Raw-Audio-to-IPA Transcription with a RoPE E-Branchformer Encodercited by 1
- 2026Selective Augmentation: Improving Universal Automatic Phonetic Transcription via G2P Bootstrappingcited by 0
12 most cited of 16 All 16 (JSON)
- 2026SHAMS: An Audio-Grounded Pronunciation Benchmark for Levantine Arabic1 Oct 2026
- 2026Deep Learning Techniques for Phoneme Recognition in Italian Children' s Speech27 Sep 2026
- 2026BranchShine-CR: Compact Multilingual IPA Transcription with Self-Conditioned CTC and Consistency Regularization24 Sep 2026
- 2026BranchShine: Compact Raw-Audio-to-IPA Transcription with a RoPE E-Branchformer Encoder22 Jun 2026
- 2026ArtNet: A JEPA-Like Articulatory Predictive Framework for Robust Zero-Shot Phoneme Recognition15 Jun 2026
- 2026Scaling Human and G2P Supervision for Robust Phonetic Transcription14 Jun 2026
- 2026Selective Augmentation: Improving Universal Automatic Phonetic Transcription via G2P Bootstrapping29 Apr 2026
- 2026Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered Languages20 Apr 2026
- 2026An Empirical Recipe for Universal Phone Recognition30 Mar 2026
- 2026[b] = [d] - [t] + [p]: Self-supervised Speech Models Discover Phonological Vector Arithmetic21 Feb 2026
- 2025POWSM: A Phonetic Open Whisper-Style Speech Foundation Model28 Oct 2025
- 2025Building Tailored Speech Recognizers for Japanese Speaking Assessment25 Sep 2025
12 newest of 16 All 16 (JSON)