Modelling low-resource accents without accent-specific TTS frontend
Not on the map. Why?
Abstract (arXiv)
This work focuses on modelling a speaker's accent that does not have a dedicated text-to-speech (TTS) frontend, including a grapheme-to-phoneme (G2P) module. Prior work on modelling accents assumes a phonetic transcription is available for the target accent, which might not be the case for low-resource, regional accents. In our work, we propose an approach whereby we first augment the target accent data to sound like the donor voice via voice conversion, then train a multi-speaker multi-accent TTS model on the combination of recordings and synthetic data, to generate the donor's voice speaking in the target accent. Throughout the procedure, we use a TTS frontend developed for the same language but a different accent. We show qualitative and quantitative analysis where the proposed strategy achieves state-of-the-art results compared to other generative models. Our work demonstrates that low resource accents can be modelled with relatively little data and without developing an accent-specific TTS frontend. Audio samples of our model converting to multiple accents are available on our web page.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 12 of its 41 references that are in the map. First posted on arXiv 11 Jan 2023.
Builds on
12 of 41 references.
References · 12
- 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
- 2017Generalized End-to-End Loss for Speaker Verificationcited by 290
- 2018Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotroncited by 171
- 2019Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloningcited by 66
- 2021Universal Neural Vocoding with Parallel WaveNetcited by 25
- 2020Accent and Speaker Disentanglement in Many-to-many Voice Conversioncited by 15
- 2021Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speechcited by 14
- 2022Training Text-To-Speech Systems From Synthetic Data: A Practical Approach For Accent Transfer Taskscited by 6
- 2022Unify and Conquer: How Phonetic Feature Representation Affects Polyglot Text-To-Speech (TTS)cited by 5
- 2021AISPEECH-SJTU accent identification system for the Accented English Speech Recognition Challengecited by 4
- 2022Mix and Match: An Empirical Study on Training Corpus Composition for Polyglot Text-To-Speech (TTS)cited by 4
- 2022Remap, warp and attend: Non-parallel many-to-many accent conversion with Normalizing Flowscited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 0; 2026: 1.
3 papers.
- 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Reviewcited by 18
- 2024VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editingcited by 7
- 2026Complex-Text Robustness Evaluation and Failure Diagnosis for Low-Resource Multilingual Text-to-Speechcited by 0
- 2026Complex-Text Robustness Evaluation and Failure Diagnosis for Low-Resource Multilingual Text-to-Speech10 Sep 2026
- 2024VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editing10 Apr 2024
- 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Review7 Jul 2023