Voice-preserving Zero-shot Multiple Accent Conversion
Not on the map. Why?
Abstract (arXiv)
Most people who have tried to learn a foreign language would have experienced difficulties understanding or speaking with a native speaker's accent. For native speakers, understanding or speaking a new accent is likewise a difficult task. An accent conversion system that changes a speaker's accent but preserves that speaker's voice identity, such as timbre and pitch, has the potential for a range of applications, such as communication, language learning, and entertainment. Existing accent conversion models tend to change the speaker identity and accent at the same time. Here, we use adversarial learning to disentangle accent dependent features while retaining other acoustic characteristics. What sets our work apart from existing accent conversion models is the capability to convert an unseen speaker's utterance to multiple accents while preserving its original voice identity. Subjective evaluations show that our model generates audio that sound closer to the target accent and like the original speaker.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 7 of its 22 references that are in the map. First posted on arXiv 23 Nov 2022.
Builds on
7 of 22 references.
References · 7
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2019Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloningcited by 66
- 2020Accent and Speaker Disentanglement in Many-to-many Voice Conversioncited by 15
- 2020Unsupervised Learning of Disentangled Speech Content and Style Representationcited by 13
Built on by
Citing papers per year: 2023: 2; 2024: 5; 2025: 3; 2026: 7.
17 papers.
Sort:
By area:
- 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Reviewcited by 18
- 2025Forensic deepfake audio detection using segmental speech featurescited by 8
- 2024VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editingcited by 7
- 2024Transfer the linguistic representations from TTS to accent conversion with non-parallel datacited by 5
- 2024Accent conversion using discrete units with parallel data synthesized from controllable accented TTScited by 5
- 2024Improving Pronunciation and Accent Conversion through Knowledge Distillation And Synthetic Ground-Truth from Native TTScited by 5
- 2025Pairwise Evaluation of Accent Similarity in Speech Synthesiscited by 4
- 2024Non-autoregressive real-time Accent Conversion model with voice cloningcited by 2
- 2026CosyAccent: Duration-Controllable Accent Normalization Using Source-Synthesis Training Datacited by 2
- 2023Synthetic Cross-accent Data Augmentation for Automatic Speech Recognitioncited by 1
- 2025Streaming Non-Autoregressive Model for Accent Conversion and Pronunciation Improvementcited by 1
- 2026Unifying Speech Recognition, Synthesis and Conversion with Autoregressive Transformerscited by 0
5 more
- 2026StyleStream: Real-Time Zero-Shot Voice Style Conversioncited by 0
- 2026Controllable Accent Normalization via Discrete Diffusioncited by 0
- 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Controlcited by 0
- 2026TokAN: Accent Normalization Using Self-Supervised Speech Tokenscited by 0
- 2026A survey of AI-generated voices and their detectioncited by 0
- 2026A survey of AI-generated voices and their detection15 Aug 2026
- 2026TokAN: Accent Normalization Using Self-Supervised Speech Tokens4 Jul 2026
- 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Control15 Jun 2026
- 2026Controllable Accent Normalization via Discrete Diffusion15 Mar 2026
- 2026StyleStream: Real-Time Zero-Shot Voice Style Conversion23 Feb 2026
- 2026CosyAccent: Duration-Controllable Accent Normalization Using Source-Synthesis Training Data22 Feb 2026
- 2026Unifying Speech Recognition, Synthesis and Conversion with Autoregressive Transformers15 Jan 2026
- 2025Streaming Non-Autoregressive Model for Accent Conversion and Pronunciation Improvement19 Jun 2025
- 2025Pairwise Evaluation of Accent Similarity in Speech Synthesis20 May 2025
- 2025Forensic deepfake audio detection using segmental speech features20 May 2025
- 2024Improving Pronunciation and Accent Conversion through Knowledge Distillation And Synthetic Ground-Truth from Native TTS19 Oct 2024
- 2024Accent conversion using discrete units with parallel data synthesized from controllable accented TTS30 Sep 2024
5 more
- 2024Non-autoregressive real-time Accent Conversion model with voice cloning21 May 2024
- 2024VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editing10 Apr 2024
- 2024Transfer the linguistic representations from TTS to accent conversion with non-parallel data7 Jan 2024
- 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Review7 Jul 2023
- 2023Synthetic Cross-accent Data Augmentation for Automatic Speech Recognition1 Mar 2023
- 2026Controllable Accent Normalization via Discrete Diffusioncited by 0
- 2026Controllable Accent Normalization via Discrete Diffusion15 Mar 2026
- 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Reviewcited by 18
- 2025Forensic deepfake audio detection using segmental speech featurescited by 8
- 2024VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editingcited by 7
- 2024Transfer the linguistic representations from TTS to accent conversion with non-parallel datacited by 5
- 2024Accent conversion using discrete units with parallel data synthesized from controllable accented TTScited by 5
- 2024Improving Pronunciation and Accent Conversion through Knowledge Distillation And Synthetic Ground-Truth from Native TTScited by 5
- 2025Pairwise Evaluation of Accent Similarity in Speech Synthesiscited by 4
- 2024Non-autoregressive real-time Accent Conversion model with voice cloningcited by 2
- 2026CosyAccent: Duration-Controllable Accent Normalization Using Source-Synthesis Training Datacited by 2
- 2023Synthetic Cross-accent Data Augmentation for Automatic Speech Recognitioncited by 1
- 2025Streaming Non-Autoregressive Model for Accent Conversion and Pronunciation Improvementcited by 1
- 2026Unifying Speech Recognition, Synthesis and Conversion with Autoregressive Transformerscited by 0
12 most cited of 16 All 16 (JSON)
- 2026A survey of AI-generated voices and their detection15 Aug 2026
- 2026TokAN: Accent Normalization Using Self-Supervised Speech Tokens4 Jul 2026
- 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Control15 Jun 2026
- 2026StyleStream: Real-Time Zero-Shot Voice Style Conversion23 Feb 2026
- 2026CosyAccent: Duration-Controllable Accent Normalization Using Source-Synthesis Training Data22 Feb 2026
- 2026Unifying Speech Recognition, Synthesis and Conversion with Autoregressive Transformers15 Jan 2026
- 2025Streaming Non-Autoregressive Model for Accent Conversion and Pronunciation Improvement19 Jun 2025
- 2025Pairwise Evaluation of Accent Similarity in Speech Synthesis20 May 2025
- 2025Forensic deepfake audio detection using segmental speech features20 May 2025
- 2024Improving Pronunciation and Accent Conversion through Knowledge Distillation And Synthetic Ground-Truth from Native TTS19 Oct 2024
- 2024Accent conversion using discrete units with parallel data synthesized from controllable accented TTS30 Sep 2024
- 2024Non-autoregressive real-time Accent Conversion model with voice cloning21 May 2024
12 newest of 16 All 16 (JSON)