Accent Analogy Guidance: More Speaker Similarity at Equal Accent in Cross-Lingual Voice Cloning
Not on the map. Why?
Abstract (arXiv)
In cross-lingual zero-shot text-to-speech, the accent of the reference leaks into the target speech. We propose accent analogy guidance (AAG), a training-free sampler term that subtracts an accent direction estimated from the model's own predictions for one synthetic voice rendered in both languages, so the voice cancels and only the accent remains. By a blind LLM accent judge on real dubbing data, reweighting classifier-free guidance between reference and text, and its variants, stay near one identity-accent trade-off curve; we score a method by its speaker similarity above that curve at equal accent (DeltaSIM). Across four open TTS models AAG lies above the curve: on OmniVoice DeltaSIM is +0.11 to +0.27 on three test sets (accent 3.51 to 4.28 on a 1-5 scale at speaker similarity 0.29, where reweighting keeps 0.02); MaskGCT and CosyVoice 2 also lie above their curves, and on F5-TTS it is more native than any reweighting setting. An LLM-free language-ID measure and a twelve-listener panel agree. A premise test and the reach of a model's own curve indicate in advance whether and roughly how much AAG can gain, predicting the one model where it gains nothing (X-Voice).
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 23 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
21 of 23 references.
References · 21
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
- 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
- 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
- 2023Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modelingcited by 167
- 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 161
- 2021speechocean762: An Open-Source Non-native English Speech Corpus For Pronunciation Assessmentcited by 58
- 2015THCHS-30 : A Free Chinese Speech Corpuscited by 43
9 more
- 2025MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesiscited by 41
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Modelscited by 25
- 2024DualSpeech: Enhancing Speaker-Fidelity and Text-Intelligibility Through Dual Classifier-Free Guidancecited by 11
- 2025Selective Classifier-free Guidance for Zero-shot Text-to-speechcited by 4
- 2026X-Voice: Enabling Everyone to Speak 30 Languages via Zero-Shot Cross-Lingual Voice Cloningcited by 4
- 2026Accent Vector: Controllable Accent Manipulation for Multilingual TTS Without Accented Datacited by 2
- 2026CrossAccent-TTS: Cross-Lingual Accent-Intensity Controllable Text-to-Speech via Disentangled Speaker and Accent Representationscited by 1
- 2026Joint Residual Reweighting for Classifier Free Guidance in Flow-Matching Zero-Shot TTScited by 1
- 2026Phrase-Localized Language-Contrastive Guidance: Training-Free Localized Accent Control for Code-Switching Text-to-Speechcited by 1
Built on by
Not cited yet.