Phrase-Localized Language-Contrastive Guidance: Training-Free Localized Accent Control for Code-Switching Text-to-Speech
Not on the map. Why?
Abstract (arXiv)
Current speech synthesis struggles with code-switching, which mixes a foreign language phrase into a primary language utterance, causing the phrase to be spoken with the primary language's accent rather than its native one. We propose Phrase-Localized Language-Contrastive Guidance (LCG), a training-free inference framework that restores a native accent to code-switched phrases in cross-lingual text-to-speech. LCG replaces the single language guidance applied across the whole utterance with a separate guidance for each region, so each part is guided by its own language. To choose where to apply this localized guidance, we propose a self-attention probing technique that finds the phrase boundaries without external alignments. Together, these components generate speech in which each region carries the accent of its own language, requiring no fine-tuning or auxiliary models. Across diverse language pairs, LCG robustly increases the nativeness of the code-switched phrase while suppressing accent leakage, and preserving overall speaker identity and naturalness.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
28 of 45 references.
References · 28
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
- 2017Tacotron: Towards End-to-End Speech Synthesiscited by 487
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
- 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 293
16 more
- 2020Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Searchcited by 269
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
- 2023Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modelingcited by 166
- 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 159
- 2024VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wildcited by 118
- 2023Stay on topic with Classifier-Free Guidancecited by 90
- 2019A Survey of Code-switched Speech and Language Processingcited by 73
- 2024Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidancecited by 58
- 2019CSS10: A Collection of Single Speaker Speech Datasets for 10 Languagescited by 54
- 2025SwitchLingua: The First Large-Scale Multilingual and Multi-Ethnic Code-Switching Datasetcited by 12
- 2025PIER: A Novel Metric for Evaluating What Matters in Code-Switchingcited by 11
- 2025Selective Classifier-free Guidance for Zero-shot Text-to-speechcited by 4
- 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognitioncited by 4
- 2026X-Voice: Enabling Everyone to Speak 30 Languages via Zero-Shot Cross-Lingual Voice Cloningcited by 4
- 2022Text Enhancement for Paragraph Processing in End-to-End Code-switching TTScited by 1
- 2026LLaDA-TTS: Unifying Speech Synthesis and Zero-Shot Editing via Masked Diffusion Modelingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.