mlsanityData to 7 Oct 2026

Phrase-Localized Language-Contrastive Guidance: Training-Free Localized Accent Control for Code-Switching Text-to-Speech

arXiv 2609.01016 ↗First posted 1 Sep 2026cs.CL cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

Current speech synthesis struggles with code-switching, which mixes a foreign language phrase into a primary language utterance, causing the phrase to be spoken with the primary language's accent rather than its native one. We propose Phrase-Localized Language-Contrastive Guidance (LCG), a training-free inference framework that restores a native accent to code-switched phrases in cross-lingual text-to-speech. LCG replaces the single language guidance applied across the whole utterance with a separate guidance for each region, so each part is guided by its own language. To choose where to apply this localized guidance, we propose a self-attention probing technique that finds the phrase boundaries without external alignments. Together, these components generate speech in which each region carries the accent of its own language, requiring no fine-tuning or auxiliary models. Across diverse language pairs, LCG robustly increases the nativeness of the code-switched phrase while suppressing accent leakage, and preserving overall speaker identity and naturalness.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

28 of 45 references.

References · 28

  1. 2022Classifier-Free Diffusion Guidancecited by 5,717
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  4. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  5. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  6. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
  7. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  8. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
  9. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 487
  10. 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
  11. 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
  12. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 293
16 more
  1. 2020Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Searchcited by 269
  2. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
  3. 2023Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modelingcited by 166
  4. 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 159
  5. 2024VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wildcited by 118
  6. 2023Stay on topic with Classifier-Free Guidancecited by 90
  7. 2019A Survey of Code-switched Speech and Language Processingcited by 73
  8. 2024Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidancecited by 58
  9. 2019CSS10: A Collection of Single Speaker Speech Datasets for 10 Languagescited by 54
  10. 2025SwitchLingua: The First Large-Scale Multilingual and Multi-Ethnic Code-Switching Datasetcited by 12
  11. 2025PIER: A Novel Metric for Evaluating What Matters in Code-Switchingcited by 11
  12. 2025Selective Classifier-free Guidance for Zero-shot Text-to-speechcited by 4
  13. 2025HiKE: Hierarchical Evaluation Framework for Korean-English Code-Switching Speech Recognitioncited by 4
  14. 2026X-Voice: Enabling Everyone to Speak 30 Languages via Zero-Shot Cross-Lingual Voice Cloningcited by 4
  15. 2022Text Enhancement for Paragraph Processing in End-to-End Code-switching TTScited by 1
  16. 2026LLaDA-TTS: Unifying Speech Synthesis and Zero-Shot Editing via Masked Diffusion Modelingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.