One Voice, Many Tongues: Cross-Lingual Voice Cloning for Scientific Speech
Not on the map. Why?
Abstract (arXiv)
Preserving a speaker's voice identity while generating speech in a different language remains a fundamental challenge in spoken language technology, particularly in specialized domains such as scientific communication. In this paper, we address this challenge through our system submission to the International Conference on Spoken Language Translation (IWSLT 2026), the Cross-Lingual Voice Cloning shared task. First, we evaluate several state-of-the-art voice cloning models for cross-lingual speech generation of scientific texts in Arabic, Chinese, and French. Then, we build voice cloning systems based on the OmniVoice foundation model. We employ data augmentation via multi-model ensemble distillation from the ACL 60/60 corpus. We investigate the effect of using this synthetic data for fine-tuning, demonstrating improvements in intelligibility (WER & CER) and speaker similarity (SIM), with gains varying across languages.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 21 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
12 of 21 references.
References · 12
- 2017Attention Is All You Needcited by 59,932
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2016Sequence-Level Knowledge Distillationcited by 761
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
- 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 231
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
- 2023Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labellingcited by 87
- 2025Efficient Speech Translation through Model Compression and Knowledge Distillationcited by 4
- 2021HLT-NUS SUBMISSION FOR 2020 NIST Conversational Telephone Speech SREcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026X-Voice: Enabling Everyone to Speak 30 Languages via Zero-Shot Cross-Lingual Voice Cloning
- 2025Cross-Lingual F5-TTS: Towards Language-Agnostic Voice Cloning and Speech Synthesis
- 2026PFluxTTS: Hybrid Flow-Matching TTS with Robust Cross-Lingual Voice Cloning and Inference-Time Model Fusion
- 2026Confucius4-TTS: Transcript-Free Cross-Lingual Zero-Shot TTS with a Learnable Speaker Encoder
- 2026Adding Voice Cloning to Text-to-Audio-Video Models with a Single Zero-Initialised Layer
- 2026Tacit-TTS: From Autoregressive Decoding to Masked Prediction for Efficient Transcript-Free Voice Cloning
- 2026Voxtral TTS
- 2025LatinX: Aligning a Multilingual TTS Model with Direct Preference Optimization