mlsanityData to 7 Oct 2026

Scaling NVIDIA's Multi-speaker Multi-lingual TTS Systems with Zero-Shot TTS to Indic Languages

arXiv 2401.13851 ↗First posted 24 Jan 2024cs.SD cs.LG eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we describe the TTS models developed by NVIDIA for the MMITS-VC (Multi-speaker, Multi-lingual Indic TTS with Voice Cloning) 2024 Challenge. In Tracks 1 and 2, we utilize RAD-MMM to perform few-shot TTS by training additionally on 5 minutes of target speaker data. In Track 3, we utilize P-Flow to perform zero-shot TTS by training on the challenge dataset as well as external datasets. We use HiFi-GAN vocoders for all submissions. RAD-MMM performs competitively on Tracks 1 and 2, while P-Flow ranks first on Track 3, with mean opinion score (MOS) 4.4 and speaker similarity score (SMOS) of 3.62.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 3 of its 6 references that are in the map. First posted on arXiv 24 Jan 2024.

Builds on

3 of 6 references.

References · 3

  1. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  2. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
  3. 2023VANI: Very-lightweight Accent-controllable TTS for Native and Non-native speakers with Identity Preservationcited by 2

Built on by

Not cited yet.