mlsanityData to 14 Oct 2026

Fitting New Speakers Based on a Short Untranscribed Sample

arXiv 1802.06984 ↗First posted 20 Feb 2018cs.LG cs.SD eess.AScited by 18

Not on the map. Why?

Abstract (arXiv)

Learning-based Text To Speech systems have the potential to generalize from one speaker to the next and thus require a relatively short sample of any new voice. However, this promise is currently largely unrealized. We present a method that is designed to capture a new speaker from a short untranscribed audio sample. This is done by employing an additional network that given an audio sample, places the speaker in the embedding space. This network is trained as part of the speech synthesis system using various consistency losses. Our results demonstrate a greatly improved performance on both the dataset speakers, and, more importantly, when fitting new voices, even from very short samples.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Feb 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 8; 2022: 7; 2023: 2; 2024: 1.

18 papers.

Sort:

By area:

  1. 2021A Survey on Neural Speech Synthesiscited by 184
  2. 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
  3. 2023Imaginary Voice: Face-styled Diffusion Model for Text-to-Speechcited by 27
  4. 2021V2C: Visual Voice Cloningcited by 24
  5. 2022Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Featurescited by 20
  6. 2021AnyoneNet: Synchronized Speech and Talking Head Generation for Arbitrary Personcited by 17
  7. 2022CampNet: Context-Aware Mask Prediction for End-to-End Text-Based Speech Editingcited by 16
  8. 2022Style-Label-Free: Cross-Speaker Style Transfer by Quantized VAE and Speaker-wise Normalization in Speech Synthesiscited by 7
  9. 2021Review of end-to-end speech synthesis technology based on deep learningcited by 6
  10. 2022Improve few-shot voice cloning using multi-modal learningcited by 3
  11. 2021Voice Cloning: a Multi-Speaker Text-to-Speech Synthesis Approach based on Transfer Learningcited by 2
  12. 2021The AS-NU System for the M2VoC Challengecited by 1
6 more
  1. 2022Speaker Adaption with Intuitive Prosodic Features for Statistical Parametric Speech Synthesiscited by 1
  2. 2022AutoLV: Automatic Lecture Video Generatorcited by 1
  3. 2023Controllable Generation of Artificial Speaker Embeddings through Discovery of Principal Directionscited by 1
  4. 2024Spiking Music: Audio Compression with Event Based Auto-encoderscited by 1
  5. 2021AI based Presentation Creator With Customized Audio Content Deliverycited by 0
  6. 2022Show Me Your Face, And I'll Tell You How You Speakcited by 0