mlsanityData to 14 Oct 2026

GSA-TTS : Toward Zero-Shot Speech Synthesis based on Gradual Style Adaptor

arXiv 2505.19384 ↗First posted 26 May 2025cs.CL cs.SD eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

We present the gradual style adaptor TTS (GSA-TTS) with a novel style encoder that gradually encodes speaking styles from an acoustic reference for zero-shot speech synthesis. GSA first captures the local style of each semantic sound unit. Then the local styles are combined by self-attention to obtain a global style condition. This semantic and hierarchical encoding strategy provides a robust and rich style representation for an acoustic model. We test GSA-TTS on unseen speakers and obtain promising results regarding naturalness, speaker similarity, and intelligibility. Additionally, we explore the potential of GSA in terms of interpretability and controllability, which stems from its hierarchical structure.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 30 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

22 of 30 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  3. 2016Layer Normalizationcited by 5,669
  4. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  5. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
  6. 2016Language Modeling with Gated Convolutional Networkscited by 702
  7. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 490
  8. 2019Are Transformers universal approximators of sequence-to-sequence functions?cited by 406
  9. 2018Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesiscited by 259
  10. 2020FastPitch: Parallel Text-to-speech with Pitch Predictioncited by 151
  11. 2023LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpuscited by 101
  12. 2021AdaSpeech: Adaptive Text to Speech for Custom Voicecited by 98
10 more
  1. 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
  2. 2019Zero-Shot Multi-Speaker Text-To-Speech with State-of-the-art Neural Speaker Embeddingscited by 73
  3. 2021One TTS Alignment To Rule Them Allcited by 47
  4. 2015Sequence-to-Sequence Neural Net Models for Grapheme-to-Phoneme Conversioncited by 19
  5. 2020g2pM: A Neural Grapheme-to-Phoneme Conversion Package for Mandarin Chinese Based on a New Open Benchmark Datasetcited by 15
  6. 2023HierVST: Hierarchical Adaptive Zero-shot Voice Style Transfercited by 9
  7. 2023CrossSpeech: Speaker-independent Acoustic Representation for Cross-lingual Speech Synthesiscited by 3
  8. 2021Visual Question Answering based on Local-Scene-Aware Referring Expression Generationcited by 2
  9. 2023Good Neighbors Are All You Need for Chinese Grapheme-to-Phoneme Conversioncited by 1
  10. 2024Intelli-Z: Toward Intelligible Zero-Shot TTScited by 1

Built on by

Not cited yet.