mlsanityData to 14 Oct 2026

Voiced-Aware Style Extraction and Style Direction Adjustment for Expressive Text-to-Speech

arXiv 2511.14824 ↗First posted 18 Nov 2025cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in expressive text-to-speech (TTS) have introduced diverse methods based on style embedding extracted from reference speech. However, synthesizing high-quality expressive speech remains challenging. We propose SpotlightTTS, which exclusively emphasizes style via voiced-aware style extraction and style direction adjustment. Voiced-aware style extraction focuses on voiced regions highly related to style while maintaining continuity across different speech regions to improve expressiveness. We adjust the direction of the extracted style for optimal integration into the TTS model, which improves speech quality. Experimental results demonstrate that Spotlight-TTS achieves superior performance compared to baseline models in terms of expressiveness, overall speech quality, and style transfer capability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 42 references that are in the map. First posted on arXiv 18 Nov 2025.

Builds on

26 of 42 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2022A ConvNet for the 2020scited by 3,579
  5. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  6. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  7. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  8. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  9. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 804
  10. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  11. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
  12. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
14 more
  1. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 490
  2. 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 390
  3. 2018Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesiscited by 259
  4. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
  5. 2018Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotroncited by 173
  6. 2021Emotional Voice Conversion: Theory, Databases and ESDcited by 115
  7. 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
  8. 2024Restructuring Vector Quantization with the Rotation Trickcited by 51
  9. 2023Not All Image Regions Matter: Masked Vector Quantization for Autoregressive Image Generationcited by 28
  10. 2024EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for Controllable Emotional Text-to-Speechcited by 24
  11. 2021Cross-speaker emotion disentangling and transfer for end-to-end speech synthesiscited by 21
  12. 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Controlcited by 20
  13. 2022SyntaSpeech: Syntax-Aware Generative Adversarial Text-to-Speechcited by 18
  14. 2023QI-TTS: Questioning Intonation Control for Emotional Speech Synthesiscited by 8

Built on by

Not cited yet.