mlsanityData to 7 Oct 2026

LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning

arXiv 2406.07969 ↗First posted 12 Jun 2024eess.AS cs.CL cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

We introduce LibriTTS-P, a new corpus based on LibriTTS-R that includes utterance-level descriptions (i.e., prompts) of speaking style and speaker-level prompts of speaker characteristics. We employ a hybrid approach to construct prompt annotations: (1) manual annotations that capture human perceptions of speaker characteristics and (2) synthetic annotations on speaking style. Compared to existing English prompt datasets, our corpus provides more diverse prompt annotations for all speakers of LibriTTS-R. Experimental results for prompt-based controllable TTS demonstrate that the TTS model trained with LibriTTS-P achieves higher naturalness than the model using the conventional dataset. Furthermore, the results for style captioning tasks show that the model utilizing LibriTTS-P generates 2.5 times more accurate words than the model using a conventional dataset. Our corpus, LibriTTS-P, is available at https://github.com/line/LibriTTS-P.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 20 of its 30 references that are in the map. First posted on arXiv 12 Jun 2024.

Builds on

20 of 30 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  6. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
  7. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
  8. 2023Audiobox: Unified Audio Generation with Natural Language Promptscited by 120
  9. 2022PromptTTS: Controllable Text-to-Speech with Text Descriptionscited by 106
  10. 2023LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpuscited by 100
  11. 2023InstructTTS: Modelling Expressive TTS in Discrete Latent Space with Natural Language Style Promptcited by 90
  12. 2024Natural language guidance of high-fidelity text-to-speech with synthetic annotationscited by 66
8 more
  1. 2023TextrolSpeech: A Text Style Control Speech Corpus With Codec Language Text-to-Speech Modelscited by 48
  2. 2019Neural source-filter waveform models for statistical parametric speech synthesiscited by 46
  3. 2023PromptStyle: Controllable Style Transfer for Text-to-Speech with Natural Language Descriptionscited by 33
  4. 2023PromptTTS++: Controlling Speaker Identity in Prompt-Based Text-to-Speech Using Natural Language Descriptionscited by 25
  5. 2023Coco-Nut: Corpus of Japanese Utterance and Voice Characteristics Description for Prompt-based Controlcited by 7
  6. 2023StyleCap: Automatic Speaking-Style Captioning from Speech Based on Speech and Language Self-supervised Learning Modelscited by 7
  7. 2023PromptSpeaker: Speaker Generation Based on Text Descriptionscited by 5
  8. 2023Controllable Speaking Styles Using a Large Language Modelcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 10; 2026: 2.

15 papers.

Sort:

By area:

  1. 2025Scaling Rich Style-Prompted Text-to-Speech Datasetscited by 17
  2. 2025SIFT-50M: A Large-Scale Multilingual Dataset for Speech Instruction Fine-Tuningcited by 14
  3. 2025CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speechcited by 11
  4. 2024Adversarial Training: A Surveycited by 6
  5. 2024Description-based Controllable Text-to-Speech with Cross-Lingual Voice Controlcited by 4
  6. 2025Speechless: Speech Instruction Training Without Speech for Low Resource Languagescited by 4
  7. 2025RASMALAI: Resources for Adaptive Speech Modeling in Indian Languages with Accents and Intonationscited by 3
  8. 2025Voice Impression Control in Zero-Shot TTScited by 3
  9. 2025Unispeaker: A Unified Approach for Multimodality-driven Speaker Generationcited by 2
  10. 2025MoE-TTS: Enhancing Out-of-Domain Text Understanding for Description-based TTS via Mixture-of-Expertscited by 2
  11. 2025HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarioscited by 2
  12. 2024EmoSpeech: A Corpus of Emotionally Rich and Contextually Detailed Speech Annotationscited by 1
3 more
  1. 2026Accent Vector: Controllable Accent Manipulation for Multilingual TTS Without Accented Datacited by 1
  2. 2026VoiceDesigner: Text-to-Voice Generation and Editing via Unified Diffusion Modeling and Data Augmentationcited by 1
  3. 2025Expressive Speech Retrieval using Natural Language Descriptions of Speaking Stylecited by 0