Hi-Fi Multi-Speaker English TTS Dataset
Not on the map. Why?
Abstract (arXiv)
This paper introduces a new multi-speaker English dataset for training text-to-speech models. The dataset is based on LibriVox audiobooks and Project Gutenberg texts, both in the public domain. The new dataset contains about 292 hours of speech from 10 speakers with at least 17 hours per speaker sampled at 44.1 kHz. To select speech samples with high quality, we considered audio recordings with a signal bandwidth of at least 13 kHz and a signal-to-noise ratio (SNR) of at least 32 dB. The dataset is publicly released at http://www.openslr.org/109/ .
Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Apr 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 9; 2023: 10; 2024: 10; 2025: 15; 2026: 10.
60 papers.
Sort:
By area:
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
- 2023Better speech synthesis through scalingcited by 63
- 2025Koel-TTS: Enhancing LLM based Speech Generation with Preference Alignment and Classifier Free Guidancecited by 26
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancementcited by 23
- 2024Improving Robustness of LLM-based Speech Synthesis by Learning Monotonic Alignmentcited by 21
- 2022WavThruVec: Latent speech representation as intermediate features for neural speech synthesiscited by 17
- 2022Low-Resource Multilingual and Zero-Shot Multispeaker TTScited by 15
- 2023ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpuscited by 14
- 2025NanoCodec: Towards High-Quality Ultra Fast Speech LLM Inferencecited by 14
- 2022Exact Prosody Cloning in Zero-Shot Multispeaker Text-to-Speechcited by 13
- 2021Adapting TTS models For New Speakers using Transfer Learningcited by 12
38 more
- 2024Low Frame-rate Speech Codec: a Codec Designed for Fast High-quality Speech LLM Training and Inferencecited by 11
- 2022Adapter-Based Extension of Multi-Speaker Text-to-Speech Model for New Speakerscited by 9
- 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstructioncited by 9
- 2024Meta Learning Text-to-Speech Synthesis in over 7000 Languagescited by 9
- 2023mdctGAN: Taming transformer-based GAN for speech super-resolution with Modified DCT spectracited by 6
- 2025UniSS: Unified Expressive Speech-to-Speech Translation with Your Voicecited by 6
- 2021A Toolbox for Construction and Analysis of Speech Datasetscited by 5
- 2021RefineGAN: Universally Generating Waveform Better than Ground Truth with Highly Accurate Pitch and Intensity Responsescited by 5
- 2022Distribution augmentation for low-resource expressive text-to-speechcited by 5
- 2022PoeticTTS -- Controllable Poetry Reading for Literary Studiescited by 5
- 2026The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoningcited by 5
- 2021Revisiting IPA-based Cross-lingual Text-to-speechcited by 4
- 2025Voice Cloning: Comprehensive Surveycited by 4
- 2025StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMscited by 4
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Modelscited by 4
- 2023Large-scale unsupervised audio pre-training for video-to-speech synthesiscited by 3
- 2024Sound Check: Auditing Audio Datasetscited by 3
- 2026VoxServe: Streaming-Centric Serving System for Speech Language Modelscited by 3
- 2026VoiceChat-TTS: A Low-Latency Continuous Speech Synthesis Model for Interactive Agentscited by 3
- 2023Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentationcited by 2
- 2024StoryTTS: A Highly Expressive Text-to-Speech Dataset with Rich Textual Expressiveness Annotationscited by 2
- 2024SVDD Challenge 2024: A Singing Voice Deepfake Detection Challenge Evaluation Plancited by 2
- 2025UDDETTS: Unifying Discrete and Dimensional Emotions for Controllable Emotional Text-to-Speechcited by 2
- 2025Length-Aware Rotary Position Embedding for Text-Speech Alignmentcited by 2
- 2025Objective Evaluation of Prosody and Intelligibility in Speech Synthesis via Conditional Prediction of Discrete Tokenscited by 2
- 2026HoliTok: A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understandingcited by 2
- 2022Framewise WaveGAN: High Speed Adversarial Vocoder in Time Domain with Very Low Computational Complexitycited by 1
- 2023Controllable Generation of Artificial Speaker Embeddings through Discovery of Principal Directionscited by 1
- 2024SECP: A Speech Enhancement-Based Curation Pipeline For Scalable Acquisition Of Clean Speechcited by 1
- 2024Acquiring Pronunciation Knowledge from Transcribed Speech Audio via Multi-task Learningcited by 1
- 2025SupertonicTTS: Towards Highly Efficient and Streamlined Text-to-Speech Systemcited by 1
- 2025MaskVCT: Masked Voice Codec Transformer for Zero-Shot Voice Conversion With Increased Controllability via Multiple Guidancescited by 1
- 2025Align2Speak: Improving TTS for Low Resource Languages via ASR-Guided Online Preference Optimizationcited by 1
- 2025Modeling Sarcastic Speech: Semantic and Prosodic Cues in a Speech Synthesis Frameworkcited by 1
- 2026Reconstruct! Don't Encode: Self-Supervised Representation Reconstruction Loss for High-Intelligibility and Low-Latency Streaming Neural Audio Codeccited by 1
- 2026Streaming T5-based Text-to-Speech Synthesis with Limited Lookaheadcited by 1
- 2022Neural Speech Synthesis on a Shoestring: Improving the Efficiency of LPCNetcited by 0
- 2022Towards Unconstrained Audio Splicing Detection and Localization with Neural Networkscited by 0
50 most cited of 60 All 60 (JSON)
- 2026VoiceChat-TTS: A Low-Latency Continuous Speech Synthesis Model for Interactive Agents13 Aug 2026
- 2026Streaming T5-based Text-to-Speech Synthesis with Limited Lookahead20 Jun 2026
- 2026UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception29 May 2026
- 2026HoliTok: A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding28 May 2026
- 2026Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs14 Apr 2026
- 2026The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoning18 Mar 2026
- 2026When Fine-Tuning Fails and when it Generalises: Role of Data Diversity and Mixed Training in LLM-based TTS11 Mar 2026
- 2026Reconstruct! Don't Encode: Self-Supervised Representation Reconstruction Loss for High-Intelligibility and Low-Latency Streaming Neural Audio Codec6 Mar 2026
- 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Models15 Feb 2026
- 2026VoxServe: Streaming-Centric Serving System for Speech Language Models30 Jan 2026
- 2025Modeling Sarcastic Speech: Semantic and Prosodic Cues in a Speech Synthesis Framework8 Oct 2025
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Models28 Sep 2025
38 more
- 2025StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMs26 Sep 2025
- 2025Align2Speak: Improving TTS for Low Resource Languages via ASR-Guided Online Preference Optimization26 Sep 2025
- 2025UniSS: Unified Expressive Speech-to-Speech Translation with Your Voice25 Sep 2025
- 2025Objective Evaluation of Prosody and Intelligibility in Speech Synthesis via Conditional Prediction of Discrete Tokens24 Sep 2025
- 2025MaskVCT: Masked Voice Codec Transformer for Zero-Shot Voice Conversion With Increased Controllability via Multiple Guidances21 Sep 2025
- 2025Length-Aware Rotary Position Embedding for Text-Speech Alignment14 Sep 2025
- 2025NanoCodec: Towards High-Quality Ultra Fast Speech LLM Inference7 Aug 2025
- 2025UDDETTS: Unifying Discrete and Dimensional Emotions for Controllable Emotional Text-to-Speech15 May 2025
- 2025Voice Cloning: Comprehensive Survey1 May 2025
- 2025SupertonicTTS: Towards Highly Efficient and Streamlined Text-to-Speech System29 Mar 2025
- 2025Audio-FLAN: An Instruction-Following Dataset for Unified Audio Understanding and Generation of Speech, Music, and Sound23 Feb 2025
- 2025Koel-TTS: Enhancing LLM based Speech Generation with Preference Alignment and Classifier Free Guidance7 Feb 2025
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancement26 Jan 2025
- 2024Sound Check: Auditing Audio Datasets17 Oct 2024
- 2024Low Frame-rate Speech Codec: a Codec Designed for Fast High-quality Speech LLM Training and Inference18 Sep 2024
- 2024Acquiring Pronunciation Knowledge from Transcribed Speech Audio via Multi-task Learning15 Sep 2024
- 2024Improving Robustness of Diffusion-Based Zero-Shot Speech Synthesis via Stable Formant Generation14 Sep 2024
- 2024Improving Robustness of LLM-based Speech Synthesis by Learning Monotonic Alignment25 Jun 2024
- 2024Meta Learning Text-to-Speech Synthesis in over 7000 Languages10 Jun 2024
- 2024SVDD Challenge 2024: A Singing Voice Deepfake Detection Challenge Evaluation Plan8 May 2024
- 2024StoryTTS: A Highly Expressive Text-to-Speech Dataset with Rich Textual Expressiveness Annotations23 Apr 2024
- 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstruction8 Mar 2024
- 2024SECP: A Speech Enhancement-Based Curation Pipeline For Scalable Acquisition Of Clean Speech19 Feb 2024
- 2023Controllable Generation of Artificial Speaker Embeddings through Discovery of Principal Directions26 Oct 2023
- 2023Generative Adversarial Training for Text-to-Speech Synthesis Based on Raw Phonetic Input and Explicit Prosody Modelling14 Oct 2023
- 2023VoiceBank-2023: A Multi-Speaker Mandarin Speech Corpus for Constructing Personalized TTS Systems for the Speech Impaired27 Aug 2023
- 2023Large-scale unsupervised audio pre-training for video-to-speech synthesis27 Jun 2023
- 2023Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentation14 Jun 2023
- 2023mdctGAN: Taming transformer-based GAN for speech super-resolution with Modified DCT spectra18 May 2023
- 2023Better speech synthesis through scaling12 May 2023
- 2023ArmanTTS single-speaker Persian dataset7 Apr 2023
- 2023ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpus28 Feb 2023
- 2023Automatic Heteronym Resolution Pipeline Using RAD-TTS Aligners28 Feb 2023
- 2022Framewise WaveGAN: High Speed Adversarial Vocoder in Time Domain with Very Low Computational Complexity8 Dec 2022
- 2022Adapter-Based Extension of Multi-Speaker Text-to-Speech Model for New Speakers1 Nov 2022
- 2022Low-Resource Multilingual and Zero-Shot Multispeaker TTS21 Oct 2022
- 2022Towards Unconstrained Audio Splicing Detection and Localization with Neural Networks29 Jul 2022
- 2022PoeticTTS -- Controllable Poetry Reading for Literary Studies11 Jul 2022
50 newest of 60 All 60 (JSON)
- 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
- 2023Better speech synthesis through scalingcited by 63
- 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstructioncited by 9
- 2024Improving Robustness of Diffusion-Based Zero-Shot Speech Synthesis via Stable Formant Generationcited by 0
- 2024Improving Robustness of Diffusion-Based Zero-Shot Speech Synthesis via Stable Formant Generation14 Sep 2024
- 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstruction8 Mar 2024
- 2023Better speech synthesis through scaling12 May 2023
- 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance23 Nov 2021
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancementcited by 23
- 2024Improving Robustness of LLM-based Speech Synthesis by Learning Monotonic Alignmentcited by 21
- 2022WavThruVec: Latent speech representation as intermediate features for neural speech synthesiscited by 17
- 2022Low-Resource Multilingual and Zero-Shot Multispeaker TTScited by 15
- 2023ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpuscited by 14
- 2025NanoCodec: Towards High-Quality Ultra Fast Speech LLM Inferencecited by 14
- 2022Exact Prosody Cloning in Zero-Shot Multispeaker Text-to-Speechcited by 13
- 2021Adapting TTS models For New Speakers using Transfer Learningcited by 12
- 2024Low Frame-rate Speech Codec: a Codec Designed for Fast High-quality Speech LLM Training and Inferencecited by 11
- 2022Adapter-Based Extension of Multi-Speaker Text-to-Speech Model for New Speakerscited by 9
- 2024Meta Learning Text-to-Speech Synthesis in over 7000 Languagescited by 9
12 most cited of 51 All 51 (JSON)
- 2026Streaming T5-based Text-to-Speech Synthesis with Limited Lookahead20 Jun 2026
- 2026UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception29 May 2026
- 2026HoliTok: A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding28 May 2026
- 2026Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs14 Apr 2026
- 2026The Silent Thought: Modeling Internal Cognition in Full-Duplex Spoken Dialogue Models via Latent Reasoning18 Mar 2026
- 2026When Fine-Tuning Fails and when it Generalises: Role of Data Diversity and Mixed Training in LLM-based TTS11 Mar 2026
- 2026Reconstruct! Don't Encode: Self-Supervised Representation Reconstruction Loss for High-Intelligibility and Low-Latency Streaming Neural Audio Codec6 Mar 2026
- 2025Modeling Sarcastic Speech: Semantic and Prosodic Cues in a Speech Synthesis Framework8 Oct 2025
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Models28 Sep 2025
- 2025StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMs26 Sep 2025
- 2025UniSS: Unified Expressive Speech-to-Speech Translation with Your Voice25 Sep 2025
- 2025Objective Evaluation of Prosody and Intelligibility in Speech Synthesis via Conditional Prediction of Discrete Tokens24 Sep 2025
12 newest of 51 All 51 (JSON)