Training Neural Speech Recognition Systems with Synthetic Speech Augmentation
Not on the map. Why?
Abstract (arXiv)
Building an accurate automatic speech recognition (ASR) system requires a large dataset that contains many hours of labeled speech samples produced by a diverse set of speakers. The lack of such open free datasets is one of the main issues preventing advancements in ASR research. To address this problem, we propose to augment a natural speech dataset with synthetic speech. We train very large end-to-end neural speech recognition models using the LibriSpeech dataset augmented with synthetic speech. These new models achieve state of the art Word Error Rate (WER) for character-level based models without an external language model.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 7; 2023: 9; 2024: 3.
21 papers.
Sort:
By area:
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
- 2023StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learnerscited by 177
- 2021Injecting Text in Self-Supervised Speech Pretrainingcited by 24
- 2023GPT-FL: Generative Pre-trained Model-Assisted Federated Learningcited by 24
- 2022Differentially Private Speaker Anonymizationcited by 16
- 2023Text-only domain adaptation for end-to-end ASR using integrated text-to-mel-spectrogram generatorcited by 11
- 2022Synthesizing Dysarthric Speech Using Multi-talker TTS for Dysarthric Speech Recognitioncited by 10
- 2022ASR data augmentation in low-resource settings using cross-lingual multi-speaker TTS and cross-lingual voice conversioncited by 10
- 2022Evaluating and reducing the distance between synthetic and real speech distributionscited by 9
- 2022When Is TTS Augmentation Through a Pivot Language Useful?cited by 8
- 2023Accurate synthesis of Dysarthric Speech for ASR data augmentationcited by 7
- 2023OLISIA: a Cascade System for Spoken Dialogue State Trackingcited by 5
9 more
- 2024AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentationcited by 5
- 2022End-to-End Spoken Language Understanding: Performance analyses of a voice command task in a low resource settingcited by 3
- 2023SpeeChain: A Speech Toolkit for Large-Scale Machine Speech Chaincited by 2
- 2021Data Incubation -- Synthesizing Missing Data for Handwriting Recognitioncited by 1
- 2023Dialect Adaptation and Data Augmentation for Low-Resource ASR: TalTech Systems for the MADASR 2023 Challengecited by 1
- 2023MAC: A unified framework boosting low resource automatic speech recognitioncited by 0
- 2023AraSpot: Arabic Spoken Command Spottingcited by 0
- 2024Initial Decoding with Minimally Augmented Language Model for Improved Lattice Rescoring in Low Resource ASRcited by 0
- 2024Beyond Oversmoothing: Evaluating DDPM and MSE for Scalable Speech Synthesis in ASRcited by 0
- 2024AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentation13 Dec 2024
- 2024Beyond Oversmoothing: Evaluating DDPM and MSE for Scalable Speech Synthesis in ASR16 Oct 2024
- 2024Initial Decoding with Minimally Augmented Language Model for Improved Lattice Rescoring in Low Resource ASR16 Mar 2024
- 2023Dialect Adaptation and Data Augmentation for Low-Resource ASR: TalTech Systems for the MADASR 2023 Challenge26 Oct 2023
- 2023Accurate synthesis of Dysarthric Speech for ASR data augmentation16 Aug 2023
- 2023GPT-FL: Generative Pre-trained Model-Assisted Federated Learning3 Jun 2023
- 2023StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learners1 Jun 2023
- 2023OLISIA: a Cascade System for Spoken Dialogue State Tracking20 Apr 2023
- 2023AraSpot: Arabic Spoken Command Spotting29 Mar 2023
- 2023Text-only domain adaptation for end-to-end ASR using integrated text-to-mel-spectrogram generator27 Feb 2023
- 2023MAC: A unified framework boosting low resource automatic speech recognition5 Feb 2023
- 2023SpeeChain: A Speech Toolkit for Large-Scale Machine Speech Chain8 Jan 2023
9 more
- 2022Evaluating and reducing the distance between synthetic and real speech distributions29 Nov 2022
- 2022When Is TTS Augmentation Through a Pivot Language Useful?20 Jul 2022
- 2022End-to-End Spoken Language Understanding: Performance analyses of a voice command task in a low resource setting17 Jul 2022
- 2022Self-Supervised Speech Representation Learning: A Review21 May 2022
- 2022ASR data augmentation in low-resource settings using cross-lingual multi-speaker TTS and cross-lingual voice conversion29 Mar 2022
- 2022Differentially Private Speaker Anonymization23 Feb 2022
- 2022Synthesizing Dysarthric Speech Using Multi-talker TTS for Dysarthric Speech Recognition27 Jan 2022
- 2021Data Incubation -- Synthesizing Missing Data for Handwriting Recognition13 Oct 2021
- 2021Injecting Text in Self-Supervised Speech Pretraining27 Aug 2021
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
- 2023StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learnerscited by 177
- 2021Injecting Text in Self-Supervised Speech Pretrainingcited by 24
- 2023GPT-FL: Generative Pre-trained Model-Assisted Federated Learningcited by 24
- 2022Differentially Private Speaker Anonymizationcited by 16
- 2023Text-only domain adaptation for end-to-end ASR using integrated text-to-mel-spectrogram generatorcited by 11
- 2022Synthesizing Dysarthric Speech Using Multi-talker TTS for Dysarthric Speech Recognitioncited by 10
- 2022ASR data augmentation in low-resource settings using cross-lingual multi-speaker TTS and cross-lingual voice conversioncited by 10
- 2022Evaluating and reducing the distance between synthetic and real speech distributionscited by 9
- 2022When Is TTS Augmentation Through a Pivot Language Useful?cited by 8
- 2023Accurate synthesis of Dysarthric Speech for ASR data augmentationcited by 7
- 2023OLISIA: a Cascade System for Spoken Dialogue State Trackingcited by 5
12 most cited of 20 All 20 (JSON)
- 2024AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentation13 Dec 2024
- 2024Initial Decoding with Minimally Augmented Language Model for Improved Lattice Rescoring in Low Resource ASR16 Mar 2024
- 2023Dialect Adaptation and Data Augmentation for Low-Resource ASR: TalTech Systems for the MADASR 2023 Challenge26 Oct 2023
- 2023Accurate synthesis of Dysarthric Speech for ASR data augmentation16 Aug 2023
- 2023GPT-FL: Generative Pre-trained Model-Assisted Federated Learning3 Jun 2023
- 2023StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learners1 Jun 2023
- 2023OLISIA: a Cascade System for Spoken Dialogue State Tracking20 Apr 2023
- 2023AraSpot: Arabic Spoken Command Spotting29 Mar 2023
- 2023Text-only domain adaptation for end-to-end ASR using integrated text-to-mel-spectrogram generator27 Feb 2023
- 2023MAC: A unified framework boosting low resource automatic speech recognition5 Feb 2023
- 2023SpeeChain: A Speech Toolkit for Large-Scale Machine Speech Chain8 Jan 2023
- 2022Evaluating and reducing the distance between synthetic and real speech distributions29 Nov 2022
12 newest of 20 All 20 (JSON)