The RWTH ASR System for TED-LIUM Release 2: Improving Hybrid HMM with SpecAugment
Not on the map. Why?
Abstract (arXiv)
We present a complete training pipeline to build a state-of-the-art hybrid HMM-based ASR system on the 2nd release of the TED-LIUM corpus. Data augmentation using SpecAugment is successfully applied to improve performance on top of our best SAT model using i-vectors. By investigating the effect of different maskings, we achieve improvements from SpecAugment on hybrid HMM models without increasing model size and training time. A subsequent sMBR training is applied to fine-tune the final acoustic model, and both LSTM and Transformer language models are trained and evaluated. Our best system achieves a 5.6% WER on the test set, which outperforms the previous state-of-the-art by 27% relative.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 3; 2023: 3; 2024: 2; 2025: 1; 2026: 2.
19 papers.
Sort:
- 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 148
- 2023End-to-End Speech Recognition: A Surveycited by 127
- 2021SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Networkcited by 83
- 2021Transformer Based Deliberation for Two-Pass Speech Recognitioncited by 29
- 2022Listen, Adapt, Better WER: Source-free Single-utterance Test-time Adaptation for Automatic Speech Recognitioncited by 19
- 2021Conformer-based Hybrid ASR System for Switchboard Datasetcited by 15
- 2022Efficient Training of Neural Transducer for Speech Recognitioncited by 14
- 2023Lexical Speaker Error Correction: Leveraging Language Models for Speaker Diarization Error Correctioncited by 14
- 2021Acoustic Data-Driven Subword Modeling for End-to-End Speech Recognitioncited by 11
- 2022Improving the Training Recipe for a Robust Conformer-based Hybrid Modelcited by 9
- 2021On Architectures and Training for Raw Waveform Feature Extraction in ASRcited by 8
- 2024Dynamic Encoder Size Based on Data-Driven Layer-wise Pruning for Speech Recognitioncited by 7
7 more
- 2024AG-LSEC: Audio Grounded Lexical Speaker Error Correctioncited by 3
- 2021The Impact of ASR on the Automatic Analysis of Linguistic Complexity and Sophistication in Spontaneous L2 Speechcited by 1
- 2021Prediction of Listener Perception of Argumentative Speech in a Crowdsourced Dataset Using (Psycho-)Linguistic and Fluency Featurescited by 1
- 2025Dynamic Acoustic Model Architecture Optimization in Training for ASRcited by 1
- 2023Hybrid ASR for Resource-Constrained Robots: HMM - Deep Learning Fusioncited by 0
- 2026Do we really need Self-Attention for Streaming Automatic Speech Recognition?cited by 0
- 2026SENS-ASR: Semantic Embedding injection in Neural-transducer for Streaming Automatic Speech Recognitioncited by 0
- 2026SENS-ASR: Semantic Embedding injection in Neural-transducer for Streaming Automatic Speech Recognition17 Feb 2026
- 2026Do we really need Self-Attention for Streaming Automatic Speech Recognition?27 Jan 2026
- 2025Dynamic Acoustic Model Architecture Optimization in Training for ASR16 Jun 2025
- 2024Dynamic Encoder Size Based on Data-Driven Layer-wise Pruning for Speech Recognition10 Jul 2024
- 2024AG-LSEC: Audio Grounded Lexical Speaker Error Correction25 Jun 2024
- 2023Hybrid ASR for Resource-Constrained Robots: HMM - Deep Learning Fusion11 Sep 2023
- 2023Lexical Speaker Error Correction: Leveraging Language Models for Speaker Diarization Error Correction15 Jun 2023
- 2023End-to-End Speech Recognition: A Survey3 Mar 2023
- 2022Improving the Training Recipe for a Robust Conformer-based Hybrid Model26 Jun 2022
- 2022Efficient Training of Neural Transducer for Speech Recognition22 Apr 2022
- 2022Listen, Adapt, Better WER: Source-free Single-utterance Test-time Adaptation for Automatic Speech Recognition27 Mar 2022
- 2021Prediction of Listener Perception of Argumentative Speech in a Crowdsourced Dataset Using (Psycho-)Linguistic and Fluency Features13 Nov 2021
7 more
- 2021Conformer-based Hybrid ASR System for Switchboard Dataset5 Nov 2021
- 2021Acoustic Data-Driven Subword Modeling for End-to-End Speech Recognition19 Apr 2021
- 2021The Impact of ASR on the Automatic Analysis of Linguistic Complexity and Sophistication in Spontaneous L2 Speech17 Apr 2021
- 2021On Architectures and Training for Raw Waveform Feature Extraction in ASR9 Apr 2021
- 2021SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Network5 Apr 2021
- 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training2 Apr 2021
- 2021Transformer Based Deliberation for Two-Pass Speech Recognition27 Jan 2021
- 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 148
- 2023End-to-End Speech Recognition: A Surveycited by 127
- 2021SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Networkcited by 83
- 2021Transformer Based Deliberation for Two-Pass Speech Recognitioncited by 29
- 2022Listen, Adapt, Better WER: Source-free Single-utterance Test-time Adaptation for Automatic Speech Recognitioncited by 19
- 2021Conformer-based Hybrid ASR System for Switchboard Datasetcited by 15
- 2022Efficient Training of Neural Transducer for Speech Recognitioncited by 14
- 2023Lexical Speaker Error Correction: Leveraging Language Models for Speaker Diarization Error Correctioncited by 14
- 2021Acoustic Data-Driven Subword Modeling for End-to-End Speech Recognitioncited by 11
- 2022Improving the Training Recipe for a Robust Conformer-based Hybrid Modelcited by 9
- 2021On Architectures and Training for Raw Waveform Feature Extraction in ASRcited by 8
- 2024Dynamic Encoder Size Based on Data-Driven Layer-wise Pruning for Speech Recognitioncited by 7
12 most cited of 19 All 19 (JSON)
- 2026SENS-ASR: Semantic Embedding injection in Neural-transducer for Streaming Automatic Speech Recognition17 Feb 2026
- 2026Do we really need Self-Attention for Streaming Automatic Speech Recognition?27 Jan 2026
- 2025Dynamic Acoustic Model Architecture Optimization in Training for ASR16 Jun 2025
- 2024Dynamic Encoder Size Based on Data-Driven Layer-wise Pruning for Speech Recognition10 Jul 2024
- 2024AG-LSEC: Audio Grounded Lexical Speaker Error Correction25 Jun 2024
- 2023Hybrid ASR for Resource-Constrained Robots: HMM - Deep Learning Fusion11 Sep 2023
- 2023Lexical Speaker Error Correction: Leveraging Language Models for Speaker Diarization Error Correction15 Jun 2023
- 2023End-to-End Speech Recognition: A Survey3 Mar 2023
- 2022Improving the Training Recipe for a Robust Conformer-based Hybrid Model26 Jun 2022
- 2022Efficient Training of Neural Transducer for Speech Recognition22 Apr 2022
- 2022Listen, Adapt, Better WER: Source-free Single-utterance Test-time Adaptation for Automatic Speech Recognition27 Mar 2022
- 2021Prediction of Listener Perception of Argumentative Speech in a Crowdsourced Dataset Using (Psycho-)Linguistic and Fluency Features13 Nov 2021
12 newest of 19 All 19 (JSON)