Espresso: A Fast End-to-end Neural Speech Recognition Toolkit
Not on the map. Why?
Abstract (arXiv)
We present Espresso, an open-source, modular, extensible end-to-end neural automatic speech recognition (ASR) toolkit based on the deep learning library PyTorch and the popular neural machine translation toolkit fairseq. Espresso supports distributed training across GPUs and computing nodes, and features various decoding approaches commonly employed in ASR, including look-ahead word-based language model fusion, for which a fast, parallelized decoder is implemented. Espresso achieves state-of-the-art ASR performance on the WSJ, LibriSpeech, and Switchboard data sets among other end-to-end systems without data augmentation, and is 4--11x faster for decoding than similar systems (e.g. ESPnet).
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 9; 2023: 4; 2024: 3.
31 papers.
Sort:
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 406
- 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 140
- 2023End-to-End Speech Recognition: A Surveycited by 129
- 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durationscited by 58
- 2021Wav2vec-Switch: Contrastive Learning from Original-noisy Speech Pairs for Robust Speech Recognitioncited by 16
- 2021Semantic-WER: A Unified Metric for the Evaluation of ASR Transcript for End Usabilitycited by 14
- 2021Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstructioncited by 13
- 2021Sequential Randomized Smoothing for Adversarially Robust Speech Recognitioncited by 13
- 2022Multi-blank Transducers for Speech Recognitioncited by 11
- 2021End2End Acoustic to Semantic Transductioncited by 10
- 2021Wake Word Detection with Streaming Transformerscited by 10
- 2024Label-Looping: Highly Efficient Decoding for Transducerscited by 9
19 more
- 2021Multi-Channel Multi-Speaker ASR Using 3D Spatial Featurecited by 7
- 2021Multi-Encoder Learning and Stream Fusion for Transformer-Based End-to-End Automatic Speech Recognitioncited by 6
- 2021Comparing CTC and LFMMI for out-of-domain adaptation of wav2vec 2.0 acoustic modelcited by 6
- 2022Improving Low-Resource Speech Recognition with Pretrained Speech Models: Continued Pretraining vs. Semi-Supervised Trainingcited by 6
- 2022Insights on Neural Representations for End-to-End Speech Recognitioncited by 5
- 2022Relaxed Attention for Transformer Modelscited by 5
- 2022Training Integer-Only Deep Recurrent Neural Networkscited by 5
- 2021Relaxed Attention: A Simple Method to Boost Performance of End-to-End Automatic Speech Recognitioncited by 4
- 2021Overcoming Domain Mismatch in Low Resource Sequence-to-Sequence ASR Models using Hybrid Generated Pseudotranscriptscited by 3
- 2021iRNN: Integer-only Recurrent Neural Networkcited by 3
- 2023Quran Recitation Recognition using End-to-End Deep Learningcited by 3
- 2021Deformable TDNN with adaptive receptive fields for speech recognitioncited by 2
- 2022BEA-Base: A Benchmark for ASR of Spontaneous Hungariancited by 2
- 2022Effectiveness of Text, Acoustic, and Lattice-based representations in Spoken Language Understanding taskscited by 2
- 2022Probing Statistical Representations For End-To-End ASRcited by 1
- 2022EFI: A Toolbox for Feature Importance Fusion and Interpretation in Pythoncited by 0
- 2023RIR-SF: Room Impulse Response Based Spatial Feature for Target Speech Recognition in Multi-Channel Multi-Speaker Scenarioscited by 0
- 2024Transducers with Pronunciation-aware Embeddings for Automatic Speech Recognitioncited by 0
- 2024Improving Autoregressive Training with Dynamic Oraclescited by 0
- 2024Improving Autoregressive Training with Dynamic Oracles13 Jun 2024
- 2024Label-Looping: Highly Efficient Decoding for Transducers10 Jun 2024
- 2024Transducers with Pronunciation-aware Embeddings for Automatic Speech Recognition4 Apr 2024
- 2023RIR-SF: Room Impulse Response Based Spatial Feature for Target Speech Recognition in Multi-Channel Multi-Speaker Scenarios31 Oct 2023
- 2023Quran Recitation Recognition using End-to-End Deep Learning10 May 2023
- 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durations13 Apr 2023
- 2023End-to-End Speech Recognition: A Survey3 Mar 2023
- 2022Training Integer-Only Deep Recurrent Neural Networks22 Dec 2022
- 2022Effectiveness of Text, Acoustic, and Lattice-based representations in Spoken Language Understanding tasks16 Dec 2022
- 2022Multi-blank Transducers for Speech Recognition4 Nov 2022
- 2022Probing Statistical Representations For End-To-End ASR3 Nov 2022
- 2022Relaxed Attention for Transformer Models20 Sep 2022
19 more
- 2022EFI: A Toolbox for Feature Importance Fusion and Interpretation in Python8 Aug 2022
- 2022Improving Low-Resource Speech Recognition with Pretrained Speech Models: Continued Pretraining vs. Semi-Supervised Training1 Jul 2022
- 2022Insights on Neural Representations for End-to-End Speech Recognition19 May 2022
- 2022BEA-Base: A Benchmark for ASR of Spontaneous Hungarian1 Feb 2022
- 2021Multi-Channel Multi-Speaker ASR Using 3D Spatial Feature22 Nov 2021
- 2021Sequential Randomized Smoothing for Adversarially Robust Speech Recognition5 Nov 2021
- 2021Recent Advances in End-to-End Automatic Speech Recognition2 Nov 2021
- 2021Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction28 Oct 2021
- 2021Wav2vec-Switch: Contrastive Learning from Original-noisy Speech Pairs for Robust Speech Recognition11 Oct 2021
- 2021iRNN: Integer-only Recurrent Neural Network20 Sep 2021
- 2021Relaxed Attention: A Simple Method to Boost Performance of End-to-End Automatic Speech Recognition2 Jul 2021
- 2021Overcoming Domain Mismatch in Low Resource Sequence-to-Sequence ASR Models using Hybrid Generated Pseudotranscripts14 Jun 2021
- 2021SpeechBrain: A General-Purpose Speech Toolkit8 Jun 2021
- 2021Semantic-WER: A Unified Metric for the Evaluation of ASR Transcript for End Usability3 Jun 2021
- 2021Deformable TDNN with adaptive receptive fields for speech recognition30 Apr 2021
- 2021Comparing CTC and LFMMI for out-of-domain adaptation of wav2vec 2.0 acoustic model6 Apr 2021
- 2021Multi-Encoder Learning and Stream Fusion for Transformer-Based End-to-End Automatic Speech Recognition31 Mar 2021
- 2021Wake Word Detection with Streaming Transformers8 Feb 2021
- 2021End2End Acoustic to Semantic Transduction1 Feb 2021
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 406
- 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 140
- 2023End-to-End Speech Recognition: A Surveycited by 129
- 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durationscited by 58
- 2021Wav2vec-Switch: Contrastive Learning from Original-noisy Speech Pairs for Robust Speech Recognitioncited by 16
- 2021Semantic-WER: A Unified Metric for the Evaluation of ASR Transcript for End Usabilitycited by 14
- 2021Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstructioncited by 13
- 2021Sequential Randomized Smoothing for Adversarially Robust Speech Recognitioncited by 13
- 2022Multi-blank Transducers for Speech Recognitioncited by 11
- 2021End2End Acoustic to Semantic Transductioncited by 10
- 2021Wake Word Detection with Streaming Transformerscited by 10
- 2024Label-Looping: Highly Efficient Decoding for Transducerscited by 9
12 most cited of 31 All 31 (JSON)
- 2024Improving Autoregressive Training with Dynamic Oracles13 Jun 2024
- 2024Label-Looping: Highly Efficient Decoding for Transducers10 Jun 2024
- 2024Transducers with Pronunciation-aware Embeddings for Automatic Speech Recognition4 Apr 2024
- 2023RIR-SF: Room Impulse Response Based Spatial Feature for Target Speech Recognition in Multi-Channel Multi-Speaker Scenarios31 Oct 2023
- 2023Quran Recitation Recognition using End-to-End Deep Learning10 May 2023
- 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durations13 Apr 2023
- 2023End-to-End Speech Recognition: A Survey3 Mar 2023
- 2022Training Integer-Only Deep Recurrent Neural Networks22 Dec 2022
- 2022Effectiveness of Text, Acoustic, and Lattice-based representations in Spoken Language Understanding tasks16 Dec 2022
- 2022Multi-blank Transducers for Speech Recognition4 Nov 2022
- 2022Probing Statistical Representations For End-To-End ASR3 Nov 2022
- 2022Relaxed Attention for Transformer Models20 Sep 2022
12 newest of 31 All 31 (JSON)