Jasper: An End-to-End Convolutional Neural Acoustic Model
Not on the map. Why?
Abstract (arXiv)
In this paper, we report state-of-the-art results on LibriSpeech among end-to-end speech recognition models without any external training data. Our model, Jasper, uses only 1D convolutions, batch normalization, ReLU, dropout, and residual connections. To improve training, we further introduce a new layer-wise optimizer called NovoGrad. Through experiments, we demonstrate that the proposed deep architecture performs as well or better than more complex choices. Our deepest Jasper variant uses 54 convolutional layers. With this architecture, we achieve 2.95% WER using a beam-search decoder with an external neural language model and 3.86% WER with a greedy decoder on LibriSpeech test-clean. We also report competitive results on the Wall Street Journal and the Hub5'00 conversational evaluation datasets.
Key facts. Cited by 75 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 31; 2022: 13; 2023: 17; 2024: 8; 2025: 4; 2026: 2.
75 papers.
Sort:
By area:
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 167
- 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understandingcited by 90
- 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 90
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 77
- 2021VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversioncited by 63
- 2022Squeezeformer: An Efficient Transformer for Automatic Speech Recognitioncited by 50
- 2021One TTS Alignment To Rule Them Allcited by 47
- 2021Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognitioncited by 42
- 2021Missing Value Imputation on Multidimensional Time Seriescited by 33
- 2021End-to-End Video-To-Speech Synthesis using Generative Adversarial Networkscited by 27
38 more
- 2022FitHuBERT: Going Thinner and Deeper for Knowledge Distillation of Speech Self-Supervised Learningcited by 24
- 2023Audio-Visual Efficient Conformer for Robust Speech Recognitioncited by 22
- 2022A Survey of Multilingual Models for Automatic Speech Recognitioncited by 21
- 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarioscited by 20
- 2021Integer-only Zero-shot Quantization for Efficient Speech Recognitioncited by 19
- 2021Pushing the Limits of Non-Autoregressive Speech Recognitioncited by 18
- 2023A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Taskscited by 13
- 2021FSR: Accelerating the Inference Process of Transducer-Based Models by Applying Fast-Skip Regularizationcited by 11
- 2021High Fidelity Speech Regeneration with Application to Speech Enhancementcited by 10
- 2021LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Readingcited by 10
- 2022ConvRNN-T: Convolutional Augmented Recurrent Neural Network Transducers for Streaming Speech Recognitioncited by 8
- 2024UNIT-DSR: Dysarthric Speech Reconstruction System Using Speech Unit Normalizationcited by 8
- 2021Improving speech recognition models with small samples for air traffic control systemscited by 6
- 2021ATCSpeechNet: A multilingual end-to-end speech recognition framework for air traffic control systemscited by 6
- 2022Easter2.0: Improving convolutional models for handwritten text recognitioncited by 6
- 2023Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Modelcited by 6
- 2021A Toolbox for Construction and Analysis of Speech Datasetscited by 5
- 2021Real World Robustness from Systematic Noisecited by 5
- 2022Generating gender-ambiguous voices for privacy-preserving speech recognitioncited by 5
- 2022Uconv-Conformer: High Reduction of Input Sequence Length for End-to-End Speech Recognitioncited by 5
- 2021Advancing CTC-CRF Based End-to-End Speech Recognition with Wordpieces and Conformerscited by 4
- 2022Speaker Identity Preservation in Dysarthric Speech Reconstruction by Adversarial Speaker Adaptationcited by 4
- 2021Do End-to-End Speech Recognition Models Care About Context?cited by 3
- 2021Dialectal Speech Recognition and Translation of Swiss German Speech to Standard German Text: Microsoft's Submission to SwissText 2021cited by 3
- 2021Discovery of Single Independent Latent Variablecited by 3
- 2022MLP-ASR: Sequence-length agnostic all-MLP architectures for speech recognitioncited by 3
- 2023PATCorrect: Non-autoregressive Phoneme-augmented Transformer for ASR Error Correctioncited by 3
- 2023Bring the Noise: Introducing Noise Robustness to Pretrained Automatic Speech Recognitioncited by 3
- 2021Error-driven Fixed-Budget ASR Personalization for Accented Speakerscited by 2
- 2021Compressing 1D Time-Channel Separable Convolutions using Sparse Random Ternary Matricescited by 2
- 2021Deformable TDNN with adaptive receptive fields for speech recognitioncited by 2
- 2021Speech recognition for air traffic control via feature learning and end-to-end trainingcited by 2
- 2022Adaptive Sparse and Monotonic Attention for Transformer-based Automatic Speech Recognitioncited by 2
- 2024Non-autoregressive real-time Accent Conversion model with voice cloningcited by 2
- 2024OneEncoder: A Lightweight Framework for Progressive Alignment of Modalitiescited by 2
- 2024Training Large ASR Encoders with Differential Privacycited by 2
- 2025Whispering Under the Eaves: Protecting User Privacy Against Commercial and LLM-powered Automatic Speech Recognition Systemscited by 2
- 2021Efficient and Generic 1D Dilated Convolution Layer for Deep Learningcited by 1
50 most cited of 75 All 75 (JSON)
- 2026End-to-End Intracortical Speech Decoding from Neural Activity23 May 2026
- 2026WhisperPipe: A Resource-Efficient Streaming Architecture for Real-Time Automatic Speech Recognition28 Apr 2026
- 2025Unifying Streaming and Non-streaming Zipformer-based ASR17 Jun 2025
- 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges15 May 2025
- 2025Whispering Under the Eaves: Protecting User Privacy Against Commercial and LLM-powered Automatic Speech Recognition Systems1 Apr 2025
- 2025Enhancing Aviation Communication Transcription: Fine-Tuning Distil-Whisper with LoRA13 Mar 2025
- 2024Continual Learning in Machine Speech Chain Using Gradient Episodic Memory27 Nov 2024
- 2024Learning state and proposal dynamics in state-space models using differentiable particle filters and neural networks23 Nov 2024
- 2024Acoustic Model Optimization over Multiple Data Sources: Merging and Valuation21 Oct 2024
- 2024Training Large ASR Encoders with Differential Privacy21 Sep 2024
- 2024OneEncoder: A Lightweight Framework for Progressive Alignment of Modalities17 Sep 2024
- 2024Query-by-Example Keyword Spotting Using Spectral-Temporal Graph Attentive Pooling and Multi-Task Learning27 Aug 2024
38 more
- 2024Non-autoregressive real-time Accent Conversion model with voice cloning21 May 2024
- 2024UNIT-DSR: Dysarthric Speech Reconstruction System Using Speech Unit Normalization26 Jan 2024
- 2023Data Center Audio/Video Intelligence on Device (DAVID) -- An Edge-AI Platform for Smart-Toys18 Nov 2023
- 2023Zipformer: A faster and better encoder for automatic speech recognition17 Oct 2023
- 2023Bring the Noise: Introducing Noise Robustness to Pretrained Automatic Speech Recognition5 Sep 2023
- 2023ApproBiVT: Lead ASR Models to Generalize Better Using Approximated Bias-Variance Tradeoff Guided Early Stopping and Checkpoint Averaging5 Aug 2023
- 2023N-gram Boosting: Improving Contextual Biasing with Normalized N-gram Targets4 Aug 2023
- 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarios23 Jun 2023
- 2023Mitigating Communication Costs in Neural Networks: The Role of Dendritic Nonlinearity21 Jun 2023
- 2023Creating Personalized Synthetic Voices from Post-Glossectomy Speech with Guided Diffusion Models27 May 2023
- 2023Hystoc: Obtaining word confidences for fusion of end-to-end ASR systems21 May 2023
- 2023A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Tasks18 May 2023
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?21 Mar 2023
- 2023Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Model27 Feb 2023
- 2023Emphasizing Unseen Words: New Vocabulary Acquisition for End-to-End Speech Recognition20 Feb 2023
- 2023PATCorrect: Non-autoregressive Phoneme-augmented Transformer for ASR Error Correction10 Feb 2023
- 2023Open Problems in Applied Deep Learning26 Jan 2023
- 2023BayesSpeech: A Bayesian Transformer Network for Automatic Speech Recognition16 Jan 2023
- 2023Audio-Visual Efficient Conformer for Robust Speech Recognition4 Jan 2023
- 2022E-Branchformer: Branchformer with Enhanced merging for speech recognition30 Sep 2022
- 2022Adaptive Sparse and Monotonic Attention for Transformer-based Automatic Speech Recognition30 Sep 2022
- 2022ConvRNN-T: Convolutional Augmented Recurrent Neural Network Transducers for Streaming Speech Recognition29 Sep 2022
- 2022Attention Enhanced Citrinet for Speech Recognition1 Sep 2022
- 2022Uconv-Conformer: High Reduction of Input Sequence Length for End-to-End Speech Recognition16 Aug 2022
- 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understanding6 Jul 2022
- 2022Generating gender-ambiguous voices for privacy-preserving speech recognition3 Jul 2022
- 2022FitHuBERT: Going Thinner and Deeper for Knowledge Distillation of Speech Self-Supervised Learning1 Jul 2022
- 2022Squeezeformer: An Efficient Transformer for Automatic Speech Recognition2 Jun 2022
- 2022Easter2.0: Improving convolutional models for handwritten text recognition30 May 2022
- 2022A Survey of Multilingual Models for Automatic Speech Recognition25 Feb 2022
- 2022Speaker Identity Preservation in Dysarthric Speech Reconstruction by Adversarial Speaker Adaptation18 Feb 2022
- 2022MLP-ASR: Sequence-length agnostic all-MLP architectures for speech recognition17 Feb 2022
- 2021Load-balanced Gather-scatter Patterns for Sparse Deep Neural Networks20 Dec 2021
- 2021LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Reading9 Dec 2021
- 2021Analysis of Data Augmentation Methods for Low-Resource Maltese ASR15 Nov 2021
- 2021Oracle Teacher: Leveraging Target Information for Better Knowledge Distillation of CTC Models5 Nov 2021
- 2021Speech recognition for air traffic control via feature learning and end-to-end training4 Nov 2021
- 2021Discovery of Single Independent Latent Variable12 Oct 2021
50 newest of 75 All 75 (JSON)
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understandingcited by 90
- 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 90
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 77
- 2021VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversioncited by 63
- 2022Squeezeformer: An Efficient Transformer for Automatic Speech Recognitioncited by 50
- 2021One TTS Alignment To Rule Them Allcited by 47
- 2021Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognitioncited by 42
- 2021Missing Value Imputation on Multidimensional Time Seriescited by 33
- 2021End-to-End Video-To-Speech Synthesis using Generative Adversarial Networkscited by 27
- 2022FitHuBERT: Going Thinner and Deeper for Knowledge Distillation of Speech Self-Supervised Learningcited by 24
12 most cited of 72 All 72 (JSON)
- 2026End-to-End Intracortical Speech Decoding from Neural Activity23 May 2026
- 2026WhisperPipe: A Resource-Efficient Streaming Architecture for Real-Time Automatic Speech Recognition28 Apr 2026
- 2025Unifying Streaming and Non-streaming Zipformer-based ASR17 Jun 2025
- 2025Whispering Under the Eaves: Protecting User Privacy Against Commercial and LLM-powered Automatic Speech Recognition Systems1 Apr 2025
- 2025Enhancing Aviation Communication Transcription: Fine-Tuning Distil-Whisper with LoRA13 Mar 2025
- 2024Continual Learning in Machine Speech Chain Using Gradient Episodic Memory27 Nov 2024
- 2024Learning state and proposal dynamics in state-space models using differentiable particle filters and neural networks23 Nov 2024
- 2024Acoustic Model Optimization over Multiple Data Sources: Merging and Valuation21 Oct 2024
- 2024Training Large ASR Encoders with Differential Privacy21 Sep 2024
- 2024OneEncoder: A Lightweight Framework for Progressive Alignment of Modalities17 Sep 2024
- 2024Query-by-Example Keyword Spotting Using Spectral-Temporal Graph Attentive Pooling and Multi-Task Learning27 Aug 2024
- 2024Non-autoregressive real-time Accent Conversion model with voice cloning21 May 2024
12 newest of 72 All 72 (JSON)