QuartzNet: Deep Automatic Speech Recognition with 1D Time-Channel Separable Convolutions
Not on the map. Why?
Abstract (arXiv)
We propose a new end-to-end neural acoustic model for automatic speech recognition. The model is composed of multiple blocks with residual connections between them. Each block consists of one or more modules with 1D time-channel separable convolutional layers, batch normalization, and ReLU layers. It is trained with CTC loss. The proposed network achieves near state-of-the-art accuracy on LibriSpeech and Wall Street Journal, while having fewer parameters than all competing models. We also demonstrate that this model can be effectively fine-tuned on new datasets.
Key facts. Cited by 93 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 23; 2023: 18; 2024: 10; 2025: 9; 2026: 6.
93 papers.
Sort:
By area:
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 98
- 2021Intermediate Loss Regularization for CTC-based Speech Recognitioncited by 95
- 2024An Embarrassingly Simple Approach for LLM with Strong ASR Capacitycited by 86
- 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 77
- 2021Relaxing the Conditional Independence Assumption of CTC-based ASR by Conditioning on Intermediate Predictionscited by 61
- 2022Squeezeformer: An Efficient Transformer for Automatic Speech Recognitioncited by 50
- 2021Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognitioncited by 42
- 2021Momentum Pseudo-Labeling for Semi-Supervised Speech Recognitioncited by 37
- 2022PriMock57: A Dataset Of Primary Care Mock Consultationscited by 30
- 2021A Comparative Study on Non-Autoregressive Modelings for Speech-to-Text Generationcited by 27
- 2023Adaptation of Whisper models to child speech recognitioncited by 25
38 more
- 2022FitHuBERT: Going Thinner and Deeper for Knowledge Distillation of Speech Self-Supervised Learningcited by 24
- 2023Audio-Visual Efficient Conformer for Robust Speech Recognitioncited by 22
- 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarioscited by 20
- 2021Integer-only Zero-shot Quantization for Efficient Speech Recognitioncited by 19
- 2021Pushing the Limits of Non-Autoregressive Speech Recognitioncited by 18
- 2023ACE-VC: Adaptive and Controllable Voice Conversion using Explicitly Disentangled Self-supervised Speech Representationscited by 15
- 2021Layer Pruning on Demand with Intermediate CTCcited by 13
- 2024The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancementcited by 12
- 2022ASR data augmentation in low-resource settings using cross-lingual multi-speaker TTS and cross-lingual voice conversioncited by 10
- 2022ConvRNN-T: Convolutional Augmented Recurrent Neural Network Transducers for Streaming Speech Recognitioncited by 8
- 2021TalkNet 2: Non-Autoregressive Depth-Wise Separable Convolutional Model for Speech Synthesis with Explicit Pitch and Duration Predictioncited by 7
- 2021Scribosermo: Fast Speech-to-Text models for German and other Languagescited by 7
- 20224D ASR: Joint modeling of CTC, Attention, Transducer, and Mask-Predict decoderscited by 7
- 2021Review of end-to-end speech synthesis technology based on deep learningcited by 6
- 2022Improving Mandarin Speech Recogntion with Block-augmented Transformercited by 6
- 2023Tailor: Altering Skip Connections for Resource-Efficient Inferencecited by 6
- 2024Two Sparse Matrices are Better than One: Sparsifying Neural Networks with Double Sparse Factorizationcited by 6
- 2021A Toolbox for Construction and Analysis of Speech Datasetscited by 5
- 2021On the Impact of Word Error Rate on Acoustic-Linguistic Speech Emotion Recognition: An Update for the Deep Learning Eracited by 5
- 2021SIGTYP 2021 Shared Task: Robust Spoken Language Identificationcited by 5
- 2022ECAPA-TDNN for Multi-speaker Text-to-speech Synthesiscited by 5
- 2022Generating gender-ambiguous voices for privacy-preserving speech recognitioncited by 5
- 2022Uconv-Conformer: High Reduction of Input Sequence Length for End-to-End Speech Recognitioncited by 5
- 2023On the Behavior of Intrusive and Non-intrusive Speech Enhancement Metrics in Predictive and Generative Settingscited by 5
- 2023SelfVC: Voice Conversion With Iterative Refinement using Self Transformationscited by 5
- 2024Revisiting ASR Error Correction with Specialized Modelscited by 5
- 2025BERSting at the Screams: A Benchmark for Distanced, Emotional and Shouted Speech Recognitioncited by 5
- 2022Improving CTC-based ASR Models with Gated Interlayer Collaborationcited by 4
- 2022A Compact End-to-End Model with Local and Global Context for Spoken Language Identificationcited by 4
- 2024Joint Beam Search Integrating CTC, Attention, and Transducer Decoderscited by 4
- 2025Real-Time Streamable Generative Speech Restoration with Flow Matchingcited by 4
- 2022MLP-ASR: Sequence-length agnostic all-MLP architectures for speech recognitioncited by 3
- 2023PATCorrect: Non-autoregressive Phoneme-augmented Transformer for ASR Error Correctioncited by 3
- 2024Towards Open-World Gesture Recognitioncited by 3
- 2021Error-driven Fixed-Budget ASR Personalization for Accented Speakerscited by 2
- 2021Dynamic Acoustic Unit Augmentation With BPE-Dropout for Low-Resource End-to-End Speech Recognitioncited by 2
- 2021Compressing 1D Time-Channel Separable Convolutions using Sparse Random Ternary Matricescited by 2
- 2022BEA-Base: A Benchmark for ASR of Spontaneous Hungariancited by 2
50 most cited of 93 All 93 (JSON)
- 2026I-Parakeet: Integer-Only Conformer ASR on Mobile NPU25 Sep 2026
- 2026DriftSE: Speech Enhancement with Generative Drifting10 Sep 2026
- 2026Building an ASR Solution for Training and Assessing Children's Reading30 Jun 2026
- 2026What Counts as an Error? Dual-Reference Benchmarking for Atypical ASR30 Jun 2026
- 2026InfoMamba: An Attention-Free Hybrid Mamba-Transformer Model8 Mar 2026
- 2026Do we really need Self-Attention for Streaming Automatic Speech Recognition?27 Jan 2026
- 2025Real-Time Streamable Generative Speech Restoration with Flow Matching22 Dec 2025
- 2025Dealing with the Hard Facts of Low-Resource African NLP23 Nov 2025
- 2025Scriboora: Rethinking Human Pose Forecasting19 Nov 2025
- 2025Open Automatic Speech Recognition Models for Classical and Modern Standard Arabic18 Jul 2025
- 2025Remote Rowhammer Attack using Adversarial Observations on Federated Learning Clients9 May 2025
- 2025BERSting at the Screams: A Benchmark for Distanced, Emotional and Shouted Speech Recognition30 Apr 2025
38 more
- 2025Speaker Retrieval in the Wild: Challenges, Effectiveness and Robustness26 Apr 2025
- 2025AutoMR: A Universal Time Series Motion Recognition Pipeline21 Feb 2025
- 2025Let SSMs be ConvNets: State-space Modeling with Optimal Tensor Contractions22 Jan 2025
- 2024Two Sparse Matrices are Better than One: Sparsifying Neural Networks with Double Sparse Factorization27 Sep 2024
- 2024Query-by-Example Keyword Spotting Using Spectral-Temporal Graph Attentive Pooling and Multi-Task Learning27 Aug 2024
- 2024TrIM, Triangular Input Movement Systolic Array for Convolutional Neural Networks: Architecture and Hardware Implementation5 Aug 2024
- 2024Framework for Curating Speech Datasets and Evaluating ASR Systems: A Case Study for Polish18 Jul 2024
- 2024Sparse Binarization for Fast Keyword Spotting9 Jun 2024
- 2024The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancement5 Jun 2024
- 2024Joint Beam Search Integrating CTC, Attention, and Transducer Decoders5 Jun 2024
- 2024Revisiting ASR Error Correction with Specialized Models24 May 2024
- 2024An Embarrassingly Simple Approach for LLM with Strong ASR Capacity13 Feb 2024
- 2024Towards Open-World Gesture Recognition20 Jan 2024
- 2023Data Center Audio/Video Intelligence on Device (DAVID) -- An Edge-AI Platform for Smart-Toys18 Nov 2023
- 2023A comparative analysis between Conformer-Transducer, Whisper, and wav2vec2 for improving the child speech recognition7 Nov 2023
- 2023Zipformer: A faster and better encoder for automatic speech recognition17 Oct 2023
- 2023SelfVC: Voice Conversion With Iterative Refinement using Self Transformations14 Oct 2023
- 2023Wiki-En-ASR-Adapt: Large-scale synthetic dataset for English ASR Customization29 Sep 2023
- 2023Enhancing Quantised End-to-End ASR Models via Personalisation17 Sep 2023
- 2023ApproBiVT: Lead ASR Models to Generalize Better Using Approximated Bias-Variance Tradeoff Guided Early Stopping and Checkpoint Averaging5 Aug 2023
- 2023Adaptation of Whisper models to child speech recognition24 Jul 2023
- 2023The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarios23 Jun 2023
- 2023Evaluation of Speech Representations for MOS prediction16 Jun 2023
- 2023On the Behavior of Intrusive and Non-intrusive Speech Enhancement Metrics in Predictive and Generative Settings5 Jun 2023
- 2023InterFormer: Interactive Local and Global Features Fusion for Automatic Speech Recognition24 May 2023
- 2023Partially Adaptive Multichannel Joint Reduction of Ego-noise and Environmental Noise27 Mar 2023
- 2023Emphasizing Unseen Words: New Vocabulary Acquisition for End-to-End Speech Recognition20 Feb 2023
- 2023ACE-VC: Adaptive and Controllable Voice Conversion using Explicitly Disentangled Self-supervised Speech Representations16 Feb 2023
- 2023PATCorrect: Non-autoregressive Phoneme-augmented Transformer for ASR Error Correction10 Feb 2023
- 2023Tailor: Altering Skip Connections for Resource-Efficient Inference18 Jan 2023
- 2023Audio-Visual Efficient Conformer for Robust Speech Recognition4 Jan 2023
- 20224D ASR: Joint modeling of CTC, Attention, Transducer, and Mask-Predict decoders21 Dec 2022
- 2022InterMPL: Momentum Pseudo-Labeling with Intermediate CTC Loss2 Nov 2022
- 2022A Compact End-to-End Model with Local and Global Context for Spoken Language Identification27 Oct 2022
- 2022Automatic Speech Recognition of Low-Resource Languages Based on Chukchi11 Oct 2022
- 2022A Comparison of Transformer, Convolutional, and Recurrent Neural Networks on Phoneme Recognition1 Oct 2022
- 2022ConvRNN-T: Convolutional Augmented Recurrent Neural Network Transducers for Streaming Speech Recognition29 Sep 2022
- 2022Attention Enhanced Citrinet for Speech Recognition1 Sep 2022
50 newest of 93 All 93 (JSON)
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 98
- 2021Intermediate Loss Regularization for CTC-based Speech Recognitioncited by 95
- 2024An Embarrassingly Simple Approach for LLM with Strong ASR Capacitycited by 86
- 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 77
- 2021Relaxing the Conditional Independence Assumption of CTC-based ASR by Conditioning on Intermediate Predictionscited by 61
- 2022Squeezeformer: An Efficient Transformer for Automatic Speech Recognitioncited by 50
- 2021Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognitioncited by 42
- 2021Momentum Pseudo-Labeling for Semi-Supervised Speech Recognitioncited by 37
- 2022PriMock57: A Dataset Of Primary Care Mock Consultationscited by 30
- 2021A Comparative Study on Non-Autoregressive Modelings for Speech-to-Text Generationcited by 27
- 2023Adaptation of Whisper models to child speech recognitioncited by 25
12 most cited of 91 All 91 (JSON)
- 2026I-Parakeet: Integer-Only Conformer ASR on Mobile NPU25 Sep 2026
- 2026DriftSE: Speech Enhancement with Generative Drifting10 Sep 2026
- 2026Building an ASR Solution for Training and Assessing Children's Reading30 Jun 2026
- 2026What Counts as an Error? Dual-Reference Benchmarking for Atypical ASR30 Jun 2026
- 2026Do we really need Self-Attention for Streaming Automatic Speech Recognition?27 Jan 2026
- 2025Dealing with the Hard Facts of Low-Resource African NLP23 Nov 2025
- 2025Scriboora: Rethinking Human Pose Forecasting19 Nov 2025
- 2025Open Automatic Speech Recognition Models for Classical and Modern Standard Arabic18 Jul 2025
- 2025Remote Rowhammer Attack using Adversarial Observations on Federated Learning Clients9 May 2025
- 2025BERSting at the Screams: A Benchmark for Distanced, Emotional and Shouted Speech Recognition30 Apr 2025
- 2025Speaker Retrieval in the Wild: Challenges, Effectiveness and Robustness26 Apr 2025
- 2025AutoMR: A Universal Time Series Motion Recognition Pipeline21 Feb 2025
12 newest of 91 All 91 (JSON)