Scaling Up Online Speech Recognition Using ConvNets
Not on the map. Why?
Abstract (arXiv)
We design an online end-to-end speech recognition system based on Time-Depth Separable (TDS) convolutions and Connectionist Temporal Classification (CTC). We improve the core TDS architecture in order to limit the future context and hence reduce latency while maintaining accuracy. The system has almost three times the throughput of a well tuned hybrid ASR baseline while also having lower latency and a better word error rate. Also important to the efficiency of the recognizer is our highly optimized beam search decoder. To show the impact of our design choices, we analyze throughput, latency, accuracy, and discuss how these metrics can be tuned based on the user requirements.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 3; 2023: 3; 2024: 2.
16 papers.
Sort:
- 2021Intermediate Loss Regularization for CTC-based Speech Recognitioncited by 95
- 2021PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognitioncited by 50
- 2021Smart at what cost? Characterising Mobile Deep Neural Networks in the wildcited by 25
- 2021Dissecting User-Perceived Latency of On-Device E2E Speech Recognitioncited by 18
- 2024emg2qwerty: A Large Dataset with Baselines for Touch Typing using Surface Electromyographycited by 17
- 2021Layer Pruning on Demand with Intermediate CTCcited by 13
- 2024Towards Online Continuous Sign Language Recognition and Translationcited by 13
- 2022Benchmarking of DL Libraries and Models on Mobile Devicescited by 12
- 2023Enabling Resource-efficient AIoT System with Cross-level Optimization: A surveycited by 8
- 2022NatiQ: An End-to-end Text-to-Speech System for Arabiccited by 7
- 2021Flexi-Transducer: Optimizing Latency, Accuracy and Compute forMulti-Domain On-Device Scenarioscited by 3
- 2023Application-Agnostic Language Modeling for On-Device ASRcited by 3
4 more
- 2023Align With Purpose: Optimize Desired Properties in CTC Models with a General Plug-and-Play Frameworkcited by 2
- 2021Audio Adversarial Examples: Attacks Using Vocal Maskscited by 0
- 2021Voice Quality and Pitch Features in Transformer-Based Speech Recognitioncited by 0
- 2022Mixture-of-Rookies: Saving DNN Computations by Predicting ReLU Outputscited by 0
- 2024emg2qwerty: A Large Dataset with Baselines for Touch Typing using Surface Electromyography26 Oct 2024
- 2024Towards Online Continuous Sign Language Recognition and Translation10 Jan 2024
- 2023Enabling Resource-efficient AIoT System with Cross-level Optimization: A survey27 Sep 2023
- 2023Align With Purpose: Optimize Desired Properties in CTC Models with a General Plug-and-Play Framework4 Jul 2023
- 2023Application-Agnostic Language Modeling for On-Device ASR16 May 2023
- 2022NatiQ: An End-to-end Text-to-Speech System for Arabic15 Jun 2022
- 2022Benchmarking of DL Libraries and Models on Mobile Devices14 Feb 2022
- 2022Mixture-of-Rookies: Saving DNN Computations by Predicting ReLU Outputs10 Feb 2022
- 2021Voice Quality and Pitch Features in Transformer-Based Speech Recognition21 Dec 2021
- 2021Smart at what cost? Characterising Mobile Deep Neural Networks in the wild28 Sep 2021
- 2021Layer Pruning on Demand with Intermediate CTC17 Jun 2021
- 2021PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognition10 Jun 2021
4 more
- 2021Flexi-Transducer: Optimizing Latency, Accuracy and Compute forMulti-Domain On-Device Scenarios6 Apr 2021
- 2021Dissecting User-Perceived Latency of On-Device E2E Speech Recognition6 Apr 2021
- 2021Intermediate Loss Regularization for CTC-based Speech Recognition5 Feb 2021
- 2021Audio Adversarial Examples: Attacks Using Vocal Masks4 Feb 2021
- 2021Intermediate Loss Regularization for CTC-based Speech Recognitioncited by 95
- 2021PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognitioncited by 50
- 2021Smart at what cost? Characterising Mobile Deep Neural Networks in the wildcited by 25
- 2021Dissecting User-Perceived Latency of On-Device E2E Speech Recognitioncited by 18
- 2024emg2qwerty: A Large Dataset with Baselines for Touch Typing using Surface Electromyographycited by 17
- 2021Layer Pruning on Demand with Intermediate CTCcited by 13
- 2024Towards Online Continuous Sign Language Recognition and Translationcited by 13
- 2022Benchmarking of DL Libraries and Models on Mobile Devicescited by 12
- 2023Enabling Resource-efficient AIoT System with Cross-level Optimization: A surveycited by 8
- 2022NatiQ: An End-to-end Text-to-Speech System for Arabiccited by 7
- 2021Flexi-Transducer: Optimizing Latency, Accuracy and Compute forMulti-Domain On-Device Scenarioscited by 3
- 2023Application-Agnostic Language Modeling for On-Device ASRcited by 3
12 most cited of 16 All 16 (JSON)
- 2024emg2qwerty: A Large Dataset with Baselines for Touch Typing using Surface Electromyography26 Oct 2024
- 2024Towards Online Continuous Sign Language Recognition and Translation10 Jan 2024
- 2023Enabling Resource-efficient AIoT System with Cross-level Optimization: A survey27 Sep 2023
- 2023Align With Purpose: Optimize Desired Properties in CTC Models with a General Plug-and-Play Framework4 Jul 2023
- 2023Application-Agnostic Language Modeling for On-Device ASR16 May 2023
- 2022NatiQ: An End-to-end Text-to-Speech System for Arabic15 Jun 2022
- 2022Benchmarking of DL Libraries and Models on Mobile Devices14 Feb 2022
- 2022Mixture-of-Rookies: Saving DNN Computations by Predicting ReLU Outputs10 Feb 2022
- 2021Voice Quality and Pitch Features in Transformer-Based Speech Recognition21 Dec 2021
- 2021Smart at what cost? Characterising Mobile Deep Neural Networks in the wild28 Sep 2021
- 2021Layer Pruning on Demand with Intermediate CTC17 Jun 2021
- 2021PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognition10 Jun 2021
12 newest of 16 All 16 (JSON)