mlsanityData to 13 Oct 2026

Neural Speech Recognizer: Acoustic-to-Word LSTM Model for Large Vocabulary Speech Recognition

arXiv 1610.09975 ↗First posted 31 Oct 2016cs.CL cs.LG cs.NEcited by 33

Not on the map. Why?

Abstract (arXiv)

We present results that show it is possible to build a competitive, greatly simplified, large vocabulary continuous speech recognition system with whole words as acoustic units. We model the output vocabulary of about 100,000 words directly using deep bi-directional LSTM RNNs with CTC loss. The model is trained on 125,000 hours of semi-supervised acoustic training data, which enables us to alleviate the data sparsity problem for word models. We show that the CTC word models work very well as an end-to-end all-neural speech recognition model without the use of traditional context-dependent sub-word phone units that require a pronunciation lexicon, and without any language model removing the need to decode. We demonstrate that the CTC word models perform better than a strong, more complex, state-of-the-art baseline with sub-word units.

Key facts. Cited by 33 papers in the map (data through 13 Oct 2026). First posted on arXiv 31 Oct 2016.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 14; 2022: 9; 2023: 7; 2024: 3.

33 papers.

Sort:

By area:

  1. 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
  2. 2023End-to-End Speech Recognition: A Surveycited by 128
  3. 2021Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognitioncited by 37
  4. 2021Tied & Reduced RNN-T Decodercited by 35
  5. 2022MOPRD: A multidisciplinary open peer review datasetcited by 32
  6. 2021End-to-End Speech Recognition from Federated Acoustic Modelscited by 30
  7. 2022Wav2Seq: Pre-training Speech-to-Text Encoder-Decoder Models Using Pseudo Languagescited by 26
  8. 2021Google Neural Network Models for Edge Devices: Analyzing and Mitigating Machine Learning Inference Bottleneckscited by 23
  9. 2022Accelerating RNN-T Training and Inference Using CTC guidancecited by 17
  10. 2024Whistle: Data-Efficient Multilingual and Crosslingual Speech Recognition via Weakly Phonetic Supervisioncited by 17
  11. 2022Effectiveness of Mining Audio and Text Pairs from Public Data for Improving ASR Systems for Low-Resource Languagescited by 16
  12. 2021Transformer Language Models with LSTM-based Cross-utterance Information Representationcited by 15
21 more
  1. 2021Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classificationcited by 14
  2. 2021Hierarchical Conditional End-to-End ASR with CTC and Multi-Granular Subword Unitscited by 13
  3. 2021Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classificationcited by 11
  4. 2021Construction of a Large-scale Japanese ASR Corpus on TV Recordingscited by 8
  5. 2021Have best of both worlds: two-pass hybrid and E2E cascading framework for speech recognitioncited by 7
  6. 2023Exploring the Integration of Large Language Models into Automatic Speech Recognition Systems: An Empirical Studycited by 7
  7. 2022Match to Win: Analysing Sequences Lengths for Efficient Self-supervised Learning in Speech and Audiocited by 6
  8. 2022LiteLSTM Architecture for Deep Recurrent Neural Networkscited by 5
  9. 2023Transformers versus LSTMs for electronic tradingcited by 4
  10. 2021Raw Waveform Encoder with Multi-Scale Globally Attentive Locally Recurrent Networks for End-to-End Speech Recognitioncited by 2
  11. 2021Generalizing RNN-Transducer to Out-Domain Audio via Sparse Self-Attention Layerscited by 2
  12. 2021Speech recognition for air traffic control via feature learning and end-to-end trainingcited by 2
  13. 2022SoftCTC -- Semi-Supervised Learning for Text Recognition using Soft Pseudo-Labelscited by 2
  14. 2023Dual-Attention Neural Transducers for Efficient Wake Word Spotting in Speech Recognitioncited by 2
  15. 2022Improving Semi-supervised End-to-end Automatic Speech Recognition using CycleGAN and Inter-domain Lossescited by 1
  16. 2023LiteLSTM Architecture Based on Weights Sharing for Recurrent Neural Networkscited by 1
  17. 2024Foundations of Multisensory Artificial Intelligencecited by 1
  18. 2024Low-Resourced Speech Recognition for Iu Mien Language via Weakly-Supervised Phoneme-based Multilingual Pre-trainingcited by 1
  19. 2022BERT-LID: Leveraging BERT to Improve Spoken Language Identificationcited by 0
  20. 2023Building Accurate Low Latency ASR for Streaming Voice Searchcited by 0
  21. 2023Timestamped Embedding-Matching Acoustic-to-Word CTC ASRcited by 0