mlsanityData to 7 Oct 2026

End-to-end Continuous Speech Recognition using Attention-based Recurrent NN: First Results

arXiv 1412.1602 ↗First posted 4 Dec 2014cs.NE cs.LG stat.MLcited by 68

Not on the map. Why?

Abstract (arXiv)

We replace the Hidden Markov Model (HMM) which is traditionally used in in continuous speech recognition with a bi-directional recurrent neural network encoder coupled to a recurrent neural network decoder that directly emits a stream of phonemes. The alignment between the input and output sequences is established using an attention mechanism: the decoder emits each symbol based on a context created with a subset of input symbols elected by the attention mechanism. We report initial results demonstrating that this new approach achieves phoneme error rates that are comparable to the state-of-the-art HMM-based decoders, on the TIMIT dataset.

Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Dec 2014.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 25; 2022: 13; 2023: 11; 2024: 8; 2025: 11.

68 papers.

Sort:

  1. 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
  2. 2021WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkitcited by 123
  3. 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
  4. 2022WeNet 2.0: More Productive End-to-End Speech Recognition Toolkitcited by 46
  5. 2022Streaming Multi-Talker ASR with Token-Level Serialized Output Trainingcited by 37
  6. 2021Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphonecited by 33
  7. 2024A Survey of Deep Learning and Foundation Models for Time Series Forecastingcited by 32
  8. 2021U2++: Unified Two-pass Bidirectional End-to-end Model for Speech Recognitioncited by 28
  9. 2021Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNetcited by 27
  10. 2024Whistle: Data-Efficient Multilingual and Crosslingual Speech Recognition via Weakly Phonetic Supervisioncited by 17
  11. 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddingscited by 14
  12. 2023When Good and Reproducible Results are a Giant with Feet of Clay: The Importance of Software Quality in NLPcited by 14
38 more
  1. 2021OkwuGb'e: End-to-End Speech Recognition for Fon and Igbocited by 13
  2. 2021Where are we in semantic concept extraction for Spoken Language Understanding?cited by 11
  3. 2021Streaming End-to-End ASR based on Blockwise Non-Autoregressive Modelscited by 11
  4. 2021End2End Acoustic to Semantic Transductioncited by 10
  5. 2021WNARS: WFST based Non-autoregressive Streaming End-to-End Speech Recognitioncited by 10
  6. 2025CS-Dialogue: A 104-Hour Dataset of Spontaneous Mandarin-English Code-Switching Dialogues for Speech Recognitioncited by 10
  7. 2021A Method to Reveal Speaker Identity in Distributed ASR Training, and How to Counter Itcited by 8
  8. 2021Have best of both worlds: two-pass hybrid and E2E cascading framework for speech recognitioncited by 7
  9. 2024Serialized Speech Information Guidance with Overlapped Encoding Separation for Multi-Speaker Automatic Speech Recognitioncited by 7
  10. 2021A Comparative Study on Neural Architectures and Training Methods for Japanese Speech Recognitioncited by 6
  11. 2021Thank you for Attention: A survey on Attention-based Artificial Neural Networks for Automatic Speech Recognitioncited by 5
  12. 2022LiteLSTM Architecture for Deep Recurrent Neural Networkscited by 5
  13. 2022Expressing Multivariate Time Series as Graphs with Time Series Attention Transformercited by 5
  14. 2022On the Interpretability of Attention Networkscited by 5
  15. 2024Serialized Output Training by Learned Dominancecited by 5
  16. 2025Serialized Output Prompting for Large Language Model-based Multi-Talker Speech Recognitioncited by 5
  17. 2025Whisper Has an Internal Word Alignercited by 5
  18. 2021Weakly-supervised word-level pronunciation error detection in non-native English speechcited by 4
  19. 2021Advancing CTC-CRF Based End-to-End Speech Recognition with Wordpieces and Conformerscited by 4
  20. 2022Computer-assisted Pronunciation Training -- Speech synthesis is almost all you needcited by 4
  21. 2022Monotonic segmental attention for automatic speech recognitioncited by 4
  22. 2024Enhancing Efficiency in Vision Transformer Networks: Design Techniques and Insightscited by 4
  23. 2021Maneuver-Aware Pooling for Vehicle Trajectory Predictioncited by 3
  24. 2022Adversarial Attacks on Speech Recognition Systems for Mission-Critical Applications: A Surveycited by 3
  25. 2022Supervised Attention in Sequence-to-Sequence Models for Speech Recognitioncited by 3
  26. 2023IA-LSTM: Interaction-Aware LSTM for Pedestrian Trajectory Predictioncited by 3
  27. 2025Pronunciation-Lexicon Free Training for Phoneme-based Crosslingual ASR via Joint Stochastic Approximationcited by 3
  28. 2021Improving End-To-End Modeling for Mispronunciation Detection with Effective Augmentation Mechanismscited by 2
  29. 2023Masked Audio Text Encoders are Effective Multi-Modal Rescorerscited by 2
  30. 2023On the Learning Dynamics of Attention Networkscited by 2
  31. 2023A Quantitative Approach to Understand Self-Supervised Models as Cross-lingual Feature Extractorscited by 2
  32. 2023BLSTM-Based Confidence Estimation for End-to-End Speech Recognitioncited by 2
  33. 2021Maneuver-based Anchor Trajectory Hypotheses at Roundaboutscited by 1
  34. 2021Global Structure-Aware Drum Transcription Based on Self-Attention Mechanismscited by 1
  35. 2021Learning Complex Users' Preferences for Recommender Systemscited by 1
  36. 2022Pronunciation-aware unique character encoding for RNN Transducer-based Mandarin speech recognitioncited by 1
  37. 2022Improving Semi-supervised End-to-end Automatic Speech Recognition using CycleGAN and Inter-domain Lossescited by 1
  38. 2023LiteLSTM Architecture Based on Weights Sharing for Recurrent Neural Networkscited by 1

50 most cited of 68 All 68 (JSON)