mlsanityData to 7 Oct 2026

ed-cec: improving rare word recognition using asr postprocessing based on error detection and context-aware error correction

arXiv 2310.05129 ↗First posted 8 Oct 2023cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Automatic speech recognition (ASR) systems often encounter difficulties in accurately recognizing rare words, leading to errors that can have a negative impact on downstream tasks such as keyword spotting, intent detection, and text summarization. To address this challenge, we present a novel ASR postprocessing method that focuses on improving the recognition of rare words through error detection and context-aware error correction. Our method optimizes the decoding process by targeting only the predicted error positions, minimizing unnecessary computations. Moreover, we leverage a rare word list to provide additional contextual knowledge, enabling the model to better correct rare words. Experimental results across five datasets demonstrate that our proposed method achieves significantly lower word error rates (WERs) than previous approaches while maintaining a reasonable inference speed. Furthermore, our approach exhibits promising robustness across different ASR systems.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 31 of its 38 references that are in the map. First posted on arXiv 8 Oct 2023.

Builds on

31 of 38 references.

References · 31

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  5. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  6. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
  7. 2015Listen, Attend and Spellcited by 542
  8. 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
  9. 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
  10. 2018Deep context: end-to-end contextual speech recognitioncited by 136
  11. 2021Contextualized Streaming End-to-End Speech Recognition with Trie-Based Deep Biasing and Shallow Fusioncited by 100
  12. 2020Pre-trained Summarization Distillationcited by 70
19 more
  1. 2020Deep Shallow Fusion for RNN-T Personalizationcited by 64
  2. 2022Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selectioncited by 39
  3. 2021Factorized Neural Transducer for Efficient Language Model Adaptationcited by 31
  4. 2021Instant One-Shot Word-Learning for Context-Specific Neural Sequence-to-Sequence Speech Recognitioncited by 30
  5. 2021Speech Summarization using Restricted Self-Attentioncited by 23
  6. 2021Phoneme-BERT: Joint Language Modelling of Phoneme Sequence and ASR Transcriptcited by 21
  7. 2019Learning ASR-Robust Contextualized Embeddings for Spoken Language Understandingcited by 20
  8. 2021BART based semantic correction for Mandarin automatic speech recognition systemcited by 20
  9. 2022Error Correction in ASR using Sequence-to-Sequence Modelscited by 19
  10. 2021On Language Model Integration for RNN Transducer based Speech Recognitioncited by 17
  11. 2022Towards Contextual Spelling Correction for Customization of End-to-end Speech Recognition Systemscited by 17
  12. 2022Tree-constrained Pointer Generator with Graph Neural Network Encodings for Contextual Speech Recognitioncited by 17
  13. 2019Audio De-identification: A New Entity Recognition Taskcited by 14
  14. 2021Remember the context! ASR slot error correction through memorizationcited by 9
  15. 2022Internal Language Model Estimation Through Explicit Context Vector Learning for Attention-based Encoder-decoder ASRcited by 9
  16. 2023JEIT: Joint End-to-End Model and Internal Language Model Training for Speech Recognitioncited by 9
  17. 2022ASR Error Correction with Constrained Decoding on Operation Predictioncited by 6
  18. 2022Named Entity Recognition for Audio De-Identificationcited by 4
  19. 2023PATCorrect: Non-autoregressive Phoneme-augmented Transformer for ASR Error Correctioncited by 3

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 5.

7 papers.