ed-cec: improving rare word recognition using asr postprocessing based on error detection and context-aware error correction
Not on the map. Why?
Abstract (arXiv)
Automatic speech recognition (ASR) systems often encounter difficulties in accurately recognizing rare words, leading to errors that can have a negative impact on downstream tasks such as keyword spotting, intent detection, and text summarization. To address this challenge, we present a novel ASR postprocessing method that focuses on improving the recognition of rare words through error detection and context-aware error correction. Our method optimizes the decoding process by targeting only the predicted error positions, minimizing unnecessary computations. Moreover, we leverage a rare word list to provide additional contextual knowledge, enabling the model to better correct rare words. Experimental results across five datasets demonstrate that our proposed method achieves significantly lower word error rates (WERs) than previous approaches while maintaining a reasonable inference speed. Furthermore, our approach exhibits promising robustness across different ASR systems.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 31 of its 38 references that are in the map. First posted on arXiv 8 Oct 2023.
Builds on
31 of 38 references.
References · 31
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2015Listen, Attend and Spellcited by 542
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
- 2018Deep context: end-to-end contextual speech recognitioncited by 136
- 2021Contextualized Streaming End-to-End Speech Recognition with Trie-Based Deep Biasing and Shallow Fusioncited by 100
- 2020Pre-trained Summarization Distillationcited by 70
19 more
- 2020Deep Shallow Fusion for RNN-T Personalizationcited by 64
- 2022Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selectioncited by 39
- 2021Factorized Neural Transducer for Efficient Language Model Adaptationcited by 31
- 2021Instant One-Shot Word-Learning for Context-Specific Neural Sequence-to-Sequence Speech Recognitioncited by 30
- 2021Speech Summarization using Restricted Self-Attentioncited by 23
- 2021Phoneme-BERT: Joint Language Modelling of Phoneme Sequence and ASR Transcriptcited by 21
- 2019Learning ASR-Robust Contextualized Embeddings for Spoken Language Understandingcited by 20
- 2021BART based semantic correction for Mandarin automatic speech recognition systemcited by 20
- 2022Error Correction in ASR using Sequence-to-Sequence Modelscited by 19
- 2021On Language Model Integration for RNN Transducer based Speech Recognitioncited by 17
- 2022Towards Contextual Spelling Correction for Customization of End-to-end Speech Recognition Systemscited by 17
- 2022Tree-constrained Pointer Generator with Graph Neural Network Encodings for Contextual Speech Recognitioncited by 17
- 2019Audio De-identification: A New Entity Recognition Taskcited by 14
- 2021Remember the context! ASR slot error correction through memorizationcited by 9
- 2022Internal Language Model Estimation Through Explicit Context Vector Learning for Attention-based Encoder-decoder ASRcited by 9
- 2023JEIT: Joint End-to-End Model and Internal Language Model Training for Speech Recognitioncited by 9
- 2022ASR Error Correction with Constrained Decoding on Operation Predictioncited by 6
- 2022Named Entity Recognition for Audio De-Identificationcited by 4
- 2023PATCorrect: Non-autoregressive Phoneme-augmented Transformer for ASR Error Correctioncited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 5.
7 papers.
- 2024MF-AED-AEC: Speech Emotion Recognition by Leveraging Multimodal Fusion, Asr Error Detection, and Asr Error Correctioncited by 8
- 2025LLM-based Generative Error Correction for Rare Words with Synthetic Data and Phonetic Contextcited by 3
- 2024Recording for Eyes, Not Echoing to Ears: Contextualized Spoken-to-Written Conversion of ASR Transcriptscited by 2
- 2025PMF-CEC: Phoneme-augmented Multimodal Fusion for Context-aware ASR Error Correction with Error-specific Selective Decodingcited by 1
- 2025CMT-LLM: Contextual Multi-Talker ASR Utilizing Large Language Modelscited by 1
- 2025Understanding Zero-shot Rare Word Recognition Improvements Through LLM Integrationcited by 0
- 2025PARCO: Phoneme-Augmented Robust Contextual ASR via Contrastive Entity Disambiguationcited by 0
- 2025PARCO: Phoneme-Augmented Robust Contextual ASR via Contrastive Entity Disambiguation4 Sep 2025
- 2025CMT-LLM: Contextual Multi-Talker ASR Utilizing Large Language Models31 May 2025
- 2025PMF-CEC: Phoneme-augmented Multimodal Fusion for Context-aware ASR Error Correction with Error-specific Selective Decoding31 May 2025
- 2025LLM-based Generative Error Correction for Rare Words with Synthetic Data and Phonetic Context23 May 2025
- 2025Understanding Zero-shot Rare Word Recognition Improvements Through LLM Integration22 Feb 2025
- 2024Recording for Eyes, Not Echoing to Ears: Contextualized Spoken-to-Written Conversion of ASR Transcripts19 Aug 2024
- 2024MF-AED-AEC: Speech Emotion Recognition by Leveraging Multimodal Fusion, Asr Error Detection, and Asr Error Correction24 Jan 2024