Error-Aware TF-IDF Retrieval-Augmented Generation for ASR Error Correction
On the map: Retrieval-augmented generation → Conversational and speech RAG
Abstract (arXiv)
End-to-end automatic speech recognition systems frequently hallucinate rare entities and domain-specific terms, especially in low-resource languages. While retrieval-augmented generation frameworks can mitigate these errors using large language models, current architectures face significant challenges. They either rely on standard sparse retrieval that ignores phonetic misrecognitions or utilize heavyweight cross-modal embeddings that introduce high latency. This letter proposes a highly efficient, purely lexical error-aware framework designed to explicitly resolve phonetic and loop hallucinations. Our approach integrates a symmetric text normalization module with a novel error-aware term frequency-inverse document frequency algorithm. By constructing a sparse diagonal penalty matrix based on historical errors, the retriever mathematically prioritizes corrective documents containing specific high-risk misrecognitions. Evaluated on the Persian subset of the FLEURS dataset, our method increased the error-aware hit rate from 53.7% to 90.9%. In end-to-end evaluations, the integrated framework reduced the final word error rate from 23.06% to 18.83%, achieving significant accuracy gains with near-zero inference latency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Conversational and speech RAG, one of 15 directions in Retrieval-augmented generation. Builds on 12 of its 16 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
12 of 16 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
- 2023End-to-End Speech Recognition: A Surveycited by 127
- 2023Can Generative Large Language Models Perform ASR Error Correction?cited by 56
- 2023HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Modelscited by 41
- 2022Noise-robust Speech Recognition with 10 Minutes Unparalleled In-domain Datacited by 30
- 2024Retrieval Augmented Correction of Named Entity Speech Recognition Errorscited by 10
- 2025BR-ASR: Efficient and Scalable Bias Retrieval Framework for Contextual Biasing ASR in Speech LLMcited by 10
- 2024DANCER: Entity Description Augmented Named Entity Corrector for Automatic Speech Recognitioncited by 4
- 2024Optimizing Contextual Speech Recognition Using Vector Quantization for Efficient Retrievalcited by 3
- 2026MedSpeak: A Knowledge Graph-Aided ASR Error Correction Framework for Spoken Medical QAcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Failing Forward: Improving Generative Error Correction for ASR with Synthetic Data and Retrieval Augmentation
- 2026Retrieval-Augmented Self-Taught Reasoning Model with Adaptive Chain-of-Thought for ASR Named Entity Correction
- 2026Better Retrieval, Worse Robustness: How Multi-hop RAG Amplifies Upstream ASR Errors
- 2025DeRAGEC: Denoising Named Entity Candidates with Synthetic Rationale for ASR Error Correction
- 2025LLM-based Generative Error Correction for Rare Words with Synthetic Data and Phonetic Context
- 2025Fewer Hallucinations, More Verification: A Three-Stage LLM-Based Framework for ASR Error Correction
- 2024Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models
- 2026RECOVER: Robust Entity Correction via agentic Orchestration of hypothesis Variants for Evidence-based Recovery