Fewer Hallucinations, More Verification: A Three-Stage LLM-Based Framework for ASR Error Correction
Not on the map. Why?
Abstract (arXiv)
Automatic Speech Recognition (ASR) error correction aims to correct recognition errors while preserving accurate text. Although traditional approaches demonstrate moderate effectiveness, LLMs offer a paradigm that eliminates the need for training and labeled data. However, directly using LLMs will encounter hallucinations problem, which may lead to the modification of the correct text. To address this problem, we propose the Reliable LLM Correction Framework (RLLM-CF), which consists of three stages: (1) error pre-detection, (2) chain-of-thought sub-tasks iterative correction, and (3) reasoning process verification. The advantage of our method is that it does not require additional information or fine-tuning of the model, and ensures the correctness of the LLM correction under multi-pass programming. Experiments on AISHELL-1, AISHELL-2, and Librispeech show that the GPT-4o model enhanced by our framework achieves 21%, 11%, 9%, and 11.4% relative reductions in CER/WER.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 26 of its 35 references that are in the map. First posted on arXiv 30 May 2025.
Builds on
26 of 35 references.
References · 26
- 2023GPT-4 Technical Reportcited by 18,396
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
- 2015Listen, Attend and Spellcited by 543
- 2024Hallucination of Multimodal Large Language Models: A Surveycited by 388
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 373
- 2021Generated Knowledge Prompting for Commonsense Reasoningcited by 214
- 2018AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scalecited by 128
- 2021WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkitcited by 125
- 2023Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Promptingcited by 72
14 more
- 2023Can Generative Large Language Models Perform ASR Error Correction?cited by 57
- 2020ASR Error Correction and Domain Adaptation Using Machine Translationcited by 48
- 2021FastCorrect: Fast Error Correction with Edit Alignment for Automatic Speech Recognitioncited by 43
- 2020Unified Streaming and Non-streaming Two-pass End-to-end Model for Speech Recognitioncited by 39
- 2020N-LTP: An Open-source Neural Language Technology Platform for Chinesecited by 29
- 2021U2++: Unified Two-pass Bidirectional End-to-end Model for Speech Recognitioncited by 29
- 2021FastCorrect 2: Fast Error Correction on Multiple Candidates for Automatic Speech Recognitioncited by 27
- 2022Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Modelscited by 26
- 2024ASR Error Correction using Large Language Modelscited by 24
- 2018Learning from Past Mistakes: Improving Automatic Speech Recognition Output via Noisy-Clean Phrase Context Modelingcited by 10
- 2022Mask the Correct Tokens: An Embarrassingly Simple Approach for Error Correctioncited by 10
- 2022SoftCorrect: Error Correction with Soft Detection for Automatic Speech Recognitioncited by 9
- 2022A Survey on Open Information Extraction from Rule-based Model to Large Language Modelcited by 8
- 2023Exploring the Integration of Large Language Models into Automatic Speech Recognition Systems: An Empirical Studycited by 7
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025CantoASR: Prosody-Aware ASR-LALM Collaboration for Low-Resource Cantonesecited by 3
- 2026Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perceptioncited by 2
- 2026VoiceSHIELD-Small: Real-Time Malicious Speech Detection and Transcriptioncited by 2
- 2025Listening, Imagining & Refining: A Heuristic Optimized ASR Correction Framework with LLMscited by 1
- 2026From Text Metrics to Model Internals: A Study of Whisper ASR Hallucination Detectioncited by 1
- 2025Speech Recognition on TV Series with Video-guided Post-ASR Correctioncited by 0
- 2026Graph-Based Phonetic Error Correction of Noisy ASRcited by 0
- 2026From Text Metrics to Model Internals: A Study of Whisper ASR Hallucination Detection22 Jun 2026
- 2026Graph-Based Phonetic Error Correction of Noisy ASR29 Apr 2026
- 2026VoiceSHIELD-Small: Real-Time Malicious Speech Detection and Transcription8 Mar 2026
- 2026Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perception14 Jan 2026
- 2025CantoASR: Prosody-Aware ASR-LALM Collaboration for Low-Resource Cantonese6 Nov 2025
- 2025Listening, Imagining & Refining: A Heuristic Optimized ASR Correction Framework with LLMs18 Sep 2025
- 2025Speech Recognition on TV Series with Video-guided Post-ASR Correction8 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2023Multi-stage Large Language Model Correction for Speech Recognition
- 2024Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models
- 2025LLM-based Generative Error Correction for Rare Words with Synthetic Data and Phonetic Context
- 2026NIM4-ASR: Towards Efficient, Robust, and Customizable Real-Time LLM-Based ASR
- 2026Error-Aware TF-IDF Retrieval-Augmented Generation for ASR Error Correction
- 2024Large Language Models are Efficient Learners of Noise-Robust Speech Recognition
- 2025Interactive In-Meeting Speaker Correction with Human Feedback
- 2026Enhancing Multilingual LLM-based ASR with Mixture of Experts and Dynamic Downsampling