Unifying Global and Near-Context Biasing in a Single Trie Pass
Not on the map. Why?
Abstract (arXiv)
Despite the success of end-to-end automatic speech recognition (ASR) models, challenges persist in recognizing rare, out-of-vocabulary words - including named entities (NE) - and in adapting to new domains using only text data. This work presents a practical approach to address these challenges through an unexplored combination of an NE bias list and a word-level n-gram language model (LM). This solution balances simplicity and effectiveness, improving entities' recognition while maintaining or even enhancing overall ASR performance. We efficiently integrate this enriched biasing method into a transducer-based ASR system, enabling context adaptation with almost no computational overhead. We present our results on three datasets spanning four languages and compare them to state-of-the-art biasing strategies. We demonstrate that the proposed combination of keyword biasing and n-gram LM improves entity recognition by up to 32% relative and reduces overall WER by up to a 12% relative.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 20 Sep 2024.
Builds on
23 of 37 references.
References · 23
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2021Datasets: A Community Library for Natural Language Processingcited by 526
- 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
- 2018Deep context: end-to-end contextual speech recognitioncited by 136
- 2023End-to-End Speech Recognition: A Surveycited by 127
- 2017An analysis of incorporating an external language model into a sequence-to-sequence modelcited by 109
- 2020Contextual RNN-T For Open Domain ASRcited by 85
11 more
- 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 77
- 2020Deep Shallow Fusion for RNN-T Personalizationcited by 64
- 2021Earnings-21: A Practical Benchmark for ASR in the Wildcited by 60
- 2022Earnings-22: A Practical Benchmark for Accents in the Wildcited by 46
- 2022Pruned RNN-T for fast, memory-efficient ASR trainingcited by 46
- 2022Improving Contextual Recognition of Rare Words with an Alternate Spelling Prediction Modelcited by 17
- 2021Spell my name: keyword boosted speech recognitioncited by 10
- 2023Contextual Biasing with the Knuth-Morris-Pratt Matching Algorithmcited by 9
- 2022Improving Mandarin End-to-End Speech Recognition with Word N-gram Language Modelcited by 6
- 2023Implementing contextual biasing in GPU decoder for online ASRcited by 4
- 2023Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.