mlsanityData to 7 Oct 2026

Unifying Global and Near-Context Biasing in a Single Trie Pass

arXiv 2409.13514 ↗First posted 20 Sep 2024cs.CL cs.SD eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

Despite the success of end-to-end automatic speech recognition (ASR) models, challenges persist in recognizing rare, out-of-vocabulary words - including named entities (NE) - and in adapting to new domains using only text data. This work presents a practical approach to address these challenges through an unexplored combination of an NE bias list and a word-level n-gram language model (LM). This solution balances simplicity and effectiveness, improving entities' recognition while maintaining or even enhancing overall ASR performance. We efficiently integrate this enriched biasing method into a transducer-based ASR system, enabling context adaptation with almost no computational overhead. We present our results on three datasets spanning four languages and compare them to state-of-the-art biasing strategies. We demonstrate that the proposed combination of keyword biasing and n-gram LM improves entity recognition by up to 32% relative and reduces overall WER by up to a 12% relative.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 20 Sep 2024.

Builds on

23 of 37 references.

References · 23

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  6. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  7. 2021Datasets: A Community Library for Natural Language Processingcited by 526
  8. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
  9. 2018Deep context: end-to-end contextual speech recognitioncited by 136
  10. 2023End-to-End Speech Recognition: A Surveycited by 127
  11. 2017An analysis of incorporating an external language model into a sequence-to-sequence modelcited by 109
  12. 2020Contextual RNN-T For Open Domain ASRcited by 85
11 more
  1. 2023Zipformer: A faster and better encoder for automatic speech recognitioncited by 77
  2. 2020Deep Shallow Fusion for RNN-T Personalizationcited by 64
  3. 2021Earnings-21: A Practical Benchmark for ASR in the Wildcited by 60
  4. 2022Earnings-22: A Practical Benchmark for Accents in the Wildcited by 46
  5. 2022Pruned RNN-T for fast, memory-efficient ASR trainingcited by 46
  6. 2022Improving Contextual Recognition of Rare Words with an Alternate Spelling Prediction Modelcited by 17
  7. 2021Spell my name: keyword boosted speech recognitioncited by 10
  8. 2023Contextual Biasing with the Knuth-Morris-Pratt Matching Algorithmcited by 9
  9. 2022Improving Mandarin End-to-End Speech Recognition with Word N-gram Language Modelcited by 6
  10. 2023Implementing contextual biasing in GPU decoder for online ASRcited by 4
  11. 2023Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.