mlsanityData to 7 Oct 2026

Post-decoder Biasing for End-to-End Speech Recognition of Multi-turn Medical Interview

arXiv 2403.00370 ↗First posted 1 Mar 2024cs.CL cs.SD eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

End-to-end (E2E) approach is gradually replacing hybrid models for automatic speech recognition (ASR) tasks. However, the optimization of E2E models lacks an intuitive method for handling decoding shifts, especially in scenarios with a large number of domain-specific rare words that hold specific important meanings. Furthermore, the absence of knowledge-intensive speech datasets in academia has been a significant limiting factor, and the commonly used speech corpora exhibit significant disparities with realistic conversation. To address these challenges, we present Medical Interview (MED-IT), a multi-turn consultation speech dataset that contains a substantial number of knowledge-intensive named entities. We also explore methods to enhance the recognition performance of rare words for E2E models. We propose a novel approach, post-decoder biasing, which constructs a transform probability matrix based on the distribution of training transcriptions. This guides the model to prioritize recognizing words in the biasing list. In our experiments, for subsets of rare words appearing in the training speech between 10 and 20 times, and between 1 and 5 times, the proposed method achieves a relative improvement of 9.3% and 5.1%, respectively.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 1 Mar 2024.

Builds on

22 of 40 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  3. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  4. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  5. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  6. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
  7. 2015Listen, Attend and Spellcited by 542
  8. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 391
  9. 2018Deep context: end-to-end contextual speech recognitioncited by 136
  10. 2017An analysis of incorporating an external language model into a sequence-to-sequence modelcited by 109
  11. 2021Contextualized Streaming End-to-End Speech Recognition with Trie-Based Deep Biasing and Shallow Fusioncited by 100
  12. 2019Knowledge-Enriched Transformer for Emotion Detection in Textual Conversationscited by 92
10 more
  1. 2020Deep Shallow Fusion for RNN-T Personalizationcited by 64
  2. 2021Earnings-21: A Practical Benchmark for ASR in the Wildcited by 60
  3. 2022Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selectioncited by 39
  4. 2018Contextual Speech Recognition with Difficult Negative Training Examplescited by 28
  5. 2018Dialog-context aware end-to-end speech recognitioncited by 27
  6. 2017Speech recognition for medical conversationscited by 18
  7. 2022Improving Contextual Recognition of Rare Words with an Alternate Spelling Prediction Modelcited by 17
  8. 2022End-to-end contextual asr based on posterior distribution adaptation for hybrid ctc/attention systemcited by 7
  9. 2023Improved Factorized Neural Transducer Model For text-only Domain Adaptationcited by 2
  10. 2023Evaluating Automatic Speech Recognition in an Incremental Settingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.