mlsanityData to 14 Oct 2026

Qualitative Evaluation of Language Model Rescoring in Automatic Speech Recognition

arXiv 2604.27533 ↗First posted 30 Apr 2026cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Evaluating automatic speech recognition (ASR) systems is a classical but difficult and still open problem, which often boils down to focusing only on the word error rate (WER). However, this metric suffers from many limitations and does not allow an in-depth analysis of automatic transcription errors. In this paper, we propose to study and understand the impact of rescoring using language models in ASR systems by means of several metrics often used in other natural language processing (NLP) tasks in addition to the WER. In particular, we introduce two measures related to morpho-syntactic and semantic aspects of transcribed words: 1) the POSER (Part-of-speech Error Rate), which should highlight the grammatical aspects, and 2) the EmbER (Embedding Error Rate), a measurement that modifies the WER by providing a weighting according to the semantic distance of the wrongly transcribed words. These metrics illustrate the linguistic contributions of the language models that are applied during a posterior rescoring step on transcription hypotheses.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 9 of its 23 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

9 of 23 references.

References · 9

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  5. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  6. 2015Deep Speech 2: End-to-End Speech Recognition in English and Mandarincited by 451
  7. 2019How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptionscited by 48
  8. 2021Evaluating User Perception of Speech Recognition System Quality with Semantic Distance Metriccited by 21
  9. 2020Transformer-based End-to-End Speech Recognition with Local Dense Synthesizer Attentioncited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

  1. 2026A Comprehensive Analysis of Tokenization and Self-Supervised Learning in End-to-End Automatic Speech Recognition applied on French Languagecited by 2
  2. 2026A Paradigm for Interpreting Metrics and Identifying Critical Errors in Automatic Speech Recognitioncited by 1
  3. 2026Generative vs. Encoder Large Language Models for ASR Evaluation: A Comparative Studycited by 0