mlsanityData to 19 Oct 2026

ASR-Style Transcript Normalization Removes Useful Pragmatic Signal for Dialogue Act Classification

arXiv 2610.22934 ↗First posted 16 Oct 2026cs.CLcited by 0

On the map: Speech and audio language models → ASR evaluation, bias and atypical speech also fits: Speech recognition models and training

Abstract (arXiv)

Automatic speech recognition (ASR) pipelines often normalize transcripts by removing filled pauses and punctuation and expanding colloquial forms, potentially discarding cues useful for dialogue act classification. We evaluate nine transcript conditions across six classifiers (TF-IDF logistic regression, RoBERTa, BERT, ALBERT, GPT-2, and BiLSTM) and three conversational corpora (Switchboard, ICSI MRDA, and SLUE-HVB), supplemented by multi-seed experiments, normalization controls, and real-ASR evaluations. Across five random seeds, heavy normalization reduces Macro-F1 in all 15 neural model-corpus combinations under the original preprocessing protocols. Removal using the original filler and backchannel lexicon consistently degrades performance on MRDA and SLUE-HVB but produces mixed effects on Switchboard. Punctuation-aware TF-IDF experiments show that punctuation removal reduces Macro-F1 by 0.036 on Switchboard and 0.078 on MRDA, demonstrating that the original linear baseline's apparent insensitivity resulted from tokenization. Restricting filler removal to um, uh, and erm preserves degradation on MRDA but largely eliminates the SLUE-HVB effect, where the original lexicon removes class-defining backchannel expressions. These findings demonstrate that normalization effects depend on preprocessing definitions, feature extraction, and conversational context, supporting task-dependent rather than indiscriminate transcript normalization.

Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in ASR evaluation, bias and atypical speech, one of 11 directions in Speech and audio language models. Builds on 13 of its 30 references that are in the map. First posted on arXiv 16 Oct 2026.

Builds on

13 of 30 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Useful Blunders: Can Automated Speech Recognition Errors Improve Downstream Dementia Classification?10 Jan

Other references · 12

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,923
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,642
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,661
  4. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,839
  5. 2020ConvoKit: A Toolkit for the Analysis of Conversationscited by 75
  6. 2024CrisperWhisper: Accurate Timestamps on Verbatim Speech Transcriptionscited by 42
  7. 2022SLUE Phase-2: A Benchmark Suite of Diverse Spoken Language Understanding Taskscited by 37
  8. 2021An Approach to Improve Robustness of NLP Systems against ASR Errorscited by 9
  9. 2023Back Transcription as a Method for Evaluating Robustness of Natural Language Understanding Models to Speech Recognition Errorscited by 9
  10. 2025Measuring the Effect of Transcription Noise on Downstream Language Understanding Taskscited by 8
  11. 2021What Helps Transformers Recognize Conversational Structure? Importance of Context, Punctuation, and Labels in Dialog Act Recognitioncited by 6
  12. 2025Emotion Detection in Speech Using Lightweight and Transformer-Based Models: A Comparative and Ablation Studycited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023End-to-end Joint Punctuated and Normalized ASR with a Limited Amount of Punctuated Training Data
  2. 2024What is lost in Normalization? Exploring Pitfalls in Multilingual ASR Model Evaluations
  3. 2023Updated Corpora and Benchmarks for Long-Form Speech Recognition
  4. 2023HypR: A comprehensive study for ASR hypothesis revising with a reference corpus
  5. 2021Joint prediction of truecasing and punctuation for conversational speech in low-resource scenarios
  6. 2026Scaling Conversational Hungarian ASR: The BEA-Dialogue+ Corpus
  7. 2021Assessing the Use of Prosody in Constituency Parsing of Imperfect Transcripts
  8. 2025Non-Intrusive Automatic Speech Recognition Refinement: A Survey