mlsanityData to 14 Oct 2026

Contrastive Regularization for Accent-Robust ASR

arXiv 2605.03297 ↗First posted 5 May 2026cs.SD cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

ASR systems based on self-supervised acoustic pretraining and CTC fine-tuning achieve strong performance on native speech but remain sensitive to accent variability. We investigate supervised contrastive learning (SupCon) as a lightweight, accent-invariant auxiliary objective for CTC fine-tuning. An utterance-level contrastive loss regularizes encoder representations without architectural modification or explicit accent supervision. Experiments on the L2-ARCTIC benchmark show consistent WER reductions across multiple pretrained encoders, with up to 25 -- 29% relative reduction under unseen-accent evaluation. Analysis using within-transcript cosine dispersion indicates that SupCon promotes more compact and stable representation geometry under accent variability. Overall, SupCon provides an effective and model-agnostic regularization strategy for improving accent robustness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 17 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

9 of 17 references.

References · 9

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  3. 2020Supervised Contrastive Learningcited by 2,829
  4. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  5. 2020Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningcited by 276
  6. 2021Supervised Contrastive Learning for Accented Speech Recognitioncited by 10
  7. 2025On the Predictive Power of Representation Dispersion in Language Modelscited by 7
  8. 2024Improving Accented Speech Recognition using Data Augmentation based on Unsupervised Text-to-Speech Synthesiscited by 5
  9. 2025Mixture of LoRA Experts for Low-Resourced Multi-Accent Automatic Speech Recognitioncited by 5

Built on by

Not cited yet.