mlsanityData to 7 Oct 2026

Layer-wise Probing of wav2vec 2.0 and Whisper for Consonant Cluster Reduction in African American English

arXiv 2606.23948 ↗First posted 22 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-supervised and supervised speech models are increasingly used to investigate which linguistic information their internal representations encode, and at what level of abstraction they encode it. One underexplored phenomenon is consonant cluster reduction (CCR) in African American English (AAE), a widespread phonological process and a source of automatic speech recognition (ASR) disparity. To examine how CCR is represented, we conduct speaker-independent layer-wise probing of wav2vec2-base and Whisper-small using two tasks: segmental reduction detection and segmental restoration of underlying cluster identity. Both models distinguish reduced and canonical forms with high accuracy. Crucially, reduced segments retain cues to their underlying stops, indicating that CCR is encoded as structured gradient phonological variation rather than simple segmental deletion. These results demonstrate structured phonological encoding of AAE CCR patterns in modern speech models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 39 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

12 of 39 references.

References · 12

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  4. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  5. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  6. 2021Layer-wise Analysis of a Self-supervised Speech Representation Modelcited by 293
  7. 2022Comparative layer-wise analysis of self-supervised speech modelscited by 155
  8. 2023What Can an Accent Identifier Learn? Probing Phonetic and Prosodic Information in a Wav2vec2-based Accent Identification Modelcited by 18
  9. 2024A layer-wise analysis of Mandarin and English suprasegmentals in SSL speech modelscited by 18
  10. 2023Homophone Disambiguation Reveals Patterns of Context Mixing in Speech Transformerscited by 13
  11. 2025Probing Whisper for Dysarthric Speech in Detection and Assessmentcited by 5
  12. 2025Automatic Speech Recognition of African American English: Lexical and Contextual Effectscited by 2

Built on by

Not cited yet.