Probing in the Wild: A Case Study of Self-Supervised Speech Representations on Mandarin Sub-dialects with Unsupervised Articulatory Analysis
Not on the map. Why?
Abstract (arXiv)
While self-supervised speech models have achieved strong performance across speech tasks, relatively little is known about how their internal phonetic representations behave under fine-grained dialect variation. Existing probing studies typically rely on curated corpora with manual phonetic annotations, limiting their applicability to naturally occurring dialect speech. We present a case study of articulatory feature representations in a Mandarin self-supervised speech model using an entirely unlabeled probing pipeline. Phone sequences are generated using a language-agnostic universal phone recognizer and mapped to articulatory feature vectors, enabling frame-level probing without manual annotation. Our results reveal a structured pattern in articulatory feature decodability across Mandarin sub-dialects. Acoustically salient features such as labiality and stridency remain comparatively stable, whereas features associated with finer spectral distinctions exhibit larger dialect-dependent variation. This variation is driven primarily by elevated decodability for Beijing speech relative to other Mandarin sub-dialects. Layer-wise analyses further show distinct representational dynamics for these feature groups. These findings suggest that language-agnostic articulatory probing can be applied to real-world dialect corpora and that dialect sensitivity in self-supervised speech representations is unevenly distributed across articulatory dimensions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 22 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
16 of 22 references.
References · 16
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 666
- 2021Layer-wise Analysis of a Self-supervised Speech Representation Modelcited by 298
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
- 2020Machine Learning in Python: Main developments and technology trends in data science, machine learning, and artificial intelligencecited by 82
- 2020Universal Phone Recognition with a Multilingual Allophone Systemcited by 81
- 2023What Do Self-Supervised Speech Models Know About Words?cited by 64
- 2023Probing self-supervised speech models for phonetic and phonemic information: a case study in aspirationcited by 36
- 2022Probing phoneme, language and speaker information in unsupervised speech representationscited by 33
- 2017Analyzing Hidden Representations in End-to-End Automatic Speech Recognition Systemscited by 32
- 2020Similarity Analysis of Self-Supervised Speech Representationscited by 26
4 more
- 2024Orthogonality and isotropy of speaker and phonetic information in self-supervised speech representationscited by 14
- 2021Do Acoustic Word Embeddings Capture Phonological Similarity? An Empirical Studycited by 8
- 2022Visualizing Automatic Speech Recognition -- Means for a Better Understanding?cited by 6
- 2025Echoes of Phonetics: Unveiling Relevant Acoustic Cues for ASR via Feature Attributioncited by 2
Built on by
Not cited yet.