Multilingual Phonological Feature Recognition with Self-Supervised Speech Models
Not on the map. Why?
Abstract (arXiv)
Phonological features provide a language-general and linguistically grounded representation of speech. We present PhonoQ-2.0, a multilingual frame-level phonological feature recognizer built on self-supervised speech models. The system directly predicts a structured 22-dimensional feature vector per frame encoding manner, vowel quality, place, and voicing, instead of deriving features from phoneme outputs. To ensure phonologically coherent predictions, we introduce a manner-conditioned gating mechanism that activates valid feature groups. Evaluated across multiple languages and corpora, PhonoQ-2.0 achieves an average macro-F1 of 91.3% in-domain and 88.9% out-of-domain. Compared to a strong CTC phoneme baseline, it delivers consistent gains of +8.8 F1 in-domain and +8.6 out-of-domain on average. In unseen-language evaluation, PhonoQ-2.0 improves macro-F1 from 66.9% to 73.6% (+6.7 on average), with gains of up to +10.8 points.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 10 of its 27 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
10 of 27 references.
References · 10
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
- 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
- 2021Simple and Effective Zero-shot Cross-lingual Phoneme Recognitioncited by 79
- 2023Self-Supervised Models of Speech Infer Universal Articulatory Kinematicscited by 16
- 2025Leveraging Allophony in Self-Supervised Speech Models for Atypical Pronunciation Assessmentcited by 15
- 2022Common Phone: A Multilingual Dataset for Robust Acoustic Modellingcited by 7
- 2025Improving Cross-Lingual Phonetic Representation of Low-Resource Languages Through Language Similarity Analysiscited by 5
- 2025Weakly Supervised Phonological Features for Pathological Speech Analysiscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.