mlsanityData to 7 Oct 2026

Multilingual Phonological Feature Recognition with Self-Supervised Speech Models

arXiv 2605.25596 ↗First posted 25 May 2026cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Phonological features provide a language-general and linguistically grounded representation of speech. We present PhonoQ-2.0, a multilingual frame-level phonological feature recognizer built on self-supervised speech models. The system directly predicts a structured 22-dimensional feature vector per frame encoding manner, vowel quality, place, and voicing, instead of deriving features from phoneme outputs. To ensure phonologically coherent predictions, we introduce a manner-conditioned gating mechanism that activates valid feature groups. Evaluated across multiple languages and corpora, PhonoQ-2.0 achieves an average macro-F1 of 91.3% in-domain and 88.9% out-of-domain. Compared to a strong CTC phoneme baseline, it delivers consistent gains of +8.8 F1 in-domain and +8.6 out-of-domain on average. In unseen-language evaluation, PhonoQ-2.0 improves macro-F1 from 66.9% to 73.6% (+6.7 on average), with gains of up to +10.8 points.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 10 of its 27 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

10 of 27 references.

References · 10

  1. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  2. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
  3. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  4. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  5. 2021Simple and Effective Zero-shot Cross-lingual Phoneme Recognitioncited by 79
  6. 2023Self-Supervised Models of Speech Infer Universal Articulatory Kinematicscited by 16
  7. 2025Leveraging Allophony in Self-Supervised Speech Models for Atypical Pronunciation Assessmentcited by 15
  8. 2022Common Phone: A Multilingual Dataset for Robust Acoustic Modellingcited by 7
  9. 2025Improving Cross-Lingual Phonetic Representation of Low-Resource Languages Through Language Similarity Analysiscited by 5
  10. 2025Weakly Supervised Phonological Features for Pathological Speech Analysiscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.