Information-Theoretic Characterization of Vowel Harmony: A Cross-Linguistic Study on Word Lists
Not on the map. Why?
Abstract (arXiv)
We present a cross-linguistic study that aims to quantify vowel harmony using data-driven computational modeling. Concretely, we define an information-theoretic measure of harmonicity based on the predictability of vowels in a natural language lexicon, which we estimate using phoneme-level language models (PLMs). Prior quantitative studies have relied heavily on inflected word-forms in the analysis of vowel harmony. We instead train our models using cross-linguistically comparable lemma forms with little or no inflection, which enables us to cover more under-studied languages. Training data for our PLMs consists of word lists with a maximum of 1000 entries per language. Despite the fact that the data we employ are substantially smaller than previously used corpora, our experiments demonstrate the neural PLMs capture vowel harmony patterns in a set of languages that exhibit this phenomenon. Our work also demonstrates that word lists are a valuable resource for typological research, and offers new possibilities for future studies on low-resource, under-studied languages.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 6 of its 35 references that are in the map. First posted on arXiv 9 Aug 2023.
Builds on
6 of 35 references.
References · 6
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Phonotactic Complexity and its Trade-offscited by 23
- 2021A surprisal--duration trade-off across and within the world's languagescited by 23
- 2019Morphological Irregularity Correlates with Frequencycited by 13
- 2021Disambiguatory Signals are Stronger in Word-initial Positionscited by 9
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2025Using Information Theory to Characterize Prosodic Typology: The Case of Tone, Pitch-Accent and Stress-Accentcited by 3
- 2025Tonguescape: Exploring Language Models Understanding of Vowel Articulationcited by 1
- 2024Phonotactic Complexity across Dialectscited by 0
- 2025Probing Subphonemes in Morphology Modelscited by 0
- 2025Probing Subphonemes in Morphology Models16 May 2025
- 2025Using Information Theory to Characterize Prosodic Typology: The Case of Tone, Pitch-Accent and Stress-Accent12 May 2025
- 2025Tonguescape: Exploring Language Models Understanding of Vowel Articulation29 Jan 2025
- 2024Phonotactic Complexity across Dialects20 Feb 2024