Disambiguatory Signals are Stronger in Word-initial Positions
Not on the map. Why?
Abstract (arXiv)
Psycholinguistic studies of human word processing and lexical access provide ample evidence of the preferred nature of word-initial versus word-final segments, e.g., in terms of attention paid by listeners (greater) or the likelihood of reduction by speakers (lower). This has led to the conjecture -- as in Wedel et al. (2019b), but common elsewhere -- that languages have evolved to provide more information earlier in words than later. Information-theoretic methods to establish such tendencies in lexicons have suffered from several methodological shortcomings that leave open the question of whether this high word-initial informativeness is actually a property of the lexicon or simply an artefact of the incremental nature of recognition. In this paper, we point out the confounds in existing methods for comparing the informativeness of segments early in the word versus later in the word, and present several new measures that avoid these confounds. When controlling for these confounds, we still find evidence across hundreds of languages that indeed there is a cross-linguistic tendency to front-load information in words.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 3 of its 33 references that are in the map. First posted on arXiv 3 Feb 2021.
Builds on
3 of 33 references.
References · 3
- 2017Attention Is All You Needcited by 59,932
- 2020Phonotactic Complexity and its Trade-offscited by 23
- 2017Word forms - not just their lengths- are optimized for efficient communicationcited by 2
Built on by
Citing papers per year: 2021: 2; 2022: 0; 2023: 2; 2024: 3; 2025: 1; 2026: 1.
9 papers.
- 2021A surprisal--duration trade-off across and within the world's languagescited by 22
- 2023A Cross-Linguistic Pressure for Uniform Information Density in Word Ordercited by 16
- 2024Surprise! Uniform Information Density Isn't the Whole Story: Predicting Surprisal Contours in Long-form Discoursecited by 14
- 2021How (Non-)Optimal is the Lexicon?cited by 11
- 2024The Impact of Word Splitting on the Semantic Content of Contextualized Word Representationscited by 6
- 2023Information-Theoretic Characterization of Vowel Harmony: A Cross-Linguistic Study on Word Listscited by 4
- 2024CiteFusion: An Ensemble Framework for Citation Intent Classification Harnessing Dual-Model Binary Couples and SHAP Analysescited by 2
- 2025Modeling Bottom-up Information Quality during Language Processingcited by 0
- 2026Expect the Unexpected? Testing the Surprisal of Salient Entitiescited by 0
- 2026Expect the Unexpected? Testing the Surprisal of Salient Entities12 Apr 2026
- 2025Modeling Bottom-up Information Quality during Language Processing21 Sep 2025
- 2024Surprise! Uniform Information Density Isn't the Whole Story: Predicting Surprisal Contours in Long-form Discourse21 Oct 2024
- 2024CiteFusion: An Ensemble Framework for Citation Intent Classification Harnessing Dual-Model Binary Couples and SHAP Analyses18 Jul 2024
- 2024The Impact of Word Splitting on the Semantic Content of Contextualized Word Representations22 Feb 2024
- 2023Information-Theoretic Characterization of Vowel Harmony: A Cross-Linguistic Study on Word Lists9 Aug 2023
- 2023A Cross-Linguistic Pressure for Uniform Information Density in Word Order6 Jun 2023
- 2021A surprisal--duration trade-off across and within the world's languages30 Sep 2021
- 2021How (Non-)Optimal is the Lexicon?29 Apr 2021