# Predictability maximization and the origins of word order harmony

arXiv: https://arxiv.org/abs/2408.16570 · HTML: https://mlsanity.com/paper/2408.16570/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 8 of its 65 references that are in the map.
- First posted on arXiv 29 Aug 2024.

## Builds on (most cited first, 8 of 8)

- [The optimality of syntactic dependency distances](https://mlsanity.com/paper/2007.15342/) (2020)
- [Anti dependency distance minimization in short sequences. A graph theoretic approach](https://mlsanity.com/paper/1906.05765/) (2019)
- [The placement of the head that maximizes predictability. An information theoretic approach](https://mlsanity.com/paper/1705.09932/) (2017)
- [The placement of the head that minimizes online memory: a complex systems approach](https://mlsanity.com/paper/1309.1939/) (2013)
- [Kauffman's adjacent possible in word order evolution](https://mlsanity.com/paper/1512.05582/) (2015)
- [Swap distance minimization in SOV languages. Cognitive and mathematical foundations](https://mlsanity.com/paper/2312.04219/) (2023)
- [The optimal placement of the head in the noun phrase. The case of demonstrative, numeral, adjective and noun](https://mlsanity.com/paper/2402.10311/) (2024)
- [Swap distance minimization beyond entropy minimization in word order variation](https://mlsanity.com/paper/2404.14192/) (2024)

## Built on by (most cited first, 1 of 1)

- [Ease of dependency distance minimization in star-like structures](https://mlsanity.com/paper/2604.28034/) (2026)

## Abstract (arXiv)

We address the linguistic problem of the sequential arrangement of a head and its dependents from an information theoretic perspective. In particular, we consider the optimal placement of a head that maximizes the predictability of the sequence. We assume that dependents are statistically independent given a head, in line with the open-choice principle and the core assumptions of dependency grammar. We demonstrate the optimality of harmonic order, i.e., placing the head last maximizes the predictability of the head whereas placing the head first maximizes the predictability of dependents. We also show that postponing the head is the optimal strategy to maximize its predictability while bringing it forward is the optimal strategy to maximize the predictability of dependents. We unravel the advantages of the strategy of maximizing the predictability of the head over maximizing the predictability of dependents. Our findings shed light on the placements of the head adopted by real languages or emerging in different kinds of experiments.