mlsanityData to 14 Oct 2026

Dependency distance minimization predicts compression

arXiv 2109.08900 ↗First posted 18 Sep 2021cs.CL q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Dependency distance minimization (DDm) is a well-established principle of word order. It has been predicted theoretically that DDm implies compression, namely the minimization of word lengths. This is a second order prediction because it links a principle with another principle, rather than a principle and a manifestation as in a first order prediction. Here we test that second order prediction with a parallel collection of treebanks controlling for annotation style with Universal Dependencies and Surface-Syntactic Universal Dependencies. To test it, we use a recently introduced score that has many mathematical and statistical advantages with respect to the widely used sum of dependency distances. We find that the prediction is confirmed by the new score when word lengths are measured in phonemes, independently of the annotation style, but not when word lengths are measured in syllables. In contrast, one of the most widely used scores, i.e. the sum of dependency distances, fails to confirm that prediction, showing the weakness of raw dependency distances for research on word order. Finally, our findings expand the theory of natural communication by linking two distinct levels of organization, namely syntax (word order) and word internal structure.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 51 references that are in the map. First posted on arXiv 18 Sep 2021.

Builds on

14 of 51 references.

References · 14

  1. 2020Phonotactic Complexity and its Trade-offscited by 23
  2. 2020The optimality of syntactic dependency distancescited by 15
  3. 2019Anti dependency distance minimization in short sequences. A graph theoretic approachcited by 13
  4. 2021How (Non-)Optimal is the Lexicon?cited by 11
  5. 2019Optimal coding and the origins of Zipfian lawscited by 10
  6. 2017The placement of the head that maximizes predictability. An information theoretic approachcited by 9
  7. 2021Minimum projective linearizations of trees in linear timecited by 9
  8. 2013The placement of the head that minimizes online memory: a complex systems approachcited by 8
  9. 2016The scarcity of crossing dependencies: a direct outcome of a specific constraint?cited by 7
  10. 2014Optimization models of natural communicationcited by 6
  11. 2015Kauffman's adjacent possible in word order evolutioncited by 6
  12. 2014Reply to the commentary "Be careful when assuming the obvious", by P. Aldaycited by 2
2 more
  1. 2014Be Careful When Assuming the Obvious: Commentary on "The placement of the head that minimizes online memory: a complex systems approach"cited by 1
  2. 2017Towards a theory of word order. Comment on "Dependency distance: a new perspective on syntactic patterns in natural language" by Haitao Liu et alcited by 1

Built on by

Not cited yet.