mlsanityData to 7 Oct 2026

Measuring language complexity from hierarchical reuse of recurring patterns

arXiv 2606.11531 ↗First posted 10 Jun 2026cs.CL cs.IT math.ITcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce the ladderpath index as a measure of language complexity grounded in algorithmic information theory. It counts the minimum steps needed to reconstruct a sequence through hierarchical reuse of repeated substructures, capturing an exactly computable but constrained form of algorithmic compressibility related to, but distinct from, Kolmogorov complexity. We apply the ladderpath approach to 21 parallel corpora from the Parallel Universal Dependencies dataset. The ladderpath index is approximately invariant across the languages, and varies much less than the corpus length. This is more pronounced when all corpora are mapped to a unified binary representation, providing evidence for the equi-complexity hypothesis from a representation-independent perspective. We also observe trade-offs between character inventory size and corpus length, and between vocabulary-level and corpus-level reconstruction complexity, supporting the trade-off hypothesis that total complexity is conserved and redistributed across linguistic levels. The reusable substructures identified by the ladderpath approach, without any linguistic input, overlap with words and morphological components attested in the natural vocabulary. The hierarchical reuse captured by the ladderpath approach parallels the chunking mechanisms proposed in cognitive science, where the human cognitive system compresses linguistic input into nested, reusable units under shared memory and processing constraints. This connection between cognitive chunking and the ladderpath approach provides a new interpretation for the equi-complexity and trade-off hypotheses, grounding both in the shared cognitive architecture that underlies language processing across human languages.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 34 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

6 of 34 references.

References · 6

  1. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  2. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  3. 2018On the Complexity and Typology of Inflectional Morphological Systemscited by 15
  4. 2016The statistical trade-off between word order and word structure - large-scale evidence for the principle of least effortcited by 8
  5. 2022What do complexity measures measure? Correlating and validating corpus-based measures of morphological complexitycited by 8
  6. 2022Quantifying syntax similarity with a polynomial representation of dependency treescited by 6

Built on by

Not cited yet.