mlsanityData to 7 Oct 2026

Compression and the origins of Zipf's law for word frequencies

arXiv 1605.01326 ↗First posted 4 May 2016cs.CL physics.data-an physics.soc-phcited by 2

Not on the map. Why?

Abstract (arXiv)

Here we sketch a new derivation of Zipf's law for word frequencies based on optimal coding. The structure of the derivation is reminiscent of Mandelbrot's random typing model but it has multiple advantages over random typing: (1) it starts from realistic cognitive pressures (2) it does not require fine tuning of parameters and (3) it sheds light on the origins of other statistical laws of language and thus can lead to a compact theory of linguistic laws. Our findings suggest that the recurrence of Zipf's law in human languages could originate from pressure for easy and fast communication.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 May 2016.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 0; 2023: 1.

2 papers.