# Text mixing shapes the anatomy of rank-frequency distributions: A modern Zipfian mechanics for natural language

arXiv: https://arxiv.org/abs/1409.3870 · HTML: https://mlsanity.com/paper/1409.3870/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Sep 2014.

## Built on by (most cited first, 6 of 6)

- [Corrections of Zipf's and Heaps' Laws Derived from Hapax Rate Models](https://mlsanity.com/paper/2307.12896/) (2023)
- [From Zipf's Law to Neural Scaling through Heaps' Law and Hilberg's Hypothesis](https://mlsanity.com/paper/2512.13491/) (2025)
- [Sentiment and structure in word co-occurrence networks on Twitter](https://mlsanity.com/paper/2110.00587/) (2021)
- [Zipf's laws of meaning in Catalan](https://mlsanity.com/paper/2107.00042/) (2021)
- [Computational Paremiology: Charting the temporal, ecological dynamics of proverb use in books, news articles, and tweets](https://mlsanity.com/paper/2107.04929/) (2021)
- [Complete asymptotic type-token relationship for growing complex systems with inverse power-law count rankings](https://mlsanity.com/paper/2511.02069/) (2025)

## Abstract (arXiv)

Natural languages are full of rules and exceptions. One of the most famous quantitative rules is Zipf's law which states that the frequency of occurrence of a word is approximately inversely proportional to its rank. Though this `law' of ranks has been found to hold across disparate texts and forms of data, analyses of increasingly large corpora over the last 15 years have revealed the existence of two scaling regimes. These regimes have thus far been explained by a hypothesis suggesting a separability of languages into core and non-core lexica. Here, we present and defend an alternative hypothesis, that the two scaling regimes result from the act of aggregating texts. We observe that text mixing leads to an effective decay of word introduction, which we show provides accurate predictions of the location and severity of breaks in scaling. Upon examining large corpora from 10 languages in the Project Gutenberg eBooks collection (eBooks), we find emphatic empirical support for the universality of our claim.