# Random Language Model

arXiv: https://arxiv.org/abs/1809.01201 · HTML: https://mlsanity.com/paper/1809.01201/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Sep 2018.

## Built on by (most cited first, 1 of 1)

- [Strahler Number of Natural Language Sentences in Comparison with Random Trees](https://mlsanity.com/paper/2307.02697/) (2023)

## Abstract (arXiv)

Many complex generative systems use languages to create structured objects. We consider a model of random languages, defined by weighted context-free grammars. As the distribution of grammar weights broadens, a transition is found from a random phase, in which sentences are indistinguishable from noise, to an organized phase in which nontrivial information is carried. This marks the emergence of deep structure in the language, and can be understood by a competition between energy and entropy.