mlsanityData to 14 Oct 2026

Shakespeare, Entropy and Educated Monkeys

arXiv 2512.11880 ↗First posted 8 Dec 2025math.HO cs.CL cs.ITcited by 0

Not on the map. Why?

Abstract (arXiv)

It has often been said, correctly, that a monkey forever randomly typing on a keyboard would eventually produce the complete works of William Shakespeare. Almost just as often it has been pointed out that this "eventually" is well beyond any conceivably relevant time frame. We point out that an educated monkey that still types at random but is constrained to only write "statistically typical" text, would produce any given passage in a much shorter time. Information theory gives a very simple way to estimate that time. For example, Shakespeare's phrase, Better three hours too soon than a minute too late, from The Merry Wives of Windsor, would take the educated monkey only 73 thousand years to produce, compared to the beyond-astronomical 2.7 × 1063 years for the randomly typing one. Despite the obvious improvement, it would still take the educated monkey an unimaginably long 1042,277 years to produce all of Hamlet.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 33 references that are in the map. First posted on arXiv 8 Dec 2025.

Builds on

3 of 33 references.

References · 3

  1. 2023Language Modeling Is Compressioncited by 225
  2. 2024Lossless data compression by large modelscited by 20
  3. 2024Ranking LLMs by compressioncited by 2

Built on by

Not cited yet.