# Entropy of Ukrainian

arXiv: https://arxiv.org/abs/2604.27534 · HTML: https://mlsanity.com/paper/2604.27534/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 0 of its 5 references that are in the map.
- First posted on arXiv 30 Apr 2026.

## Abstract (arXiv)

In natural language processing, the entropy of a language is a measure of its unpredictability and complexity. The first study on this subject was conducted by Claude Shannon in 1951. By having participants predict the next character in a sentence, he was able to approximate the entropy of the English language. Several follow-up studies by other authors have since been conducted for English, and one for Hebrew. However, to date, Shannon's experiment has never been conducted for Ukrainian. In this paper, we perform this experiment for Ukrainian by recruiting 184 volunteers using social media channels. We rely on techniques used for English to approximate the entropy value of Ukrainian. The final result is an upper bound of Hupper≈1.201 bits per character. We compare this to the performance of current Large Language Models. The methods and code used are also documented and published, along with a discussion of the main challenges encountered.