# Characterizing the Google Books corpus: Strong limits to inferences of socio-cultural and linguistic evolution

arXiv: https://arxiv.org/abs/1501.00960 · HTML: https://mlsanity.com/paper/1501.00960/

## Key facts

- Cited by 15 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Jan 2015.

## Built on by (most cited first, 15 of 15)

- [Characterizing English Variation across Social Media Communities with BERT](https://mlsanity.com/paper/2102.06820/) (2021)
- [Challenges for Computational Lexical Semantic Change](https://mlsanity.com/paper/2101.07668/) (2021)
- [Neural Language Models for Nineteenth-Century English](https://mlsanity.com/paper/2105.11321/) (2021)
- [Turkronicles: Diachronic Resources for the Fast Evolving Turkish Language](https://mlsanity.com/paper/2405.10133/) (2024)
- [A Survey on Automated Sarcasm Detection on Twitter](https://mlsanity.com/paper/2202.02516/) (2022)
- [A decomposition of book structure through ousiometric fluctuations in cumulative word-time](https://mlsanity.com/paper/2208.09496/) (2022)
- [Enhancing Task-Oriented Dialogues with Chitchat: a Comparative Study Based on Lexical Diversity and Divergence](https://mlsanity.com/paper/2311.14067/) (2023)
- [The Moral Foundations of Left-Wing Authoritarianism: On the Character, Cohesion, and Clout of Tribal Equalitarian Discourse](https://mlsanity.com/paper/2102.11009/) (2021)
- [Computational Paremiology: Charting the temporal, ecological dynamics of proverb use in books, news articles, and tweets](https://mlsanity.com/paper/2107.04929/) (2021)
- [A Statistical Model of Word Rank Evolution](https://mlsanity.com/paper/2107.09948/) (2021)
- [Ousiometrics: The essence of meaning aligns with a power-danger-structure framework instead of valence-arousal-dominance](https://mlsanity.com/paper/2110.06847/) (2021)
- [Subdiffusive semantic evolution in Indo-European languages](https://mlsanity.com/paper/2209.04701/) (2022)
- [Reliable Detection and Quantification of Selective Forces in Language Change](https://mlsanity.com/paper/2305.15914/) (2023)
- [Detecting Turkish Synonyms Used in Different Time Periods](https://mlsanity.com/paper/2411.15768/) (2024)
- [Can LLMs Cook Jamaican Couscous? A Study of Cultural Novelty in Recipe Generation](https://mlsanity.com/paper/2602.10964/) (2026)

## Abstract (arXiv)

It is tempting to treat frequency trends from the Google Books data sets as indicators of the "true" popularity of various words and phrases. Doing so allows us to draw quantitatively strong conclusions about the evolution of cultural perception of a given topic, such as time or gender. However, the Google Books corpus suffers from a number of limitations which make it an obscure mask of cultural popularity. A primary issue is that the corpus is in effect a library, containing one of each book. A single, prolific author is thereby able to noticeably insert new phrases into the Google Books lexicon, whether the author is widely read or not. With this understood, the Google Books corpus remains an important data set to be considered more lexicon-like than text-like. Here, we show that a distinct problematic feature arises from the inclusion of scientific texts, which have become an increasingly substantive portion of the corpus throughout the 1900s. The result is a surge of phrases typical to academic articles but less common in general, such as references to time in the form of citations. We highlight these dynamics by examining and comparing major contributions to the statistical divergence of English data sets between decades in the period 1800--2000. We find that only the English Fiction data set from the second version of the corpus is not heavily affected by professional texts, in clear contrast to the first version of the fiction data set and both unfiltered English data sets. Our findings emphasize the need to fully characterize the dynamics of the Google Books corpus before using these data sets to draw broad conclusions about cultural and linguistic evolution.