How Similar Are Grokipedia and Wikipedia? A Multi-Dimensional Textual and Structural Comparison
Not on the map. Why?
Abstract (arXiv)
The launch of Grokipedia, an AI-generated encyclopedia developed by Elon Musk's xAI, was presented as a response to perceived ideological and structural biases in Wikipedia, aiming to produce "truthful" entries using the Grok large language model. Yet whether an AI-driven alternative can escape the biases and limitations of human-edited platforms remains unclear. This study conducts a large-scale computational comparison of 17,790 matched article pairs from the 20,000 most-edited English Wikipedia pages. Using metrics spanning lexical richness, readability, reference density, structural features, and semantic similarity, we assess how closely the two platforms align in form and substance. We find that Grokipedia articles are substantially longer and contain significantly fewer references per word. Moreover, Grokipedia's content divides into two distinct groups: one that remains semantically and stylistically aligned with Wikipedia, and another that diverges sharply. Among the dissimilar articles, we observe a systematic rightward shift in the political bias of frequently cited news media sources, concentrated primarily in entries related to history and religion, and literature and art. More broadly, the findings indicate that AI-generated encyclopedic content departs from established editorial norms, favoring narrative expansion over citation-based verification, raising questions about transparency, provenance, and the governance of knowledge in automated information systems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 12 of its 41 references that are in the map. First posted on arXiv 30 Oct 2025.
Builds on
12 of 41 references.
References · 12
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2024Investigating Bias in LLM-Based Bias Detection: Disparities between LLMs and Human Perceptioncited by 56
- 2024Assessing Political Bias in Large Language Modelscited by 32
- 2023Accuracy and Political Bias of News Source Credibility Ratings by Large Language Modelscited by 25
- 2025Large Means Left: Political Bias in Large Language Models Increases with Their Number of Parameterscited by 12
- 2015First Women, Second Sex: Gender Bias in Wikipediacited by 11
- 2023Exploring the Jungle of Bias: Political Bias Attribution in Language Models via Dependency Analysiscited by 3
- 2025DomainDemo: a dataset of domain-sharing activities among different demographic groups on Twittercited by 3
- 2025Source framing triggers systematic evaluation bias in Large Language Modelscited by 3
- 2024Mapping the Media Landscape: Predicting Factual Reporting and Political Bias Through Web Interactionscited by 2
- 2025Assessing the performance of 8 AI chatbots in bibliographic reference retrieval: Grok and DeepSeek outperform ChatGPT, but none are fully accuratecited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.