# Grokipedia vs Wikipedia: An LLM-Based Audit of Political Neutrality along Ideologies

arXiv: https://arxiv.org/abs/2607.15146 · HTML: https://mlsanity.com/paper/2607.15146/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 15 of its 41 references that are in the map.
- First posted on arXiv 16 Jul 2026.

## Builds on (most cited first, 15 of 15)

- [Chain-of-Thought Prompting Elicits Reasoning in Large Language Models](https://mlsanity.com/paper/2201.11903/) (2022)
- [LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods](https://mlsanity.com/paper/2412.05579/) (2024)
- [The Political Preferences of LLMs](https://mlsanity.com/paper/2402.01789/) (2024)
- [Large Language Models Reflect the Ideology of their Creators](https://mlsanity.com/paper/2410.18417/) (2024)
- [Beyond Partisan Leaning: A Comparative Analysis of Political Bias in Large Language Models](https://mlsanity.com/paper/2412.16746/) (2024)
- [Uncovering Political Bias in Large Language Models using Parliamentary Voting Records](https://mlsanity.com/paper/2601.08785/) (2026)
- [A Cautionary Tale About "Neutrally" Informative AI Tools Ahead of the 2025 Federal Elections in Germany](https://mlsanity.com/paper/2502.15568/) (2025)
- [Reasoning-Grounded Natural Language Explanations for Language Models](https://mlsanity.com/paper/2503.11248/) (2025)
- [What did Elon change? A comprehensive analysis of Grokipedia](https://mlsanity.com/paper/2511.09685/) (2025)
- [POW: Political Overton Windows of Large Language Models](https://mlsanity.com/paper/2509.08853/) (2025)
- [Epistemic Substitution: How Grokipedia's AI-Generated Encyclopedia Restructures Authority](https://mlsanity.com/paper/2512.03337/) (2025)
- [Wikipedia and Grokipedia: A Comparison of Human and Generative Encyclopedias](https://mlsanity.com/paper/2602.05519/) (2026)
- [PoliticsBench: Benchmarking Political Values in Large Language Models with Multi-Turn Roleplay](https://mlsanity.com/paper/2603.23841/) (2026)
- [Left, Right, or Center? Evaluating LLM Framing in News Classification and Generation](https://mlsanity.com/paper/2601.05835/) (2026)
- [Is Grokipedia Right-Leaning? Comparing Political Framing in Wikipedia and Grokipedia on Controversial Topics](https://mlsanity.com/paper/2601.15484/) (2026)

## Abstract (arXiv)

Online encyclopedias shape political opinion and, through it, democratic discourse. In late 2025, Grokipedia was released, an encyclopedia written entirely by the LLM Grok. One motivation behind the project was to provide an unbiased alternative to Wikipedia, which has faced accusations of "left-wing" and "liberal" bias. But does an encyclopedia written by an LLM deliver greater neutrality, or does it simply embed a different ideology? We conduct a large-scale political bias study on Grokipedia and Wikipedia, analysing 1,394 article pairs describing members of government for neutrality along nine expert-coded ideology dimensions employing four LLM judges, Grok, Claude, Mistral, and DeepSeek. As the LLMs could themselves be biased, we also investigate patterns in their judgments. We find all LLM-judges, including Grok, to rate Grokipedia less neutral than Wikipedia. Both encyclopedias are rated as portraying politicians favourably overall, but towards different ideological groups. Grokipedia particularly favours economically right-wing politicians and penalises socially liberal ones, while Wikipedia is rated as favourably biased towards the latter.