mlsanityData to 14 Oct 2026

Grokipedia vs Wikipedia: An LLM-Based Audit of Political Neutrality along Ideologies

arXiv 2607.15146 ↗First posted 16 Jul 2026cs.CL cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Online encyclopedias shape political opinion and, through it, democratic discourse. In late 2025, Grokipedia was released, an encyclopedia written entirely by the LLM Grok. One motivation behind the project was to provide an unbiased alternative to Wikipedia, which has faced accusations of "left-wing" and "liberal" bias. But does an encyclopedia written by an LLM deliver greater neutrality, or does it simply embed a different ideology? We conduct a large-scale political bias study on Grokipedia and Wikipedia, analysing 1,394 article pairs describing members of government for neutrality along nine expert-coded ideology dimensions employing four LLM judges, Grok, Claude, Mistral, and DeepSeek. As the LLMs could themselves be biased, we also investigate patterns in their judgments. We find all LLM-judges, including Grok, to rate Grokipedia less neutral than Wikipedia. Both encyclopedias are rated as portraying politicians favourably overall, but towards different ideological groups. Grokipedia particularly favours economically right-wing politicians and penalises socially liberal ones, while Wikipedia is rated as favourably biased towards the latter.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 41 references that are in the map. First posted on arXiv 16 Jul 2026.

Builds on

15 of 41 references.

References · 15

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 465
  3. 2024The Political Preferences of LLMscited by 84
  4. 2024Large Language Models Reflect the Ideology of their Creatorscited by 57
  5. 2024Beyond Partisan Leaning: A Comparative Analysis of Political Bias in Large Language Modelscited by 13
  6. 2026Uncovering Political Bias in Large Language Models using Parliamentary Voting Recordscited by 8
  7. 2025A Cautionary Tale About "Neutrally" Informative AI Tools Ahead of the 2025 Federal Elections in Germanycited by 5
  8. 2025Reasoning-Grounded Natural Language Explanations for Language Modelscited by 5
  9. 2025What did Elon change? A comprehensive analysis of Grokipediacited by 4
  10. 2025POW: Political Overton Windows of Large Language Modelscited by 3
  11. 2025Epistemic Substitution: How Grokipedia's AI-Generated Encyclopedia Restructures Authoritycited by 3
  12. 2026Wikipedia and Grokipedia: A Comparison of Human and Generative Encyclopediascited by 2
3 more
  1. 2026PoliticsBench: Benchmarking Political Values in Large Language Models with Multi-Turn Roleplaycited by 2
  2. 2026Left, Right, or Center? Evaluating LLM Framing in News Classification and Generationcited by 1
  3. 2026Is Grokipedia Right-Leaning? Comparing Political Framing in Wikipedia and Grokipedia on Controversial Topicscited by 1

Built on by

Not cited yet.