# The Political Ideology of Large Language Models: Measurement, Inconsistency, and Persuasive Influence

arXiv: https://arxiv.org/abs/2505.04171 · HTML: https://mlsanity.com/paper/2505.04171/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 May 2025.

## Built on by (most cited first, 7 of 7)

- [Evaluating Decision Models for Text Annotation in Computational Social Science](https://mlsanity.com/paper/2609.24574/) (2026)
- [A Detailed Factor Analysis for the Political Compass Test: Navigating Ideologies of Large Language Models](https://mlsanity.com/paper/2506.22493/) (2025)
- [When Models Refuse: Political Steerability and Feature Richness as Measures of Ideological Depth](https://mlsanity.com/paper/2508.21448/) (2025)
- [From Ground Trust to Truth: Disparities in Offensive Language Judgments on Contemporary Korean Political Discourse](https://mlsanity.com/paper/2509.14712/) (2025)
- [Progressive in Principle, Centrist in Practice: LLM Political Bias Is Instrument-Dependent](https://mlsanity.com/paper/2606.00048/) (2026)
- [Auditing Alignment Controllability in LLMs via Political Axes](https://mlsanity.com/paper/2607.23519/) (2026)
- [Polistemics: Evaluating LLMs as Information Mediators in Politics & Elections](https://mlsanity.com/paper/2607.25953/) (2026)

## Abstract (arXiv)

Large Language Models (LLMs) are a transformational technology, fundamentally changing how people obtain information and interact with the world. As people become increasingly reliant on them for an enormous variety of tasks, a body of academic research has developed to examine these models for inherent biases, especially political biases, often finding them small. We challenge this prevailing wisdom. First, by comparing 43 LLMs to legislators, judges, and a nationally representative sample of U.S. voters, we show that LLMs' apparently moderate overall partisan positioning is the net result of offsetting strongly partisan expressed positions on specific topics, much like moderate voters. Second, in a pre-registered randomized experiment, we show that LLMs can exert persuasive influence on political attitudes. Voters randomized to discuss a policy issue with an LLM shift toward that model's measured ideological position by 3.5 percentage points on average, an effect at least as large as those produced by professional campaign advertising. Explicitly prompting a model to argue one side of the issue shifts attitudes by more than 10 percentage points relative to unsteered conversations, and this steering accounts for the pooled effect. When the same models converse naturally, without steering, we detect no persuasive effect, and our confidence interval rules out effects as small as the pre-registered smallest effect of interest. Contrary to expectations, these persuasive effects are not moderated by familiarity with LLMs, news consumption, or interest in politics. LLMs, especially those controlled by private companies or governments, may become a powerful and targeted vector for political influence.