Political Ideology Shifts in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly deployed in politically sensitive contexts, raising concerns about their susceptibility to ideological biases. In this work, we examine how synthetic persona conditioning shapes ideological expression across seven open-weight instruction-tuned models (7B-72B parameters) using the Political Compass Test (62 statements) as a standardized behavioral probe. Across three studies involving 200,000 synthetic personas and more than 260 million model responses, we analyze implicit and explicit malleability, as well as theme-associated variations. We find that: (i) larger models exhibit broader implicit ideological coverage, increasing from 14-35% for 7-8B models to up to 49% for 70B+ models; (ii) explicit ideological priming induces large and statistically significant shifts, with right-authoritarian cues moving all models in the intended direction and producing larger effects in most model-axis comparisons; (iii) left-libertarian priming produces more heterogeneous responses, including counter-directional economic shifts in three of four 7-8B models, while all 70B+ models move in the intended direction; and (iv) theme-associated semantic content in persona descriptions is linked to systematic and interpretable directional shifts in ideological space. While our results identify an upstream mechanism through which persona conditioning can alter model responses under a standardized ideological probe, we do not test whether such shifts affect users beliefs, decisions, or political behavior. Our findings are best understood as evidence of ideological malleability at the generation layer, highlighting the need to account for interactional factors when evaluating political neutrality, fairness, and safety in English-prompted, persona-conditioned language models.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 50 of its 87 references that are in the map. First posted on arXiv 22 Aug 2025.
Builds on
50 of 87 references.
References · 50
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
- 2020Aligning AI With Shared Human Valuescited by 723
- 2023Bias and Fairness in Large Language Models: A Surveycited by 639
- 2023Zephyr: Direct Distillation of LM Alignmentcited by 506
38 more
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
- 2023Role-Play with Large Language Modelscited by 294
- 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 264
- 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 264
- 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
- 2023Evaluating the Moral Beliefs Encoded in LLMscited by 215
- 2015Semi-supervised Sequence Learningcited by 198
- 2023The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientationcited by 189
- 2023Do LLMs exhibit human-like response biases? A case study in survey designcited by 180
- 2021Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Docited by 178
- 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
- 2022Who is GPT-3? An Exploration of Personality, Values and Demographicscited by 112
- 2023Generative Language Models Exhibit Social Identity Biasescited by 111
- 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
- 2024The Political Preferences of LLMscited by 84
- 2025LLM Generated Persona is a Promise with a Catchcited by 81
- 2024Evaluating Large Language Model Biases in Persona-Steered Generationcited by 78
- 2023Aligning Large Language Models with Human Preferences through Representation Engineeringcited by 71
- 2024Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voterscited by 71
- 2024Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMscited by 55
- 2023The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Valuescited by 54
- 2022Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learningcited by 53
- 2023When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Modelscited by 53
- 2025The Widespread Adoption of Large Language Model-Assisted Writing Across Societycited by 51
- 2022CommunityLM: Probing Partisan Worldviews from Language Modelscited by 36
- 2021Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation for BERT Rankerscited by 35
- 2024How Susceptible are Large Language Models to Ideological Manipulation?cited by 26
- 2025IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistancecited by 26
- 2024Personas with Attitudes: Controlling LLMs for Diverse Data Annotationcited by 21
- 2024PHAnToM: Persona-based Prompting Has An Effect on Theory-of-Mind Reasoning in Large Language Modelscited by 16
- 2024Mapping and Influencing the Political Ideology of Large Language Models using Synthetic Personascited by 16
- 2024GermanPartiesQA: Benchmarking Commercial Large Language Models and AI Companions for Political Alignment and Sycophancycited by 14
- 2024The LLM Effect: Are Humans Truly Using LLMs, or Are They Being Influenced By Them Instead?cited by 14
- 2024Spiral of Silence: How is Large Language Model Killing Information Retrieval? -- A Case Study on Open Domain Question Answeringcited by 5
- 2025The Impact of Persona-based Political Perspectives on Hateful Content Detectioncited by 5
- 2024SubData: Bridging Heterogeneous Datasets to Enable Theory-Driven Evaluation of Political and Demographic Perspectives in LLMscited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025Ideology-Based LLMs for Content Moderationcited by 1
- 2026Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebookcited by 1
- 2026Persona Conditioning as an Assessor-Sensitivity Probe for LLM-Based IR Evaluationcited by 1
- 2026How Far Will They Go? Red-Teaming Online Influence with Large Language Modelscited by 0
- 2026Auditing Stance Asymmetry in Generative Explanationscited by 0
- 2026Persona Conditioning as an Assessor-Sensitivity Probe for LLM-Based IR Evaluation11 Aug 2026
- 2026Auditing Stance Asymmetry in Generative Explanations27 May 2026
- 2026How Far Will They Go? Red-Teaming Online Influence with Large Language Models20 May 2026
- 2026Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebook16 Mar 2026
- 2025Ideology-Based LLMs for Content Moderation29 Oct 2025