mlsanityData to 14 Oct 2026

Political Ideology Shifts in Large Language Models

arXiv 2508.16013 ↗First posted 22 Aug 2025cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly deployed in politically sensitive contexts, raising concerns about their susceptibility to ideological biases. In this work, we examine how synthetic persona conditioning shapes ideological expression across seven open-weight instruction-tuned models (7B-72B parameters) using the Political Compass Test (62 statements) as a standardized behavioral probe. Across three studies involving 200,000 synthetic personas and more than 260 million model responses, we analyze implicit and explicit malleability, as well as theme-associated variations. We find that: (i) larger models exhibit broader implicit ideological coverage, increasing from 14-35% for 7-8B models to up to 49% for 70B+ models; (ii) explicit ideological priming induces large and statistically significant shifts, with right-authoritarian cues moving all models in the intended direction and producing larger effects in most model-axis comparisons; (iii) left-libertarian priming produces more heterogeneous responses, including counter-directional economic shifts in three of four 7-8B models, while all 70B+ models move in the intended direction; and (iv) theme-associated semantic content in persona descriptions is linked to systematic and interpretable directional shifts in ideological space. While our results identify an upstream mechanism through which persona conditioning can alter model responses under a standardized ideological probe, we do not test whether such shifts affect users beliefs, decisions, or political behavior. Our findings are best understood as evidence of ideological malleability at the generation layer, highlighting the need to account for interactional factors when evaluating political neutrality, fairness, and safety in English-prompted, persona-conditioned language models.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 50 of its 87 references that are in the map. First posted on arXiv 22 Aug 2025.

Builds on

50 of 87 references.

References · 50

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  5. 2017Deep reinforcement learning from human preferencescited by 3,912
  6. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  7. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
  8. 2023Whose Opinions Do Language Models Reflect?cited by 773
  9. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
  10. 2020Aligning AI With Shared Human Valuescited by 723
  11. 2023Bias and Fairness in Large Language Models: A Surveycited by 639
  12. 2023Zephyr: Direct Distillation of LM Alignmentcited by 506
38 more
  1. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
  2. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
  3. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  4. 2023Role-Play with Large Language Modelscited by 294
  5. 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 264
  6. 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 264
  7. 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
  8. 2023Evaluating the Moral Beliefs Encoded in LLMscited by 215
  9. 2015Semi-supervised Sequence Learningcited by 198
  10. 2023The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientationcited by 189
  11. 2023Do LLMs exhibit human-like response biases? A case study in survey designcited by 180
  12. 2021Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Docited by 178
  13. 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
  14. 2022Who is GPT-3? An Exploration of Personality, Values and Demographicscited by 112
  15. 2023Generative Language Models Exhibit Social Identity Biasescited by 111
  16. 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
  17. 2024The Political Preferences of LLMscited by 84
  18. 2025LLM Generated Persona is a Promise with a Catchcited by 81
  19. 2024Evaluating Large Language Model Biases in Persona-Steered Generationcited by 78
  20. 2023Aligning Large Language Models with Human Preferences through Representation Engineeringcited by 71
  21. 2024Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voterscited by 71
  22. 2024Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMscited by 55
  23. 2023The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Valuescited by 54
  24. 2022Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learningcited by 53
  25. 2023When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Modelscited by 53
  26. 2025The Widespread Adoption of Large Language Model-Assisted Writing Across Societycited by 51
  27. 2022CommunityLM: Probing Partisan Worldviews from Language Modelscited by 36
  28. 2021Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation for BERT Rankerscited by 35
  29. 2024How Susceptible are Large Language Models to Ideological Manipulation?cited by 26
  30. 2025IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistancecited by 26
  31. 2024Personas with Attitudes: Controlling LLMs for Diverse Data Annotationcited by 21
  32. 2024PHAnToM: Persona-based Prompting Has An Effect on Theory-of-Mind Reasoning in Large Language Modelscited by 16
  33. 2024Mapping and Influencing the Political Ideology of Large Language Models using Synthetic Personascited by 16
  34. 2024GermanPartiesQA: Benchmarking Commercial Large Language Models and AI Companions for Political Alignment and Sycophancycited by 14
  35. 2024The LLM Effect: Are Humans Truly Using LLMs, or Are They Being Influenced By Them Instead?cited by 14
  36. 2024Spiral of Silence: How is Large Language Model Killing Information Retrieval? -- A Case Study on Open Domain Question Answeringcited by 5
  37. 2025The Impact of Persona-based Political Perspectives on Hateful Content Detectioncited by 5
  38. 2024SubData: Bridging Heterogeneous Datasets to Enable Theory-Driven Evaluation of Political and Demographic Perspectives in LLMscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.