Multilingual Political Views of Large Language Models: Identification and Steering
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used in everyday tools and applications, raising concerns about their potential influence on political views. While prior research has shown that LLMs often exhibit measurable political biases--frequently skewing toward liberal or progressive positions--key gaps remain. Most existing studies evaluate only a narrow set of models and languages, leaving open questions about the generalizability of political biases across architectures, scales, and multilingual settings. Moreover, few works examine whether these biases can be actively controlled. In this work, we address these gaps through a large-scale study of political orientation in modern open-source instruction-tuned LLMs. We evaluate seven models, including LLaMA-3.1, Qwen-3, and Aya-Expanse, across 14 languages using the Political Compass Test with 11 semantically equivalent paraphrases per statement to ensure robust measurement. Our results reveal that larger models consistently shift toward libertarian-left positions, with significant variations across languages and model families. To test the manipulability of political stances, we utilize a simple center-of-mass activation intervention technique and show that it reliably steers model responses toward alternative ideological positions across multiple languages. Our code is publicly available at https://github.com/d-gurgurov/Political-Ideologies-LLMs.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 24 of its 44 references that are in the map. First posted on arXiv 30 Jul 2025.
Builds on
24 of 44 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2021Ethical and social risks of harm from Language Modelscited by 966
- 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
12 more
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 281
- 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
- 2025AxBench: Steering LLMs? Even Simple Baselines Outperform Sparse Autoencoderscited by 218
- 2023The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientationcited by 189
- 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
- 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
- 2024Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMscited by 55
- 2025Large Means Left: Political Bias in Large Language Models Increases with Their Number of Parameterscited by 12
- 2024Quantifying Generative Media Bias with a Corpus of Real-world and Generated News Articlescited by 9
- 2024Development and Testing of a Novel Large Language Model-Based Clinical Decision Support Systems for Medication Safety in 12 Clinical Specialtiescited by 5
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026On the Credibility of Evaluating LLMs using Survey Questionscited by 3
- 2026OPEN-1B: A Fully Auditable Training Runcited by 1
- 2026From Self to Other: Evaluating Demographic Perspective-Taking in LLM Hate Speech Annotationcited by 0
- 2026Large Language Models as Implicit Sociological Models: Reconstructing Voting Behaviour from Sociodemographic Profilescited by 0
- 2026Navigating the digital spectrum: Assessing political bias, stability, and downstream fairness in Large Language Modelscited by 0
- 2026OPEN-1B: A Fully Auditable Training Run15 Sep 2026
- 2026Navigating the digital spectrum: Assessing political bias, stability, and downstream fairness in Large Language Models8 Sep 2026
- 2026Large Language Models as Implicit Sociological Models: Reconstructing Voting Behaviour from Sociodemographic Profiles16 Aug 2026
- 2026From Self to Other: Evaluating Demographic Perspective-Taking in LLM Hate Speech Annotation4 Jun 2026
- 2026On the Credibility of Evaluating LLMs using Survey Questions3 Feb 2026