Political Alignment in Large Language Models: A Multidimensional Audit of Psychometric Identity and Behavioral Bias
Not on the map. Why?
Abstract (arXiv)
As large language models (LLMs) are increasingly deployed, understanding how they express political positioning is important for evaluating alignment and downstream effects. We audit 26 contemporary LLMs using three political psychometric inventories (Political Compass, SapplyValues, 8Values) and a news bias labeling task. To test robustness, inventories are administered across multiple semantic prompt variants and analyzed with a two-way ANOVA separating model and prompt effects. Most models cluster in a similar ideological region, with 96.3% located in the Libertarian-Left quadrant of the Political Compass, and model identity explaining most variance across prompt variants (η2 > 0.90). Cross-instrument comparisons suggest that the Political Compass social axis aligns more strongly with cultural progressivism than authority-related measures (r=-0.64). We observe differences between open-weight and closed-source models and asymmetric performance in detecting extreme political bias in downstream classification. Regression analysis finds that psychometric ideological positioning does not significantly predict classification errors, providing no evidence of a statistically significant relationship between conversational ideological identity and task-level behavior. These findings suggest that single-axis evaluations are insufficient and that multidimensional auditing frameworks are important to characterize alignment behavior in deployed LLMs. Our code and data are publicly available at https://github.com/sakhadib/PolAlignLLM.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 9 of its 38 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
9 of 38 references.
References · 9
- 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
- 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
- 2025HalluLens: LLM Hallucination Benchmarkcited by 88
- 2024The Political Preferences of LLMscited by 83
- 2024Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMscited by 55
- 2022Dbias: Detecting biases and ensuring Fairness in news articlescited by 28
- 2025Media Bias Detector: Designing and Implementing a Tool for Real-Time Selection and Framing Bias Analysis in News Coveragecited by 6
- 2025Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Expertscited by 3
- 2024High Risk of Political Bias in Black Box Emotion Inference Modelscited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Narrative over Numbers: The Identifiable Victim Effect and its Amplification Under Alignment and Reasoning in Large Language Modelscited by 0
- 2026The Pinocchio Dimension: Phenomenality of Experience as the Primary Axis of LLM Psychometric Differencescited by 0
- 2026Progressive in Principle, Centrist in Practice: LLM Political Bias Is Instrument-Dependentcited by 0
- 2026LLM-Ideoplasticity: Measuring Ideological Plasticity in the Political Behavior of LLMs as a Context-Conditioned Distributioncited by 0
- 2026Auditing Alignment Controllability in LLMs via Political Axescited by 0
- 2026Auditing Alignment Controllability in LLMs via Political Axes26 Jul 2026
- 2026LLM-Ideoplasticity: Measuring Ideological Plasticity in the Political Behavior of LLMs as a Context-Conditioned Distribution26 May 2026
- 2026The Pinocchio Dimension: Phenomenality of Experience as the Primary Axis of LLM Psychometric Differences6 May 2026
- 2026Progressive in Principle, Centrist in Practice: LLM Political Bias Is Instrument-Dependent3 May 2026
- 2026Narrative over Numbers: The Identifiable Victim Effect and its Amplification Under Alignment and Reasoning in Large Language Models13 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Examining Alignment of Large Language Models through Representative Heuristics: The Case of Political Stereotypes
- 2026A Multi-Dimensional Audit of Politically Aligned Large Language Models
- 2024GermanPartiesQA: Benchmarking Commercial Large Language Models and AI Companions for Political Alignment and Sycophancy
- 2024On the Relationship between Truth and Political Bias in Language Models
- 2025PReSS: An Automated Black-Box Framework for Evaluating Political Stance Stability in LLMs
- 2026LLMs Can Infer Political Alignment from Online Conversations
- 2025Measuring Political Preferences in AI Systems: An Integrative Approach
- 2026Who Would You Vote For? Auditing Political Alignment in LLMs: An Italian Case-Study