mlsanityData to 7 Oct 2026

Political Alignment in Large Language Models: A Multidimensional Audit of Psychometric Identity and Behavioral Bias

arXiv 2601.06194 ↗First posted 8 Jan 2026cs.CY cs.AI cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

As large language models (LLMs) are increasingly deployed, understanding how they express political positioning is important for evaluating alignment and downstream effects. We audit 26 contemporary LLMs using three political psychometric inventories (Political Compass, SapplyValues, 8Values) and a news bias labeling task. To test robustness, inventories are administered across multiple semantic prompt variants and analyzed with a two-way ANOVA separating model and prompt effects. Most models cluster in a similar ideological region, with 96.3% located in the Libertarian-Left quadrant of the Political Compass, and model identity explaining most variance across prompt variants (η2 > 0.90). Cross-instrument comparisons suggest that the Political Compass social axis aligns more strongly with cultural progressivism than authority-related measures (r=-0.64). We observe differences between open-weight and closed-source models and asymmetric performance in detecting extreme political bias in downstream classification. Regression analysis finds that psychometric ideological positioning does not significantly predict classification errors, providing no evidence of a statistically significant relationship between conversational ideological identity and task-level behavior. These findings suggest that single-axis evaluations are insufficient and that multidimensional auditing frameworks are important to characterize alignment behavior in deployed LLMs. Our code and data are publicly available at https://github.com/sakhadib/PolAlignLLM.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 9 of its 38 references that are in the map. First posted on arXiv 8 Jan 2026.

Builds on

9 of 38 references.

References · 9

  1. 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
  2. 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
  3. 2025HalluLens: LLM Hallucination Benchmarkcited by 88
  4. 2024The Political Preferences of LLMscited by 83
  5. 2024Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMscited by 55
  6. 2022Dbias: Detecting biases and ensuring Fairness in news articlescited by 28
  7. 2025Media Bias Detector: Designing and Implementing a Tool for Real-Time Selection and Framing Bias Analysis in News Coveragecited by 6
  8. 2025Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Expertscited by 3
  9. 2024High Risk of Political Bias in Black Box Emotion Inference Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Examining Alignment of Large Language Models through Representative Heuristics: The Case of Political Stereotypes
  2. 2026A Multi-Dimensional Audit of Politically Aligned Large Language Models
  3. 2024GermanPartiesQA: Benchmarking Commercial Large Language Models and AI Companions for Political Alignment and Sycophancy
  4. 2024On the Relationship between Truth and Political Bias in Language Models
  5. 2025PReSS: An Automated Black-Box Framework for Evaluating Political Stance Stability in LLMs
  6. 2026LLMs Can Infer Political Alignment from Online Conversations
  7. 2025Measuring Political Preferences in AI Systems: An Integrative Approach
  8. 2026Who Would You Vote For? Auditing Political Alignment in LLMs: An Italian Case-Study