ParlAI Vote: A Web Platform for Analyzing Gender and Political Bias in Large Language Models
Not on the map. Why?
Abstract (arXiv)
We present ParlAI Vote, an interactive web platform for exploring European Parliament debates and votes, and for testing LLMs on vote prediction and bias analysis. This web system connects debate topics, speeches, and roll-call outcomes, and includes rich demographic data such as gender, age, country, and political group. Users can browse debates, inspect linked speeches, compare real voting outcomes with predictions from frontier LLMs, and view error breakdowns by demographic group. Visualizing the EuroParlVote benchmark and its core tasks of gender classification and vote prediction, ParlAI Vote highlights systematic performance bias in state-of-the-art LLMs. It unifies data, models, and visual analytics in a single interface, lowering the barrier for reproducing findings, auditing behavior, and running counterfactual scenarios. This web platform also shows model reasoning, helping users see why errors occur and what cues the models rely on. It supports research, education, and public engagement with legislative decision-making, while making clear both the strengths and the limitations of current LLMs in political analysis.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 20 references that are in the map. First posted on arXiv 18 Sep 2025.
Builds on
9 of 20 references.
References · 9
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2024Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voterscited by 71
- 2023Stance Detection with Collaborative Role-Infused LLM-Based Agentscited by 53
- 2025ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understandingcited by 50
- 2025SCORE: Story Coherence and Retrieval Enhancement for AI Narrativescited by 42
- 2024Political-LLM: Large Language Models in Political Sciencecited by 27
- 2024The Power of LLM-Generated Synthetic Data for Stance Detection in Online Political Discussionscited by 16
- 2024Modelling Political Coalition Negotiations Using LLM-based Agentscited by 13
Built on by
Not cited yet.