Diagnosing Korean-Language LLM Political Bias via Census-Grounded Agent Simulation
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Large language models (LLMs) exhibit systematic political biases in voter simulations, but their underlying mechanisms and cross-lingual generalizations remain poorly understood. We introduce Dynamo-K, a census-grounded simulation framework evaluating Korean-language LLM political behavior across four models on six Korean elections (2017-2025). Using this framework, we identify three systematic failure modes: (1) progressive bias in moderate agents, where explicit mitigation reduces Mean Absolute Error (MAE) by 5.2 times; (2) model-dependent third-party salience collapse, distinguishing between salience failure and decision bias; and (3) regional polarization collapse, where models bidirectionally under-predict historical party strongholds. To address these failures, we demonstrate that scenario reframing recovers 62% of 2017 MAE by restoring third-party visibility. Furthermore, we introduce a learned reweighting adapter that successfully calibrates opposing-valence models without relying on candidate names at train or test time. Validating our diagnostic framework, Dynamo-K accurately predicts 3/3 presidential winners - including a 2.1%p MAE on the highly contested 0.73%p-margin 2022 race - and correctly identifies the dominant party in a held-out local election. The pipeline is open-source and provides a scalable, cost-effective method for diagnosing LLM political behavior.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 8 of its 21 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
8 of 21 references.
Closest ancestors · 1
Same direction, newest first
Other references · 7
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
- 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
- 2025EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modescited by 32
- 2025Polypersona: Persona-Grounded LLM for Synthetic Survey Responsescited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Assessing Political Bias in Large Language Models
- 2025Examining Alignment of Large Language Models through Representative Heuristics: The Case of Political Stereotypes
- 2025Steering Towards Fairness: Mitigating Political Bias in LLMs
- 2025Human Preferences in Large Language Model Latent Space: A Technical Analysis on the Reliability of Synthetic Data in Voting Outcome Prediction
- 2026Navigating the digital spectrum: Assessing political bias, stability, and downstream fairness in Large Language Models
- 2024GermanPartiesQA: Benchmarking Commercial Large Language Models and AI Companions for Political Alignment and Sycophancy
- 2024Bias Amplification: Large Language Models as Increasingly Biased Media
- 2025Measuring Political Preferences in AI Systems: An Integrative Approach