Debiasing International Attitudes: LLM Agents for Simulating US-China Perception Changes
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) offer transformative opportunities to address the longstanding challenge of modeling opinion evolution in computational social science. This study investigates how media influences cross-border attitudes - a key driver of global polarization - by developing an LLM-agent framework to disentangle sources of bias and assess LLMs' capacity for human-like opinion formation in response to external information. We introduce an LLM-agent-based framework that models U.S. citizens' attitudes toward China from 2005 to 2025. Our approach integrates large-scale news data with social media profiles to initialize agent populations, which then undergo cognitive-aware reflection and opinion updating. We propose three debiasing mechanisms: (1) fact elicitation, extracting neutral events from subjectively framed news; (2) a devil's advocate agent that simulates critical contextualization; and (3) counterfactual exposure to surface inherent model biases. Simulations with two state-of-the-art LLMs (Qwen3-14b and GPT4o) reveal the expected negative attitudinal trend following media exposure. While all three mechanisms mitigate this trend to varying degrees, results indicate that subjective news framing contributes only modestly to negative attitudes, whereas the devil's advocate agent proves most effective overall, suggesting that intermediate analytical steps can produce more human-like agent opinions. Notably, the counterfactual study reveals contradictory findings across models, suggesting region-specific inherent biases tied to models' geographic origins. By advancing understanding of LLM-based opinion formation and debiasing methods, this study contributes to developing more objective models that better align with human cognitive tendencies.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 66 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
36 of 66 references.
References · 36
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025Qwen3 Technical Reportcited by 8,820
- 2024GPT-4o System Cardcited by 4,588
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2024LongRoPE: Extending LLM Context Window Beyond 2 Million Tokenscited by 313
- 2024TrustLLM: Trustworthiness in Large Language Modelscited by 285
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 251
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contextscited by 245
- 2023LongLoRA: Efficient Fine-tuning of Long-Context Large Language Modelscited by 244
- 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 233
24 more
- 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 222
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Societycited by 186
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activitiescited by 154
- 2023Simulating Opinion Dynamics with Networks of LLM-based Agentscited by 154
- 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Warscited by 145
- 2024OASIS: Open Agent Social Interaction Simulations with One Million Agentscited by 132
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Modelscited by 124
- 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 116
- 2023Generative Language Models Exhibit Social Identity Biasescited by 111
- 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 82
- 2023LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplaycited by 63
- 2024Self-Alignment of Large Language Models via Monopolylogue-based Social Scene Simulationcited by 46
- 2024Richelieu: Self-Evolving LLM-Based Agents for AI Diplomacycited by 36
- 2024ElectionSim: Massive Population Election Simulation Powered by Large Language Model Driven Agentscited by 35
- 2024Simulating Human-like Daily Activities with Desire-driven Autonomycited by 30
- 2025Emergence of polarization in networks of large language model agentscited by 26
- 2024Six Fallacies in Substituting Large Language Models for Human Participantscited by 24
- 2015Learning and Forecasting Opinion Dynamics in Social Networkscited by 21
- 2020Learning Opinion Dynamics From Social Tracescited by 15
- 2025Triangulating LLM Progress through Benchmarks, Games, and Cognitive Testscited by 12
- 2024Social Opinions Prediction Utilizes Fusing Dynamics Equation with LLM-based Agentscited by 11
- 2024A semantic embedding space based on large language models for modelling human beliefscited by 9
- 2025EcoLANG: Efficient and Effective Agent Communication Language Induction for Social Simulationcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A Cross-Cultural Comparison of LLM-based Public Opinion Simulation: Evaluating Chinese and U.S. Models on Diverse Societies
- 2025Analysis of LLM Bias (Chinese Propaganda & Anti-US Sentiment) in DeepSeek-R1 vs. ChatGPT o3-mini-high
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Models
- 2025Competing LLM Agents in a Non-Cooperative Game of Opinion Polarisation
- 2025"As Eastern Powers, I will veto." : An Investigation of Nation-level Bias of Large Language Models in International Relations
- 2025Disentangling Interaction and Bias Effects in Opinion Dynamics of Large Language Models
- 2026Mitigating Cultural Bias in LLMs via Multi-Agent Cultural Debate
- 2026Overstating Attitudes, Ignoring Networks: LLM Biases in Simulating Misinformation Susceptibility