Are LLMs Socially Adaptive? Contrasting Belief Evolution in Large Language Models and Humans
Not on the map. Why?
Abstract (arXiv)
As large language models (LLMs) increasingly engage in complex social interactions, ensuring that their behaviors align with human ethical principles and intentions, known as value alignment, has become a critical scientific challenge. Existing benchmarks often rely on static assessments and fail to capture the longitudinal dynamics of decision-making or the latent cognitive processes driving agent behavior. In this work, we propose FairMindSim, a realistic simulation benchmark rooted in social psychology that evaluates alignment through continuous economic games. To move beyond black-box observations, we introduce the Belief-Reward Alignment Behavior Evolution Model (BREM), a probabilistic framework that formalizes decision-making as a dynamic trade-off between maximizing extrinsic rewards and upholding intrinsic beliefs. We conducted a large-scale comparative study involving 1,017 human participants and ten LLMs, including GPT-5 and Gemini-3-Pro. Our experimental results reveal a capability linked non linear empirical trend in the Third Party Punishment (TPP) game. Mid capability models exhibit rigid and algorithmic aggression that is characterized by over punishment, while frontier models show a convergence of restraint and a shift toward human like leniency as reasoning capabilities scale. Furthermore, using BREM, we decompose agents longitudinal decision dynamics and find that more advanced models better balance conflicting objectives by reducing belief action inconsistency. Our contributions provide a standardized protocol for psychological stress testing and an interpretable mechanism for analyzing the longitudinal evolution of AI alignment in controlled social dilemma settings.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 12 of its 53 references that are in the map. First posted on arXiv 14 Oct 2024.
Builds on
12 of 53 references.
References · 12
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2020Artificial Intelligence, Values and Alignmentcited by 448
- 2022Using cognitive psychology to understand GPT-3cited by 398
- 2018Reward learning from human preferences and demonstrations in Ataricited by 316
- 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 241
- 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 218
- 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environmentscited by 120
- 2023Deception Abilities Emerged in Large Language Modelscited by 101
- 2024Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulationcited by 71
- 2023CompeteAI: Understanding the Competition Dynamics in Large Language Model-based Agentscited by 65
- 2023Do LLM Agents Exhibit Social Behavior?cited by 53
- 2019When Choosing Plausible Alternatives, Clever Hans can be Clevercited by 40
Built on by
Citing papers per year: 2025: 10; 2026: 1.
11 papers.
- 2025Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agentscited by 22
- 2025RhinoInsight: Improving Deep Research through Control Mechanisms for Model Behavior and Contextcited by 8
- 2025Interactional Fairness in LLM Multi-Agent Systems: An Evaluation Frameworkcited by 6
- 2025Do Large Language Models Think Like the Brain? Sentence-Level Evidences from Layer-Wise Embeddings and fMRIcited by 6
- 2025Assessing the Potential of Generative Agents in Crowdsourced Fact-Checkingcited by 3
- 2025PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimizationcited by 3
- 2025LLMs are Introvertcited by 1
- 2025Bias in Decision-Making for AI's Ethical Dilemmas: A Comparative Study of ChatGPT and Claudecited by 0
- 2025Are LLMs complicated ethical dilemma analyzers?cited by 0
- 2025EMNLP: Educator-role Moral and Normative Large Language Models Profilingcited by 0
- 2026Mitigating Social Sycophancy via Pluralistic Preference Optimizationcited by 0
- 2026Mitigating Social Sycophancy via Pluralistic Preference Optimization1 Oct 2026
- 2025RhinoInsight: Improving Deep Research through Control Mechanisms for Model Behavior and Context24 Nov 2025
- 2025EMNLP: Educator-role Moral and Normative Large Language Models Profiling21 Aug 2025
- 2025PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimization22 Jul 2025
- 2025LLMs are Introvert8 Jul 2025
- 2025Do Large Language Models Think Like the Brain? Sentence-Level Evidences from Layer-Wise Embeddings and fMRI28 May 2025
- 2025Interactional Fairness in LLM Multi-Agent Systems: An Evaluation Framework17 May 2025
- 2025Are LLMs complicated ethical dilemma analyzers?12 May 2025
- 2025Assessing the Potential of Generative Agents in Crowdsourced Fact-Checking24 Apr 2025
- 2025Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agents18 Feb 2025
- 2025Bias in Decision-Making for AI's Ethical Dilemmas: A Comparative Study of ChatGPT and Claude17 Jan 2025
Similar, not cited
Close in wording, no citation either way
- 2025Noise, Adaptation, and Strategy: Assessing LLM Fidelity in Decision-Making
- 2025Computational Basis of LLM's Decision Making in Social Simulation
- 2026Improving Behavioral Alignment in LLM Social Simulations via Context Formation and Navigation
- 2025Effects of Theory of Mind and Prosocial Beliefs on Steering Human-Aligned Behaviors of LLMs in Ultimatum Games
- 2025Understanding LLM Agent Behaviours via Game Theory: Strategy Recognition, Biases and Multi-Agent Dynamics
- 2024Evolution of Social Norms in LLM Agents using Natural Language
- 2024The Good, the Bad, and the Hulk-like GPT: Analyzing Emotional Decisions of Large Language Models in Cooperation and Bargaining Games
- 2024Systematic Biases in LLM Simulations of Debates