mlsanityData to 14 Oct 2026

Are LLMs Socially Adaptive? Contrasting Belief Evolution in Large Language Models and Humans

arXiv 2410.10398 ↗First posted 14 Oct 2024cs.CE cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

As large language models (LLMs) increasingly engage in complex social interactions, ensuring that their behaviors align with human ethical principles and intentions, known as value alignment, has become a critical scientific challenge. Existing benchmarks often rely on static assessments and fail to capture the longitudinal dynamics of decision-making or the latent cognitive processes driving agent behavior. In this work, we propose FairMindSim, a realistic simulation benchmark rooted in social psychology that evaluates alignment through continuous economic games. To move beyond black-box observations, we introduce the Belief-Reward Alignment Behavior Evolution Model (BREM), a probabilistic framework that formalizes decision-making as a dynamic trade-off between maximizing extrinsic rewards and upholding intrinsic beliefs. We conducted a large-scale comparative study involving 1,017 human participants and ten LLMs, including GPT-5 and Gemini-3-Pro. Our experimental results reveal a capability linked non linear empirical trend in the Third Party Punishment (TPP) game. Mid capability models exhibit rigid and algorithmic aggression that is characterized by over punishment, while frontier models show a convergence of restraint and a shift toward human like leniency as reasoning capabilities scale. Furthermore, using BREM, we decompose agents longitudinal decision dynamics and find that more advanced models better balance conflicting objectives by reducing belief action inconsistency. Our contributions provide a standardized protocol for psychological stress testing and an interpretable mechanism for analyzing the longitudinal evolution of AI alignment in controlled social dilemma settings.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 12 of its 53 references that are in the map. First posted on arXiv 14 Oct 2024.

Builds on

12 of 53 references.

References · 12

  1. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  2. 2020Artificial Intelligence, Values and Alignmentcited by 448
  3. 2022Using cognitive psychology to understand GPT-3cited by 398
  4. 2018Reward learning from human preferences and demonstrations in Ataricited by 316
  5. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 241
  6. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 218
  7. 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environmentscited by 120
  8. 2023Deception Abilities Emerged in Large Language Modelscited by 101
  9. 2024Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulationcited by 71
  10. 2023CompeteAI: Understanding the Competition Dynamics in Large Language Model-based Agentscited by 65
  11. 2023Do LLM Agents Exhibit Social Behavior?cited by 53
  12. 2019When Choosing Plausible Alternatives, Clever Hans can be Clevercited by 40

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 1.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Noise, Adaptation, and Strategy: Assessing LLM Fidelity in Decision-Making
  2. 2025Computational Basis of LLM's Decision Making in Social Simulation
  3. 2026Improving Behavioral Alignment in LLM Social Simulations via Context Formation and Navigation
  4. 2025Effects of Theory of Mind and Prosocial Beliefs on Steering Human-Aligned Behaviors of LLMs in Ultimatum Games
  5. 2025Understanding LLM Agent Behaviours via Game Theory: Strategy Recognition, Biases and Multi-Agent Dynamics
  6. 2024Evolution of Social Norms in LLM Agents using Natural Language
  7. 2024The Good, the Bad, and the Hulk-like GPT: Analyzing Emotional Decisions of Large Language Models in Cooperation and Bargaining Games
  8. 2024Systematic Biases in LLM Simulations of Debates