Too Human to Model:The Uncanny Valley of LLMs in Social Simulation -- When Generative Language Agents Misalign with Modelling Principles
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Large language models (LLMs) have been increasingly used to build agents in social simulation because of their impressive abilities to generate fluent, contextually coherent dialogues. Such abilities can enhance the realism of models. However, the pursuit of realism is not necessarily compatible with the epistemic foundation of modelling. We argue that LLM agents, in many regards, are too human to model: they are too expressive, detailed and intractable to be consistent with the abstraction, simplification, and interpretability typically demanded by modelling. Through a model-building thought experiment that converts the Bass diffusion model to an LLM-based variant, we uncover five core dilemmas: a temporal resolution mismatch between natural conversation and abstract time steps; the need for intervention in conversations while avoiding undermining spontaneous agent outputs; the temptation to introduce rule-like instructions in prompts while maintaining conversational naturalness; the tension between role consistency and role evolution across time; and the challenge of understanding emergence, where system-level patterns become obscured by verbose micro textual outputs. These dilemmas steer the LLM agents towards an uncanny valley: not abstract enough to clarify underlying social mechanisms, while not natural enough to represent realistic human behaviour. This exposes an important paradox: the realism of LLM agents can obscure, rather than clarify, social dynamics when misapplied. We tease out the conditions in which LLM agents are ideally suited: where system-level emergence is not the focus, linguistic nuances and meaning are central, interactions unfold in natural time, and stable role identity is more important than long-term behavioural evolution. We call for repositioning LLM agents in the ecosystem of social simulation for future applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 6 of its 15 references that are in the map. First posted on arXiv 8 Jul 2025.
Builds on
6 of 15 references.
References · 6
- 2023GPT-4 Technical Reportcited by 18,396
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
- 2025Large Language Models Pass the Turing Testcited by 48
- 2020Leveraging inter-firm influence in the diffusion of energy efficiency technologies: An agent-based modelcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulations
- 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents
- 2026AI Agents Alone Are Not (Yet) Sufficient for Social Simulation
- 2024Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs
- 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
- 2025From the Fluency Fallacy to the Micro-to-Macro Validity Gap: Opportunities and Pitfalls of LLMs in Social Simulation
- 2025Are LLM Agents Behaviorally Coherent? Latent Profiles for Social Simulation
- 2026Classic AI Scaffolding for LLM Social Agents