mlsanityData to 7 Oct 2026

Are Human Interactions Replicable by Generative Agents? A Case Study on Pronoun Usage in Hierarchical Interactions

arXiv 2501.15283 ↗First posted 25 Jan 2025cs.CLcited by 2

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

As Large Language Models (LLMs) advance in their capabilities, researchers have increasingly employed them for social simulation. In this paper, we investigate whether interactions among LLM agents resemble those of humans. Specifically, we focus on the pronoun usage difference between leaders and non-leaders, examining whether the simulation would lead to human-like pronoun usage patterns during the LLMs' interactions. Our evaluation reveals the significant discrepancies between LLM-based simulations and human pronoun usage, with prompt-based or specialized agents failing to demonstrate human-like pronoun usage patterns. In addition, we reveal that even if LLMs understand the human pronoun usage patterns, they fail to demonstrate them in the actual interaction process. Our study highlights the limitations of social simulations based on LLM agents, urging caution in using such social simulation in practitioners' decision-making process.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 24 of its 50 references that are in the map. First posted on arXiv 25 Jan 2025.

Builds on

24 of 50 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individuals15 Nov
  2. 2024Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM Interactions3 Oct
  3. 2024What if LLMs Have Different World Views: Simulating Alien Civilizations with LLM-based Agents20 Feb
  4. 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Wars28 Nov
  5. 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activities16 Oct
  6. 2023MetaAgents: Large Language Model Based Agents for Decision-Making on Teaming10 Oct

Other references · 18

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2023Qwen Technical Reportcited by 3,273
  6. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  7. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  8. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  9. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 454
  10. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
  11. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 300
  12. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 191
6 more
  1. 2023In-Context Impersonation Reveals Large Language Models' Strengths and Biasescited by 154
  2. 2023ExpertPrompting: Instructing Large Language Models to be Distinguished Expertscited by 140
  3. 2024Simulating Classroom Education with LLM-Empowered Agentscited by 125
  4. 2023How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain Settingscited by 57
  5. 2023Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?cited by 54
  6. 2023Lyfe Agents: Generative agents for low-cost real-time social interactionscited by 49

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025Static Sandboxes Are Inadequate: Modeling Societal Complexity Requires Open-Ended Co-Evolution in LLM-Based Multi-Agent Simulationscited by 2
  2. 2026Interview-Informed Generative Agents for Product Discovery: A Validation Studycited by 1

Similar, not cited

Close in wording, no citation either way

  1. 2024Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs
  2. 2025Don't Trust Generative Agents to Mimic Communication on Social Networks Unless You Benchmarked their Empirical Realism
  3. 2025Human vs. Agent in Task-Oriented Conversations
  4. 2025Are LLM Agents Behaviorally Coherent? Latent Profiles for Social Simulation
  5. 2025Design and Evaluation of Generative Agent-based Platform for Human-Assistant Interaction Research: A Tale of 10 User Studies
  6. 2025Too Human to Model:The Uncanny Valley of LLMs in Social Simulation -- When Generative Language Agents Misalign with Modelling Principles
  7. 2024LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models
  8. 2026Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluations