mlsanityData to 7 Oct 2026

Beyond Static Responses: Multi-Agent LLM Systems as a New Paradigm for Social Science Research

arXiv 2506.01839 ↗First posted 2 Jun 2025cs.MAcited by 9

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

As large language models (LLMs) transition from static tools to fully agentic systems, their potential for transforming social science research has become increasingly evident. This paper introduces a structured framework for understanding the diverse applications of LLM-based agents, ranging from simple data processors to complex, multi-agent systems capable of simulating emergent social dynamics. By mapping this developmental continuum across six levels, the paper clarifies the technical and methodological boundaries between different agentic architectures, providing a comprehensive overview of current capabilities and future potential. It highlights how lower-tier systems streamline conventional tasks like text classification and data annotation, while higher-tier systems enable novel forms of inquiry, including the study of group dynamics, norm formation, and large-scale social processes. However, these advancements also introduce significant challenges, including issues of reproducibility, ethical oversight, and the risk of emergent biases. The paper critically examines these concerns, emphasizing the need for robust validation protocols, interdisciplinary collaboration, and standardized evaluation metrics. It argues that while LLM-based agents hold transformative potential for the social sciences, realizing this promise will require careful, context-sensitive deployment and ongoing methodological refinement. The paper concludes with a call for future research that balances technical innovation with ethical responsibility, encouraging the development of agentic systems that not only replicate but also extend the frontiers of social science, offering new insights into the complexities of human behavior.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 73 of its 154 references that are in the map. First posted on arXiv 2 Jun 2025.

Builds on

73 of 154 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulations4 Apr
  2. 2025Can A Society of Generative Agents Simulate Human Behavior and Inform Public Health Policy? A Case Study on Vaccine Hesitancy12 Mar
  3. 2025Investigating and Extending Homans' Social Exchange Theory with Large Language Model based Agents18 Feb
  4. 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society12 Feb
  5. 2024Static network structure cannot stabilize cooperation among Large Language Model agents15 Nov
  6. 2024Designing AI-Agents with Personalities: A Psychometric Approach25 Oct
  7. 2024GenSim: A General Social Simulation Platform with Large Language Model based Agents6 Oct
  8. 2024Artificial Leviathan: Exploring Social Evolution of LLM Agents Through the Lens of Hobbesian Social Contract Theory20 Jun
  9. 2024On the Principles behind Opinion Dynamics in Multi-Agent Systems of Large Language Models18 Jun
  10. 2024Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents25 Apr
  11. 2023Do LLM Agents Exhibit Social Behavior?23 Dec
  12. 2023Simulating Opinion Dynamics with Networks of LLM-based Agents16 Nov
3 more
  1. 2023CompeteAI: Understanding the Competition Dynamics in Large Language Model-based Agents26 Oct
  2. 2023An Appraisal-Based Chain-Of-Emotion Architecture for Affective Language Model Game Agents10 Sep
  3. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 58

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  3. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
  4. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  5. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  6. 2023Whose Opinions Do Language Models Reflect?cited by 759
  7. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  8. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  9. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
  10. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  11. 2024Understanding the planning of LLM agents: A surveycited by 414
  12. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
38 more
  1. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 297
  2. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
  3. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
  4. 2023Can Large Language Models Transform Computational Social Science?cited by 245
  5. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 238
  6. 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 228
  7. 2023AutoAgents: A Framework for Automatic Agent Generationcited by 211
  8. 2023Do LLMs exhibit human-like response biases? A case study in survey designcited by 176
  9. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
  10. 2025Multi-Agent Risks from Advanced AIcited by 150
  11. 2023Harms from Increasingly Agentic Algorithmic Systemscited by 134
  12. 2023Emergent autonomous scientific research capabilities of large language modelscited by 127
  13. 2024Simulating Classroom Education with LLM-Empowered Agentscited by 125
  14. 2023On Generative Agents in Recommendationcited by 88
  15. 2023AgentSims: An Open-Source Sandbox for Large Language Model Evaluationcited by 86
  16. 2025Can LLMs Replace Human Evaluators? An Empirical Study of LLM-as-a-Judge in Software Engineeringcited by 64
  17. 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 64
  18. 2024Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMscited by 59
  19. 2025LLM Agents for Education: Advances and Applicationscited by 59
  20. 2024Random Silicon Sampling: Simulating Human Sub-Population Opinion Using a Large Language Model Based on Group-Level Demographic Informationcited by 48
  21. 2024Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challengescited by 48
  22. 2024PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agentscited by 28
  23. 2024Political-LLM: Large Language Models in Political Sciencecited by 27
  24. 2024CollabStory: Multi-LLM Collaborative Story Generation and Authorship Analysiscited by 26
  25. 2023Artificial muses: Generative Artificial Intelligence Chatbots Have Risen to Human-Level Creativitycited by 24
  26. 2023Creative Agents: Empowering Agents with Imagination for Creative Taskscited by 24
  27. 2023The Machine Psychology of Cooperation: Can GPT models operationalise prompts for altruism, cooperation, competitiveness and selfishness in economic games?cited by 22
  28. 2025Human-Artificial Interaction in the Age of Agentic AI: A System-Theoretical Approachcited by 22
  29. 2025Eliciting Language Model Behaviors with Investigator Agentscited by 21
  30. 2024A social path to human-like artificial intelligencecited by 20
  31. 2025EduPlanner: LLM-Based Multi-Agent Systems for Customized and Intelligent Instructional Designcited by 18
  32. 2024Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Reviewcited by 17
  33. 2024How Teachers Can Use Large Language Models and Bloom's Taxonomy to Create Educational Quizzescited by 17
  34. 2024Measuring Social Norms of Large Language Modelscited by 16
  35. 2025MAGI: Multi-Agent Guided Interview for Psychiatric Assessmentcited by 14
  36. 2023Machine-assisted quantitizing designs: augmenting humanities and social sciences with artificial intelligencecited by 13
  37. 2023Towards the Scalable Evaluation of Cooperativeness in Language Modelscited by 12
  38. 2024AI-Driven Virtual Teacher for Enhanced Educational Efficiency: Leveraging Large Pretrain Models for Autonomous Error Analysis and Correctioncited by 12

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 6.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
  2. 2025Exploring Large Language Model Agents for Piloting Social Experiments
  3. 2025Evaluating the Use of Large Language Models as Synthetic Social Agents in Social Science Research
  4. 2024Sense and Sensitivity: Evaluating the simulation of social dynamics via Large Language Models
  5. 2025Large Language Models Miss the Multi-Agent Mark
  6. 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective
  7. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View
  8. 2025From the Fluency Fallacy to the Micro-to-Macro Validity Gap: Opportunities and Pitfalls of LLMs in Social Simulation