Beyond Static Responses: Multi-Agent LLM Systems as a New Paradigm for Social Science Research
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
As large language models (LLMs) transition from static tools to fully agentic systems, their potential for transforming social science research has become increasingly evident. This paper introduces a structured framework for understanding the diverse applications of LLM-based agents, ranging from simple data processors to complex, multi-agent systems capable of simulating emergent social dynamics. By mapping this developmental continuum across six levels, the paper clarifies the technical and methodological boundaries between different agentic architectures, providing a comprehensive overview of current capabilities and future potential. It highlights how lower-tier systems streamline conventional tasks like text classification and data annotation, while higher-tier systems enable novel forms of inquiry, including the study of group dynamics, norm formation, and large-scale social processes. However, these advancements also introduce significant challenges, including issues of reproducibility, ethical oversight, and the risk of emergent biases. The paper critically examines these concerns, emphasizing the need for robust validation protocols, interdisciplinary collaboration, and standardized evaluation metrics. It argues that while LLM-based agents hold transformative potential for the social sciences, realizing this promise will require careful, context-sensitive deployment and ongoing methodological refinement. The paper concludes with a call for future research that balances technical innovation with ethical responsibility, encouraging the development of agentic systems that not only replicate but also extend the frontiers of social science, offering new insights into the complexities of human behavior.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 73 of its 154 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
73 of 154 references.
Closest ancestors · 15
Same direction, newest first
- 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulations4 Apr
- 2025Can A Society of Generative Agents Simulate Human Behavior and Inform Public Health Policy? A Case Study on Vaccine Hesitancy12 Mar
- 2025Investigating and Extending Homans' Social Exchange Theory with Large Language Model based Agents18 Feb
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society12 Feb
- 2024Static network structure cannot stabilize cooperation among Large Language Model agents15 Nov
- 2024Designing AI-Agents with Personalities: A Psychometric Approach25 Oct
- 2024GenSim: A General Social Simulation Platform with Large Language Model based Agents6 Oct
- 2024Artificial Leviathan: Exploring Social Evolution of LLM Agents Through the Lens of Hobbesian Social Contract Theory20 Jun
- 2024On the Principles behind Opinion Dynamics in Multi-Agent Systems of Large Language Models18 Jun
- 2024Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents25 Apr
- 2023Do LLM Agents Exhibit Social Behavior?23 Dec
- 2023Simulating Opinion Dynamics with Networks of LLM-based Agents16 Nov
3 more
Other references · 58
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
- 2024Understanding the planning of LLM agents: A surveycited by 414
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
38 more
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 297
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 238
- 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 228
- 2023AutoAgents: A Framework for Automatic Agent Generationcited by 211
- 2023Do LLMs exhibit human-like response biases? A case study in survey designcited by 176
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
- 2025Multi-Agent Risks from Advanced AIcited by 150
- 2023Harms from Increasingly Agentic Algorithmic Systemscited by 134
- 2023Emergent autonomous scientific research capabilities of large language modelscited by 127
- 2024Simulating Classroom Education with LLM-Empowered Agentscited by 125
- 2023On Generative Agents in Recommendationcited by 88
- 2023AgentSims: An Open-Source Sandbox for Large Language Model Evaluationcited by 86
- 2025Can LLMs Replace Human Evaluators? An Empirical Study of LLM-as-a-Judge in Software Engineeringcited by 64
- 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 64
- 2024Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMscited by 59
- 2025LLM Agents for Education: Advances and Applicationscited by 59
- 2024Random Silicon Sampling: Simulating Human Sub-Population Opinion Using a Large Language Model Based on Group-Level Demographic Informationcited by 48
- 2024Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challengescited by 48
- 2024PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agentscited by 28
- 2024Political-LLM: Large Language Models in Political Sciencecited by 27
- 2024CollabStory: Multi-LLM Collaborative Story Generation and Authorship Analysiscited by 26
- 2023Artificial muses: Generative Artificial Intelligence Chatbots Have Risen to Human-Level Creativitycited by 24
- 2023Creative Agents: Empowering Agents with Imagination for Creative Taskscited by 24
- 2023The Machine Psychology of Cooperation: Can GPT models operationalise prompts for altruism, cooperation, competitiveness and selfishness in economic games?cited by 22
- 2025Human-Artificial Interaction in the Age of Agentic AI: A System-Theoretical Approachcited by 22
- 2025Eliciting Language Model Behaviors with Investigator Agentscited by 21
- 2024A social path to human-like artificial intelligencecited by 20
- 2025EduPlanner: LLM-Based Multi-Agent Systems for Customized and Intelligent Instructional Designcited by 18
- 2024Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Reviewcited by 17
- 2024How Teachers Can Use Large Language Models and Bloom's Taxonomy to Create Educational Quizzescited by 17
- 2024Measuring Social Norms of Large Language Modelscited by 16
- 2025MAGI: Multi-Agent Guided Interview for Psychiatric Assessmentcited by 14
- 2023Machine-assisted quantitizing designs: augmenting humanities and social sciences with artificial intelligencecited by 13
- 2023Towards the Scalable Evaluation of Cooperativeness in Language Modelscited by 12
- 2024AI-Driven Virtual Teacher for Enhanced Educational Efficiency: Leveraging Large Pretrain Models for Autonomous Error Analysis and Correctioncited by 12
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 6.
9 papers.
- 2025WOLF: Werewolf-based Observations for LLM Deception and Falsehoodscited by 13
- 2026MoltNet: Understanding Social Behavior of AI Agents in the Agent-Native MoltBookcited by 12
- 2025FACET: Teacher-Centred LLM-Based Multi-Agent Systems-Towards Personalized Educational Worksheetscited by 7
- 2025Neo-Grounded Theory: A Methodological Innovation Integrating High-Dimensional Vector Clustering and Multi-Agent Collaboration for Qualitative Researchcited by 1
- 2026Agentic MIP Research: Accelerated Constraint Handler Generationcited by 1
- 2026Subjective-Graph LLM Agents for Simulating Uncertainty in Classroom Social Perceptioncited by 0
- 2026Behavioral Determinants of Deployed AI Agents in Social Networks: A Multi-Factor Study of Personality, Model, and Guardrail Specificationcited by 0
- 2026The CASE Framework: A Multi-Disciplinary Control Architecture for Governing Enterprise Agentic AIcited by 0
- 2026An Agentic Framework Using Rules and LLMs for Embedding and Annotating Descriptive Document Layouts: A Plant Science Use Casecited by 0
- 2026The CASE Framework: A Multi-Disciplinary Control Architecture for Governing Enterprise Agentic AI10 Aug 2026
- 2026An Agentic Framework Using Rules and LLMs for Embedding and Annotating Descriptive Document Layouts: A Plant Science Use Case19 Jun 2026
- 2026Agentic MIP Research: Accelerated Constraint Handler Generation9 May 2026
- 2026Behavioral Determinants of Deployed AI Agents in Social Networks: A Multi-Factor Study of Personality, Model, and Guardrail Specification8 May 2026
- 2026Subjective-Graph LLM Agents for Simulating Uncertainty in Classroom Social Perception21 Mar 2026
- 2026MoltNet: Understanding Social Behavior of AI Agents in the Agent-Native MoltBook13 Feb 2026
- 2025WOLF: Werewolf-based Observations for LLM Deception and Falsehoods9 Dec 2025
- 2025Neo-Grounded Theory: A Methodological Innovation Integrating High-Dimensional Vector Clustering and Multi-Agent Collaboration for Qualitative Research26 Sep 2025
- 2025FACET: Teacher-Centred LLM-Based Multi-Agent Systems-Towards Personalized Educational Worksheets15 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
- 2025Exploring Large Language Model Agents for Piloting Social Experiments
- 2025Evaluating the Use of Large Language Models as Synthetic Social Agents in Social Science Research
- 2024Sense and Sensitivity: Evaluating the simulation of social dynamics via Large Language Models
- 2025Large Language Models Miss the Multi-Agent Mark
- 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective
- 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View
- 2025From the Fluency Fallacy to the Micro-to-Macro Validity Gap: Opportunities and Pitfalls of LLMs in Social Simulation