Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Computational experiments have emerged as a valuable method for studying complex systems, involving the algorithmization of counterfactuals. However, accurately representing real social systems in Agent-based Modeling (ABM) is challenging due to the diverse and intricate characteristics of humans, including bounded rationality and heterogeneity. To address this limitation, the integration of Large Language Models (LLMs) has been proposed, enabling agents to possess anthropomorphic abilities such as complex reasoning and autonomous learning. These agents, known as LLM-based Agent, offer the potential to enhance the anthropomorphism lacking in ABM. Nonetheless, the absence of explicit explainability in LLMs significantly hinders their application in the social sciences. Conversely, computational experiments excel in providing causal analysis of individual behaviors and complex phenomena. Thus, combining computational experiments with LLM-based Agent holds substantial research potential. This paper aims to present a comprehensive exploration of this fusion. Primarily, it outlines the historical development of agent structures and their evolution into artificial societies, emphasizing their importance in computational experiments. Then it elucidates the advantages that computational experiments and LLM-based Agents offer each other, considering the perspectives of LLM-based Agent for computational experiments and vice versa. Finally, this paper addresses the challenges and future trends in this research domain, offering guidance for subsequent related studies.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 103 of its 287 references that are in the map. First posted on arXiv 1 Feb 2024.
Builds on
103 of 287 references.
Closest ancestors · 7
Same direction, newest first
- 2023LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay23 Oct
- 2023Character-LLM: A Trainable Agent for Role-Playing16 Oct
- 2023Exploring the Intersection of Large Language Models and Agent-Based Modeling via Prompt Engineering14 Aug
- 2023Epidemic Modeling with Generative Agents11 Jul
- 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecture28 Jun
- 2023User Behavior Simulation with Large Language Model based Agents5 Jun
- 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
Other references · 96
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
38 more
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
- 2022Towards Reasoning in Large Language Models: A Surveycited by 593
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
- 2023Cognitive Architectures for Language Agentscited by 422
- 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thoughtcited by 334
- 2023Explainability for Large Language Models: A Surveycited by 331
- 2023Tool Learning with Foundation Modelscited by 302
- 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 300
- 2022Post-hoc Concept Bottleneck Modelscited by 289
- 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
- 2023Self-collaboration Code Generation via ChatGPTcited by 255
- 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 254
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2022Emergent Analogical Reasoning in Large Language Modelscited by 239
- 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 238
- 2018Techniques for Interpretable Machine Learningcited by 237
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 231
50 most cited of 96 All 96 (JSON)
Built on by
Citing papers per year: 2024: 4; 2025: 6; 2026: 1.
11 papers.
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systemscited by 129
- 2025A Survey of Context Engineering for Large Language Modelscited by 120
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networkscited by 110
- 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 86
- 2024A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarioscited by 23
- 2025Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systemscited by 17
- 2025LLM-Based Social Simulations Require a Boundarycited by 11
- 2025Efficient Leave-one-out Approximation in LLM Multi-agent Debate Based on Introspectioncited by 4
- 2025What Makes LLM Agent Simulations Useful for Policy Practice? An Iterative Design Study in Emergency Preparednesscited by 2
- 2025Shall We Play a Game? Language Models for Open-ended Wargamescited by 1
- 2026CAMO: An Agentic Framework for Automated Causal Discovery from Micro Behaviors to Macro Emergence in LLM Agent Simulationscited by 0
- 2026CAMO: An Agentic Framework for Automated Causal Discovery from Micro Behaviors to Macro Emergence in LLM Agent Simulations16 Apr 2026
- 2025What Makes LLM Agent Simulations Useful for Policy Practice? An Iterative Design Study in Emergency Preparedness26 Sep 2025
- 2025Shall We Play a Game? Language Models for Open-ended Wargames21 Sep 2025
- 2025A Survey of Context Engineering for Large Language Models17 Jul 2025
- 2025LLM-Based Social Simulations Require a Boundary24 Jun 2025
- 2025Efficient Leave-one-out Approximation in LLM Multi-agent Debate Based on Introspection28 May 2025
- 2025Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems16 Feb 2025
- 2024A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarios5 Dec 2024
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks15 Oct 2024
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems3 Oct 2024
- 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges15 Jun 2024
Similar, not cited
Close in wording, no citation either way
- 2025Exploring Large Language Model Agents for Piloting Social Experiments
- 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
- 2025Beyond Static Responses: Multi-Agent LLM Systems as a New Paradigm for Social Science Research
- 2025Investigating and Extending Homans' Social Exchange Theory with Large Language Model based Agents
- 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulations
- 2025Computational Basis of LLM's Decision Making in Social Simulation
- 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents
- 2026Collective cooperation without individual fidelity in LLM agents