mlsanityData to 7 Oct 2026

Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective

arXiv 2402.00262 ↗First posted 1 Feb 2024cs.AIcited by 11

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Computational experiments have emerged as a valuable method for studying complex systems, involving the algorithmization of counterfactuals. However, accurately representing real social systems in Agent-based Modeling (ABM) is challenging due to the diverse and intricate characteristics of humans, including bounded rationality and heterogeneity. To address this limitation, the integration of Large Language Models (LLMs) has been proposed, enabling agents to possess anthropomorphic abilities such as complex reasoning and autonomous learning. These agents, known as LLM-based Agent, offer the potential to enhance the anthropomorphism lacking in ABM. Nonetheless, the absence of explicit explainability in LLMs significantly hinders their application in the social sciences. Conversely, computational experiments excel in providing causal analysis of individual behaviors and complex phenomena. Thus, combining computational experiments with LLM-based Agent holds substantial research potential. This paper aims to present a comprehensive exploration of this fusion. Primarily, it outlines the historical development of agent structures and their evolution into artificial societies, emphasizing their importance in computational experiments. Then it elucidates the advantages that computational experiments and LLM-based Agents offer each other, considering the perspectives of LLM-based Agent for computational experiments and vice versa. Finally, this paper addresses the challenges and future trends in this research domain, offering guidance for subsequent related studies.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 103 of its 287 references that are in the map. First posted on arXiv 1 Feb 2024.

Builds on

103 of 287 references.

Closest ancestors · 7

Same direction, newest first

  1. 2023LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay23 Oct
  2. 2023Character-LLM: A Trainable Agent for Role-Playing16 Oct
  3. 2023Exploring the Intersection of Large Language Models and Agent-Based Modeling via Prompt Engineering14 Aug
  4. 2023Epidemic Modeling with Generative Agents11 Jul
  5. 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecture28 Jun
  6. 2023User Behavior Simulation with Large Language Model based Agents5 Jun
  7. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 96

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  7. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  8. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  9. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  10. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  11. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  12. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
38 more
  1. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  2. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  3. 2022Emergent Abilities of Large Language Modelscited by 2,483
  4. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  5. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  6. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  7. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  8. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  9. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  10. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  11. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  12. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  13. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  14. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  15. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  16. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  17. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  18. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
  19. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  20. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  21. 2022Towards Reasoning in Large Language Models: A Surveycited by 593
  22. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
  23. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
  24. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
  25. 2023Cognitive Architectures for Language Agentscited by 422
  26. 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thoughtcited by 334
  27. 2023Explainability for Large Language Models: A Surveycited by 331
  28. 2023Tool Learning with Foundation Modelscited by 302
  29. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 300
  30. 2022Post-hoc Concept Bottleneck Modelscited by 289
  31. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
  32. 2023Self-collaboration Code Generation via ChatGPTcited by 255
  33. 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 254
  34. 2023Can Large Language Models Transform Computational Social Science?cited by 245
  35. 2022Emergent Analogical Reasoning in Large Language Modelscited by 239
  36. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 238
  37. 2018Techniques for Interpretable Machine Learningcited by 237
  38. 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 231

50 most cited of 96 All 96 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 6; 2026: 1.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Exploring Large Language Model Agents for Piloting Social Experiments
  2. 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
  3. 2025Beyond Static Responses: Multi-Agent LLM Systems as a New Paradigm for Social Science Research
  4. 2025Investigating and Extending Homans' Social Exchange Theory with Large Language Model based Agents
  5. 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulations
  6. 2025Computational Basis of LLM's Decision Making in Social Simulation
  7. 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents
  8. 2026Collective cooperation without individual fidelity in LLM agents