mlsanityData to 7 Oct 2026

Generative agent-based modeling with actions grounded in physical, social, or digital space using Concordia

arXiv 2312.03664 ↗First posted 6 Dec 2023cs.AI cs.CLcited by 119

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Agent-based modeling has been around for decades, and applied widely across the social and natural sciences. The scope of this research method is now poised to grow dramatically as it absorbs the new affordances provided by Large Language Models (LLM)s. Generative Agent-Based Models (GABM) are not just classic Agent-Based Models (ABM)s where the agents talk to one another. Rather, GABMs are constructed using an LLM to apply common sense to situations, act "reasonably", recall common semantic knowledge, produce API calls to control digital technologies like apps, and communicate both within the simulation and to researchers viewing it from the outside. Here we present Concordia, a library to facilitate constructing and working with GABMs. Concordia makes it easy to construct language-mediated simulations of physically- or digitally-grounded environments. Concordia agents produce their behavior using a flexible component system which mediates between two fundamental operations: LLM calls and associative memory retrieval. A special agent called the Game Master (GM), which was inspired by tabletop role-playing games, is responsible for simulating the environment where the agents interact. Agents take actions by describing what they want to do in natural language. The GM then translates their actions into appropriate implementations. In a simulated physical world, the GM checks the physical plausibility of agent actions and describes their effects. In digital environments simulating technologies such as apps and services, the GM may handle API calls to integrate with external tools such as general AI assistants (e.g., Bard, ChatGPT), and digital apps (e.g., Calendar, Email, Search, etc.). Concordia was designed to support a wide array of applications both in scientific research and for evaluating performance of real digital services by simulating users and/or generating synthetic data.

Key facts. Cited by 119 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 38 of its 133 references that are in the map. First posted on arXiv 6 Dec 2023.

Builds on

38 of 133 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 37

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  6. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  7. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  8. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  9. 2023PaLM 2 Technical Reportcited by 1,154
  10. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
  11. 2021Ethical and social risks of harm from Language Modelscited by 957
  12. 2023Whose Opinions Do Language Models Reflect?cited by 759
25 more
  1. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  2. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  3. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 459
  4. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 350
  5. 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 328
  6. 2023Role-Play with Large Language Modelscited by 290
  7. 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 288
  8. 2018Human-level performance in first-person multiplayer games with population-based deep reinforcement learningcited by 260
  9. 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
  10. 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
  11. 2017Multi-agent Reinforcement Learning in Sequential Social Dilemmascited by 206
  12. 2023Personality Traits in Large Language Modelscited by 166
  13. 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
  14. 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
  15. 2023Large Language Models can Strategically Deceive their Users when Put Under Pressurecited by 132
  16. 2020Syntactic Structure from Deep Learningcited by 99
  17. 2021Scalable Evaluation of Multi-Agent Reinforcement Learning with Melting Potcited by 97
  18. 2017A multi-agent reinforcement learning model of common-pool resource appropriationcited by 68
  19. 2019Autocurricula and the Emergence of Innovation from Social Interaction: A Manifesto for Multi-Agent Intelligence Researchcited by 58
  20. 2023Machine Culturecited by 55
  21. 2023Lyfe Agents: Generative agents for low-cost real-time social interactionscited by 49
  22. 2022Large Language Models can Implement Policy Iterationcited by 31
  23. 2022Emergent Bartering Behaviour in Multi-Agent Reinforcement Learningcited by 18
  24. 2023Framework-Based Qualitative Analysis of Free Responses of Large Language Models: Algorithmic Fidelitycited by 7
  25. 2020Expected Utilitarianismcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 25; 2025: 37; 2026: 56.

119 papers.

Sort:

By area:

  1. 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganographycited by 107
  2. 2024Best Practices and Lessons Learned on Synthetic Datacited by 104
  3. 2024Werewolf Arena: A Case Study in LLM Evaluation via Social Deductioncited by 42
  4. 2024Moral Alignment for LLM Agentscited by 39
  5. 2025The Homogenizing Effect of Large Language Models on Human Expression and Thoughtcited by 35
  6. 2025Consistently Simulating Human Personas with Multi-Turn Reinforcement Learningcited by 35
  7. 2024Simulating Human-like Daily Activities with Desire-driven Autonomycited by 30
  8. 2024Cultural Evolution of Cooperation among LLM Agentscited by 30
  9. 2025CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning taskscited by 30
  10. 2025ARE: Scaling Up Agent Environments and Evaluationscited by 28
  11. 2023A Review of Cooperation in Multi-agent Learningcited by 27
  12. 2024TeachTune: Reviewing Pedagogical Agents Against Diverse Student Profiles with Simulated Studentscited by 25
38 more
  1. 2025Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemmacited by 22
  2. 2026GameDevBench: Evaluating Agentic Capabilities Through Game Developmentcited by 21
  3. 2024On the limits of agency in agent-based modelscited by 20
  4. 2024When LLMs Play the Telephone Game: Cultural Attractors as Conceptual Tools to Evaluate LLMs in Multi-turn Settingscited by 17
  5. 2024Simulacra as Conscious Exoticacited by 16
  6. 2025Risk Analysis Techniques for Governed LLM-based Multi-Agent Systemscited by 16
  7. 2024Evolving AI Collectives to Enhance Human Diversity and Enable Self-Regulationcited by 13
  8. 2024Reflect-RL: Two-Player Online RL Fine-Tuning for LMscited by 13
  9. 2024Cultural evolution in populations of Large Language Modelscited by 12
  10. 2024A Simulation System Towards Solving Societal-Scale Manipulationcited by 12
  11. 2024Boundless Socratic Learning with Language Gamescited by 12
  12. 2025A Pragmatic View of AI Personhoodcited by 12
  13. 2026OpenGame: Open Agentic Coding for Gamescited by 12
  14. 2025Evaluating Generalization Capabilities of LLM-Based Agents in Mixed-Motive Scenarios Using Concordiacited by 11
  15. 2026Conformity and Social Impact on AI Agentscited by 11
  16. 2025SOTOPIA-S4: a user-friendly system for flexible, customizable, and large-scale social simulationcited by 10
  17. 2025Multi-Actor Generative Artificial Intelligence as a Game Enginecited by 8
  18. 2025From the Fluency Fallacy to the Micro-to-Macro Validity Gap: Opportunities and Pitfalls of LLMs in Social Simulationcited by 8
  19. 2026M3-BENCH: Process-Aware Evaluation of LLM Agents' Social Behaviors in Mixed-Motive Gamescited by 8
  20. 2025Playing games with Large language models: Randomness and strategycited by 7
  21. 2025ID-RAG: Identity Retrieval-Augmented Generation for Long-Horizon Persona Coherence in Generative Agentscited by 7
  22. 2026Generative AI collective behavior needs an interactionist paradigmcited by 6
  23. 2024Can Agents Spontaneously Form a Society? Introducing a Novel Architecture for Generative Multi-Agents to Elicit Social Emergencecited by 5
  24. 2024MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Cultural Learningcited by 5
  25. 2024Engagement-Driven Content Generation with Large Language Modelscited by 5
  26. 2025To Mask or to Mirror: Human-AI Alignment in Collective Reasoningcited by 5
  27. 2026Architectural Design, Not Only Model Intelligence, Governs Multi-Agent LLM Performancecited by 5
  28. 2026MatrAIx: Simulating the World with 8.3 Billion Persona Agentscited by 5
  29. 2024Multi-agent cooperation through learning-aware policy gradientscited by 4
  30. 2025Sleepless Nights, Sugary Days: Creating Synthetic Users with Health Conditions for Realistic Coaching Agent Interactionscited by 4
  31. 2025RoleConflictBench: A Benchmark of Role Conflict Scenarios for Evaluating LLMs' Contextual Sensitivitycited by 4
  32. 2026Identity, Cooperation and Framing Effects within Groups of Real and Simulated Humanscited by 4
  33. 2026Social physics in the age of artificial intelligencecited by 4
  34. 2024TraderTalk: An LLM Behavioural ABM applied to Simulating Human Bilateral Trading Interactionscited by 3
  35. 2025The Influence of Human-inspired Agentic Sophistication in LLM-driven Strategic Reasonerscited by 3
  36. 2025Wrong Face, Wrong Move: The Social Dynamics of Emotion Misperception in Agent-Based Modelscited by 3
  37. 2025Agent-Kernel: A MicroKernel Multi-Agent System Framework for Adaptive Social Simulation Powered by LLMscited by 3
  38. 2026Evaluating Cooperation in LLM Social Groups through Elected Leadershipcited by 3

50 most cited of 119 All 119 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulations
  2. 2024A Survey on Large Language Model-Based Game Agents
  3. 2023Generative Agent-Based Modeling: Unveiling Social System Dynamics through Coupling Mechanistic Models with Generative Artificial Intelligence
  4. 2024Generative Agents for Multi-Agent Autoformalization of Interaction Scenarios
  5. 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
  6. 2023Exploring the Intersection of Large Language Models and Agent-Based Modeling via Prompt Engineering
  7. 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulations
  8. 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chat