Generative agent-based modeling with actions grounded in physical, social, or digital space using Concordia
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Agent-based modeling has been around for decades, and applied widely across the social and natural sciences. The scope of this research method is now poised to grow dramatically as it absorbs the new affordances provided by Large Language Models (LLM)s. Generative Agent-Based Models (GABM) are not just classic Agent-Based Models (ABM)s where the agents talk to one another. Rather, GABMs are constructed using an LLM to apply common sense to situations, act "reasonably", recall common semantic knowledge, produce API calls to control digital technologies like apps, and communicate both within the simulation and to researchers viewing it from the outside. Here we present Concordia, a library to facilitate constructing and working with GABMs. Concordia makes it easy to construct language-mediated simulations of physically- or digitally-grounded environments. Concordia agents produce their behavior using a flexible component system which mediates between two fundamental operations: LLM calls and associative memory retrieval. A special agent called the Game Master (GM), which was inspired by tabletop role-playing games, is responsible for simulating the environment where the agents interact. Agents take actions by describing what they want to do in natural language. The GM then translates their actions into appropriate implementations. In a simulated physical world, the GM checks the physical plausibility of agent actions and describes their effects. In digital environments simulating technologies such as apps and services, the GM may handle API calls to integrate with external tools such as general AI assistants (e.g., Bard, ChatGPT), and digital apps (e.g., Calendar, Email, Search, etc.). Concordia was designed to support a wide array of applications both in scientific research and for evaluating performance of real digital services by simulating users and/or generating synthetic data.
Key facts. Cited by 119 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 38 of its 133 references that are in the map. First posted on arXiv 6 Dec 2023.
Builds on
38 of 133 references.
Closest ancestors · 1
Same direction, newest first
Other references · 37
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023PaLM 2 Technical Reportcited by 1,154
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2023Whose Opinions Do Language Models Reflect?cited by 759
25 more
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 459
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 350
- 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 328
- 2023Role-Play with Large Language Modelscited by 290
- 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 288
- 2018Human-level performance in first-person multiplayer games with population-based deep reinforcement learningcited by 260
- 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
- 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
- 2017Multi-agent Reinforcement Learning in Sequential Social Dilemmascited by 206
- 2023Personality Traits in Large Language Modelscited by 166
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
- 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
- 2023Large Language Models can Strategically Deceive their Users when Put Under Pressurecited by 132
- 2020Syntactic Structure from Deep Learningcited by 99
- 2021Scalable Evaluation of Multi-Agent Reinforcement Learning with Melting Potcited by 97
- 2017A multi-agent reinforcement learning model of common-pool resource appropriationcited by 68
- 2019Autocurricula and the Emergence of Innovation from Social Interaction: A Manifesto for Multi-Agent Intelligence Researchcited by 58
- 2023Machine Culturecited by 55
- 2023Lyfe Agents: Generative agents for low-cost real-time social interactionscited by 49
- 2022Large Language Models can Implement Policy Iterationcited by 31
- 2022Emergent Bartering Behaviour in Multi-Agent Reinforcement Learningcited by 18
- 2023Framework-Based Qualitative Analysis of Free Responses of Large Language Models: Algorithmic Fidelitycited by 7
- 2020Expected Utilitarianismcited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 25; 2025: 37; 2026: 56.
119 papers.
Sort:
By area:
- 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganographycited by 107
- 2024Best Practices and Lessons Learned on Synthetic Datacited by 104
- 2024Werewolf Arena: A Case Study in LLM Evaluation via Social Deductioncited by 42
- 2024Moral Alignment for LLM Agentscited by 39
- 2025The Homogenizing Effect of Large Language Models on Human Expression and Thoughtcited by 35
- 2025Consistently Simulating Human Personas with Multi-Turn Reinforcement Learningcited by 35
- 2024Simulating Human-like Daily Activities with Desire-driven Autonomycited by 30
- 2024Cultural Evolution of Cooperation among LLM Agentscited by 30
- 2025CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning taskscited by 30
- 2025ARE: Scaling Up Agent Environments and Evaluationscited by 28
- 2023A Review of Cooperation in Multi-agent Learningcited by 27
- 2024TeachTune: Reviewing Pedagogical Agents Against Diverse Student Profiles with Simulated Studentscited by 25
38 more
- 2025Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemmacited by 22
- 2026GameDevBench: Evaluating Agentic Capabilities Through Game Developmentcited by 21
- 2024On the limits of agency in agent-based modelscited by 20
- 2024When LLMs Play the Telephone Game: Cultural Attractors as Conceptual Tools to Evaluate LLMs in Multi-turn Settingscited by 17
- 2024Simulacra as Conscious Exoticacited by 16
- 2025Risk Analysis Techniques for Governed LLM-based Multi-Agent Systemscited by 16
- 2024Evolving AI Collectives to Enhance Human Diversity and Enable Self-Regulationcited by 13
- 2024Reflect-RL: Two-Player Online RL Fine-Tuning for LMscited by 13
- 2024Cultural evolution in populations of Large Language Modelscited by 12
- 2024A Simulation System Towards Solving Societal-Scale Manipulationcited by 12
- 2024Boundless Socratic Learning with Language Gamescited by 12
- 2025A Pragmatic View of AI Personhoodcited by 12
- 2026OpenGame: Open Agentic Coding for Gamescited by 12
- 2025Evaluating Generalization Capabilities of LLM-Based Agents in Mixed-Motive Scenarios Using Concordiacited by 11
- 2026Conformity and Social Impact on AI Agentscited by 11
- 2025SOTOPIA-S4: a user-friendly system for flexible, customizable, and large-scale social simulationcited by 10
- 2025Multi-Actor Generative Artificial Intelligence as a Game Enginecited by 8
- 2025From the Fluency Fallacy to the Micro-to-Macro Validity Gap: Opportunities and Pitfalls of LLMs in Social Simulationcited by 8
- 2026M3-BENCH: Process-Aware Evaluation of LLM Agents' Social Behaviors in Mixed-Motive Gamescited by 8
- 2025Playing games with Large language models: Randomness and strategycited by 7
- 2025ID-RAG: Identity Retrieval-Augmented Generation for Long-Horizon Persona Coherence in Generative Agentscited by 7
- 2026Generative AI collective behavior needs an interactionist paradigmcited by 6
- 2024Can Agents Spontaneously Form a Society? Introducing a Novel Architecture for Generative Multi-Agents to Elicit Social Emergencecited by 5
- 2024MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Cultural Learningcited by 5
- 2024Engagement-Driven Content Generation with Large Language Modelscited by 5
- 2025To Mask or to Mirror: Human-AI Alignment in Collective Reasoningcited by 5
- 2026Architectural Design, Not Only Model Intelligence, Governs Multi-Agent LLM Performancecited by 5
- 2026MatrAIx: Simulating the World with 8.3 Billion Persona Agentscited by 5
- 2024Multi-agent cooperation through learning-aware policy gradientscited by 4
- 2025Sleepless Nights, Sugary Days: Creating Synthetic Users with Health Conditions for Realistic Coaching Agent Interactionscited by 4
- 2025RoleConflictBench: A Benchmark of Role Conflict Scenarios for Evaluating LLMs' Contextual Sensitivitycited by 4
- 2026Identity, Cooperation and Framing Effects within Groups of Real and Simulated Humanscited by 4
- 2026Social physics in the age of artificial intelligencecited by 4
- 2024TraderTalk: An LLM Behavioural ABM applied to Simulating Human Bilateral Trading Interactionscited by 3
- 2025The Influence of Human-inspired Agentic Sophistication in LLM-driven Strategic Reasonerscited by 3
- 2025Wrong Face, Wrong Move: The Social Dynamics of Emotion Misperception in Agent-Based Modelscited by 3
- 2025Agent-Kernel: A MicroKernel Multi-Agent System Framework for Adaptive Social Simulation Powered by LLMscited by 3
- 2026Evaluating Cooperation in LLM Social Groups through Elected Leadershipcited by 3
50 most cited of 119 All 119 (JSON)
- 2026Workerville: Towards an Organizational Behavior Account of Agent Safety8 Oct 2026
- 2026NextMe-800: Anticipating Personal Behavior from Months of Egocentric Video1 Oct 2026
- 2026Auditing Action Settlement in LLM Agent Environments: Order, Progress, and Replay1 Oct 2026
- 2026SocioVerse2: A Longitudinal Dynamic Social Simulation Framework under a Human-AI Co-evolutionary Paradigm21 Sep 2026
- 2026From Certain Doom to Survival: Agent-Driven Self-Governance in LLM Agent Societies18 Sep 2026
- 2026Verifiable Social Reasoning for LLM Assistants15 Sep 2026
- 2026ANIMASK: What the Model Contributes to Role Play in Simulated Story Worlds15 Sep 2026
- 2026Where Reliability Lives: Experimental Localisation of Behavioural Properties in an Agent System2 Sep 2026
- 2026Classic AI Scaffolding for LLM Social Agents1 Sep 2026
- 2026Benchmarking large language model agent societies against human behavioural distributions28 Aug 2026
- 2026Probing Perceptual Priors of MLLMs via Gibbs Sampling with Interpretable Generative Controls27 Aug 2026
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
38 more
- 2026Minimal Local Simulation Foundations for LLM- and VLM-Driven Agents in 2D and 3D Environments24 Aug 2026
- 2026MicroVerse: An Instrument for Measuring Self-Authored Identity Drift in Long-Horizon Multi-Agent Language-Model Simulations16 Aug 2026
- 2026Evaluating Rational Contracting in Natural Language11 Aug 2026
- 2026MatrAIx: Simulating the World with 8.3 Billion Persona Agents4 Aug 2026
- 2026Emulate or Estimate? The Divergent Strengths of Base and Post-Trained Language Models for Opinion Simulation4 Aug 2026
- 2026Agentic Commerce World: An Auditable and Verifiable Environment for Vibe Commerce3 Aug 2026
- 2026No One Wins in Nuclear War: A Social Simulation of Military Decision-making3 Aug 2026
- 2026Artificial Intelligence and Modeling & Simulation: An Overview1 Aug 2026
- 2026How Affect Propagates among LLM Agents: Emergent Emotional Contagion in Crowd Simulation27 Jul 2026
- 2026Role differentiation as ignition of a collective information engine: Structuration in Agent Populations26 Jul 2026
- 2026Distribution-First Population Simulation: Collapse, Calibration, and Recall in Non-WEIRD LLM Persona Modeling17 Jul 2026
- 2026LLM-powered reasoning in agent-based modeling7 Jul 2026
- 2026AgoraSim: A Hybrid Agent-Based Modeling Framework7 Jul 2026
- 2026Where Knowledge and Authority Sit Changes What an Agent Benchmark Can Resolve3 Jul 2026
- 2026SidConArena: An Environment Evaluating Agents in Open-Ended,Positive-Sum Bargaining Game24 Jun 2026
- 2026When Is Emergent Consensus Real? A Measured Coupling Gain and a Validity Diagnostic for LLM Agent Societies20 Jun 2026
- 2026Human-Simulation Interaction: From Prediction to Exploration in LLM Agent Simulations for Policy17 Jun 2026
- 2026ForecastBench-Sim: A Simulated-World Forecasting Benchmark17 Jun 2026
- 2026Online Agent-as-a-Judge: Situation-Generating Evaluation for Interactive Agents6 Jun 2026
- 2026EduMirror: Modeling Educational Social Dynamics with Value-driven Multi-agent Simulation6 Jun 2026
- 2026AURA: Intent-Directed Probing for Implicit-Need Surfacing in Situated LLM Agents4 Jun 2026
- 2026Solipsistic Superintelligence is Unlikely to be Cooperative2 Jun 2026
- 2026Position: Behavioral Systems Require Behavioral Tests31 May 2026
- 2026Can LLM Agents Sustain Long-Horizon Organizational Dynamics?31 May 2026
- 2026Healthcare Mechanisms from Policy-as-Code Search under Strategic Provider Response29 May 2026
- 2026Bosses, Kings, and the Commons: Cooperation Under Power Asymmetry in LLM Societies27 May 2026
- 2026APS: Bias-Controlled Adaptive Prototype Simulation for Population-Scale LLM Agents19 May 2026
- 2026The textitSilicon Society Cookbook: Design Space of LLM-based Social Simulations30 Apr 2026
- 2026OpenGame: Open Agentic Coding for Games20 Apr 2026
- 2026Evaluating Cooperation in LLM Social Groups through Elected Leadership13 Apr 2026
- 2026Stabilising Generative Models of Attitude Change2 Apr 2026
- 2026Soft-Label Governance for Distributional Safety in Multi-Agent Systems19 Mar 2026
- 2026I Can't Believe It's Corrupt: Evaluating Corruption in Multi-Agent Governance Systems19 Mar 2026
- 2026Social physics in the age of artificial intelligence4 Mar 2026
- 2026Cognitive Models and AI Algorithms Provide Templates for Designing Language Agents26 Feb 2026
- 2026GameDevBench: Evaluating Agentic Capabilities Through Game Development11 Feb 2026
- 2026Declarative by Design, Assistable Only by Convention: Benchmarking Multi-Agent Frameworks for AI-Assistability3 Feb 2026
- 2026Persona Generators: Generating Diverse Synthetic Personas for Arbitrary Contexts3 Feb 2026
50 newest of 119 All 119 (JSON)
- 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganographycited by 107
- 2024Moral Alignment for LLM Agentscited by 39
- 2024Cultural Evolution of Cooperation among LLM Agentscited by 30
- 2025ARE: Scaling Up Agent Environments and Evaluationscited by 28
- 2024TeachTune: Reviewing Pedagogical Agents Against Diverse Student Profiles with Simulated Studentscited by 25
- 2025Will Systems of LLM Agents Cooperate: An Investigation into a Social Dilemmacited by 22
- 2026GameDevBench: Evaluating Agentic Capabilities Through Game Developmentcited by 21
- 2024On the limits of agency in agent-based modelscited by 20
- 2025Risk Analysis Techniques for Governed LLM-based Multi-Agent Systemscited by 16
- 2025A Pragmatic View of AI Personhoodcited by 12
- 2026OpenGame: Open Agentic Coding for Gamescited by 12
- 2025Evaluating Generalization Capabilities of LLM-Based Agents in Mixed-Motive Scenarios Using Concordiacited by 11
12 most cited of 57 All 57 (JSON)
- 2026Auditing Action Settlement in LLM Agent Environments: Order, Progress, and Replay1 Oct 2026
- 2026SocioVerse2: A Longitudinal Dynamic Social Simulation Framework under a Human-AI Co-evolutionary Paradigm21 Sep 2026
- 2026From Certain Doom to Survival: Agent-Driven Self-Governance in LLM Agent Societies18 Sep 2026
- 2026Where Reliability Lives: Experimental Localisation of Behavioural Properties in an Agent System2 Sep 2026
- 2026Classic AI Scaffolding for LLM Social Agents1 Sep 2026
- 2026Benchmarking large language model agent societies against human behavioural distributions28 Aug 2026
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
- 2026MicroVerse: An Instrument for Measuring Self-Authored Identity Drift in Long-Horizon Multi-Agent Language-Model Simulations16 Aug 2026
- 2026MatrAIx: Simulating the World with 8.3 Billion Persona Agents4 Aug 2026
- 2026Agentic Commerce World: An Auditable and Verifiable Environment for Vibe Commerce3 Aug 2026
- 2026How Affect Propagates among LLM Agents: Emergent Emotional Contagion in Crowd Simulation27 Jul 2026
- 2026AgoraSim: A Hybrid Agent-Based Modeling Framework7 Jul 2026
12 newest of 57 All 57 (JSON)
- 2025The Homogenizing Effect of Large Language Models on Human Expression and Thoughtcited by 35
- 2025CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning taskscited by 30
- 2025To Mask or to Mirror: Human-AI Alignment in Collective Reasoningcited by 5
- 2025The Influence of Human-inspired Agentic Sophistication in LLM-driven Strategic Reasonerscited by 3
- 2025Doing Things with Words: Rethinking Theory of Mind Simulation in Large Language Modelscited by 1
- 2025Understanding Human Limits in Pattern Recognition: A Computational Model of Sequential Reasoning in Rock, Paper, Scissorscited by 0
- 2026LLM-powered reasoning in agent-based modelingcited by 0
- 2026Verifiable Social Reasoning for LLM Assistantscited by 0
- 2026Verifiable Social Reasoning for LLM Assistants15 Sep 2026
- 2026LLM-powered reasoning in agent-based modeling7 Jul 2026
- 2025Doing Things with Words: Rethinking Theory of Mind Simulation in Large Language Models15 Oct 2025
- 2025To Mask or to Mirror: Human-AI Alignment in Collective Reasoning2 Oct 2025
- 2025The Homogenizing Effect of Large Language Models on Human Expression and Thought2 Aug 2025
- 2025CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning tasks31 Jul 2025
- 2025Understanding Human Limits in Pattern Recognition: A Computational Model of Sequential Reasoning in Rock, Paper, Scissors25 Jul 2025
- 2025The Influence of Human-inspired Agentic Sophistication in LLM-driven Strategic Reasoners14 May 2025
- 2024Best Practices and Lessons Learned on Synthetic Datacited by 104
- 2024Best Practices and Lessons Learned on Synthetic Data11 Apr 2024
- 2024Werewolf Arena: A Case Study in LLM Evaluation via Social Deductioncited by 42
- 2025Consistently Simulating Human Personas with Multi-Turn Reinforcement Learningcited by 35
- 2024Simulating Human-like Daily Activities with Desire-driven Autonomycited by 30
- 2023A Review of Cooperation in Multi-agent Learningcited by 27
- 2024When LLMs Play the Telephone Game: Cultural Attractors as Conceptual Tools to Evaluate LLMs in Multi-turn Settingscited by 17
- 2024Simulacra as Conscious Exoticacited by 16
- 2024Evolving AI Collectives to Enhance Human Diversity and Enable Self-Regulationcited by 13
- 2024Reflect-RL: Two-Player Online RL Fine-Tuning for LMscited by 13
- 2024Cultural evolution in populations of Large Language Modelscited by 12
- 2024A Simulation System Towards Solving Societal-Scale Manipulationcited by 12
- 2024Boundless Socratic Learning with Language Gamescited by 12
- 2025Multi-Actor Generative Artificial Intelligence as a Game Enginecited by 8
12 most cited of 51 All 51 (JSON)
- 2026Workerville: Towards an Organizational Behavior Account of Agent Safety8 Oct 2026
- 2026NextMe-800: Anticipating Personal Behavior from Months of Egocentric Video1 Oct 2026
- 2026ANIMASK: What the Model Contributes to Role Play in Simulated Story Worlds15 Sep 2026
- 2026Probing Perceptual Priors of MLLMs via Gibbs Sampling with Interpretable Generative Controls27 Aug 2026
- 2026Evaluating Rational Contracting in Natural Language11 Aug 2026
- 2026Emulate or Estimate? The Divergent Strengths of Base and Post-Trained Language Models for Opinion Simulation4 Aug 2026
- 2026No One Wins in Nuclear War: A Social Simulation of Military Decision-making3 Aug 2026
- 2026Artificial Intelligence and Modeling & Simulation: An Overview1 Aug 2026
- 2026Role differentiation as ignition of a collective information engine: Structuration in Agent Populations26 Jul 2026
- 2026Distribution-First Population Simulation: Collapse, Calibration, and Recall in Non-WEIRD LLM Persona Modeling17 Jul 2026
- 2026ForecastBench-Sim: A Simulated-World Forecasting Benchmark17 Jun 2026
- 2026Solipsistic Superintelligence is Unlikely to be Cooperative2 Jun 2026
12 newest of 51 All 51 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulations
- 2024A Survey on Large Language Model-Based Game Agents
- 2023Generative Agent-Based Modeling: Unveiling Social System Dynamics through Coupling Mechanistic Models with Generative Artificial Intelligence
- 2024Generative Agents for Multi-Agent Autoformalization of Interaction Scenarios
- 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
- 2023Exploring the Intersection of Large Language Models and Agent-Based Modeling via Prompt Engineering
- 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulations
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chat