MAgent: A Many-Agent Reinforcement Learning Platform for Artificial Collective Intelligence
Not on the map. Why?
Abstract (arXiv)
We introduce MAgent, a platform to support research and development of many-agent reinforcement learning. Unlike previous research platforms on single or multi-agent reinforcement learning, MAgent focuses on supporting the tasks and the applications that require hundreds to millions of agents. Within the interactions among a population of agents, it enables not only the study of learning algorithms for agents' optimal polices, but more importantly, the observation and understanding of individual agent's behaviors and social phenomena emerging from the AI society, including communication languages, leaderships, altruism. MAgent is highly scalable and can host up to one million agents on a single GPU server. MAgent also provides flexible configurations for AI researchers to design their customized environments and agents. In this demo, we present three environments designed on MAgent and show emerged collective intelligence by learning from scratch.
Key facts. Cited by 69 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 18; 2023: 14; 2024: 7; 2025: 13; 2026: 7.
69 papers.
Sort:
By area:
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 71
- 2022VMAS: A Vectorized Multi-Agent Simulator for Collective Robot Learningcited by 63
- 2021UPDeT: Universal Multi-agent Reinforcement Learning via Policy Decoupling with Transformerscited by 39
- 2022Multi-agent Dynamic Algorithm Configurationcited by 36
- 2023Multi-agent Reinforcement Learning: A Comprehensive Surveycited by 30
- 2022MARLlib: A Scalable and Efficient Multi-agent Reinforcement Learning Librarycited by 21
- 2024POGEMA: A Benchmark Platform for Cooperative Multi-Agent Pathfindingcited by 20
- 2024AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Makingcited by 19
- 2021Collaborative Visual Navigationcited by 18
- 2022Influencing Long-Term Behavior in Multiagent Reinforcement Learningcited by 18
- 2021The Neural MMO Platform for Massively Multiagent Researchcited by 17
- 2022An Introduction to Multi-Agent Reinforcement Learning and Review of its Application to Autonomous Mobilitycited by 16
38 more
- 2022RoMFAC: A robust mean-field actor-critic reinforcement learning against adversarial perturbations on statescited by 16
- 2024FightLadder: A Benchmark for Competitive Multi-Agent Reinforcement Learningcited by 13
- 2022A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learningcited by 12
- 2024Emergent Language: A Survey and Taxonomycited by 12
- 2022Policy Diagnosis via Measuring Role Diversity in Cooperative Multi-agent RLcited by 11
- 2022Individual-Level Inverse Reinforcement Learning for Mean Field Gamescited by 10
- 2022Stateful active facilitator: Coordination and Environmental Heterogeneity in Cooperative Multi-Agent Reinforcement Learningcited by 10
- 2022Concentration Network for Reinforcement Learning of Large-Scale Multi-Agent Systemscited by 7
- 2023Partially Observable Mean Field Multi-Agent Reinforcement Learning Based on Graph-Attentioncited by 7
- 2025Exponential Topology-enabled Scalable Communication in Multi-agent Reinforcement Learningcited by 7
- 2022POGEMA: Partially Observable Grid Environment for Multiple Agentscited by 6
- 2023Learning Decentralized Partially Observable Mean Field Control for Artificial Collective Behaviorcited by 6
- 2023Fictitious Cross-Play: Learning Global Nash Equilibrium in Mixed Cooperative-Competitive Gamescited by 6
- 2025Rethinking Agent Design: From Top-Down Workflows to Bottom-Up Skill Evolutioncited by 6
- 2023XuanCe: A Comprehensive and Unified Deep Reinforcement Learning Librarycited by 5
- 2025An Extended Benchmarking of Multi-Agent Reinforcement Learning Algorithms in Complex Fully Cooperative Taskscited by 5
- 2021Learning to Share in Multi-Agent Reinforcement Learningcited by 4
- 2026Holos: A Web-Scale LLM-Based Multi-Agent System for the Agentic Webcited by 4
- 2023Emergent collective intelligence from massive-agent cooperation and competitioncited by 3
- 2023Artificial Collective Intelligence Engineering: a Survey of Concepts and Perspectivescited by 3
- 2023Selectively Sharing Experiences Improves Multi-Agent Reinforcement Learningcited by 3
- 2022Toward multi-target self-organizing pursuit in a partially observable Markov gamecited by 2
- 2022Collective Intelligence for 2D Push Manipulations with Mobile Robotscited by 2
- 2023SEA: A Spatially Explicit Architecture for Multi-Agent Reinforcement Learningcited by 2
- 2023Seeking Next Layer Neurons' Attention for Error-Backpropagation-Like Training in a Multi-Agent Network Frameworkcited by 2
- 2021Structured Diversification Emergence via Reinforced Organization Control and Hierarchical Consensus Learningcited by 1
- 2021A Microscopic Pandemic Simulator for Pandemic Prediction Using Scalable Million-Agent Reinforcement Learningcited by 1
- 2021Soft Hierarchical Graph Recurrent Networks for Many-Agent Partially Observable Environmentscited by 1
- 2022A Policy Resonance Approach to Solve the Problem of Responsibility Diffusion in Multiagent Reinforcement Learningcited by 1
- 2022Learning Heterogeneous Agent Cooperation via Multiagent League Trainingcited by 1
- 2023Diverse Policy Optimization for Structured Action Spacecited by 1
- 2024GTDE: Grouped Training with Decentralized Execution for Multi-agent Actor-Criticcited by 1
- 2025Learning to Lead Themselves: Agentic AI in MAS using MARLcited by 1
- 2025The Emergence of Complex Behavior in Large-Scale Ecological Environmentscited by 1
- 2026Superminds Test: Actively Evaluating Collective Intelligence of Agent Society via Probing Agentscited by 1
- 2021The AI Arena: A Framework for Distributed Multi-Agent Reinforcement Learningcited by 0
- 2021Foresight of Graph Reinforcement Learning Latent Permutations Learnt by Gumbel Sinkhorn Networkcited by 0
- 2022PooL: Pheromone-inspired Communication Framework forLarge Scale Multi-Agent Reinforcement Learningcited by 0
50 most cited of 69 All 69 (JSON)
- 2026Heterogeneous Information-Bottleneck Coordination Graphs for Multi-Agent Reinforcement Learning17 May 2026
- 2026Superminds Test: Actively Evaluating Collective Intelligence of Agent Society via Probing Agents24 Apr 2026
- 2026From Pixels to Digital Agents: An Empirical Study on the Taxonomy and Technological Trends of Reinforcement Learning Environments25 Mar 2026
- 2026SCoUT: Scalable Communication via Utility-Guided Temporal Grouping in Multi-Agent Reinforcement Learning5 Mar 2026
- 2026TABX: A High-Throughput Sandbox Battle Simulator for Multi-Agent Reinforcement Learning2 Feb 2026
- 2026Explicit Credit Assignment through Local Rewards and Dependence Graphs in Multi-Agent Reinforcement Learning29 Jan 2026
- 2026Holos: A Web-Scale LLM-Based Multi-Agent System for the Agentic Web18 Jan 2026
- 2025StarCraft+: Benchmarking Multi-agent Algorithms in Adversary Paradigm18 Dec 2025
- 2025The Emergence of Complex Behavior in Large-Scale Ecological Environments21 Oct 2025
- 2025Learning to Lead Themselves: Agentic AI in MAS using MARL24 Sep 2025
- 2025Vulnerable Agent Identification in Large-Scale Multi-Agent Reinforcement Learning18 Sep 2025
- 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Review14 Jul 2025
38 more
- 2025Dynamic Strategy Adaptation in Multi-Agent Environments with Large Language Models1 Jul 2025
- 2025A MARL-based Approach for Easing MAS Organization Engineering5 Jun 2025
- 2025Rethinking Agent Design: From Top-Down Workflows to Bottom-Up Skill Evolution23 May 2025
- 2025Integration of TinyML and LargeML: A Survey of 6G and Beyond20 May 2025
- 2025Bi-level Mean Field: Dynamic Grouping for Large-Scale MARL10 May 2025
- 2025Exponential Topology-enabled Scalable Communication in Multi-agent Reinforcement Learning27 Feb 2025
- 2025Causal Mean Field Multi-Agent Reinforcement Learning20 Feb 2025
- 2025An Extended Benchmarking of Multi-Agent Reinforcement Learning Algorithms in Complex Fully Cooperative Tasks7 Feb 2025
- 2024GTDE: Grouped Training with Decentralized Execution for Multi-agent Actor-Critic12 Dec 2024
- 2024AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Making6 Nov 2024
- 2024Computing Ex Ante Equilibrium in Heterogeneous Zero-Sum Team Games2 Oct 2024
- 2024Emergent Language: A Survey and Taxonomy4 Sep 2024
- 2024POGEMA: A Benchmark Platform for Cooperative Multi-Agent Pathfinding20 Jul 2024
- 2024FightLadder: A Benchmark for Competitive Multi-Agent Reinforcement Learning4 Jun 2024
- 2024Prioritized League Reinforcement Learning for Large-Scale Heterogeneous Multiagent Systems26 Mar 2024
- 2023XuanCe: A Comprehensive and Unified Deep Reinforcement Learning Library25 Dec 2023
- 2023Multi-agent Reinforcement Learning: A Comprehensive Survey15 Dec 2023
- 2023Selectively Sharing Experiences Improves Multi-Agent Reinforcement Learning1 Nov 2023
- 2023Seeking Next Layer Neurons' Attention for Error-Backpropagation-Like Training in a Multi-Agent Network Framework15 Oct 2023
- 2023Fictitious Cross-Play: Learning Global Nash Equilibrium in Mixed Cooperative-Competitive Games5 Oct 2023
- 2023Learning Decentralized Partially Observable Mean Field Control for Artificial Collective Behavior12 Jul 2023
- 2023Networked Communication for Decentralised Agents in Mean-Field Games5 Jun 2023
- 2023Latent Interactive A2C for Improved RL in Open Many-Agent Systems9 May 2023
- 2023Partially Observable Mean Field Multi-Agent Reinforcement Learning Based on Graph-Attention25 Apr 2023
- 2023SEA: A Spatially Explicit Architecture for Multi-Agent Reinforcement Learning25 Apr 2023
- 2023Artificial Collective Intelligence Engineering: a Survey of Concepts and Perspectives11 Apr 2023
- 2023Diverse Policy Optimization for Structured Action Space23 Feb 2023
- 2023Adaptive Value Decomposition with Greedy Marginal Contribution Computation for Cooperative Multi-Agent Reinforcement Learning14 Feb 2023
- 2023Emergent collective intelligence from massive-agent cooperation and competition4 Jan 2023
- 2022Collective Intelligence for 2D Push Manipulations with Mobile Robots28 Nov 2022
- 2022Learning Heterogeneous Agent Cooperation via Multiagent League Training13 Nov 2022
- 2022Multi-agent Dynamic Algorithm Configuration13 Oct 2022
- 2022MARLlib: A Scalable and Efficient Multi-agent Reinforcement Learning Library11 Oct 2022
- 2022Stateful active facilitator: Coordination and Environmental Heterogeneity in Cooperative Multi-Agent Reinforcement Learning4 Oct 2022
- 2022A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learning8 Sep 2022
- 2022A Policy Resonance Approach to Solve the Problem of Responsibility Diffusion in Multiagent Reinforcement Learning16 Aug 2022
- 2022High Performance Simulation for Scalable Multi-Agent Reinforcement Learning8 Jul 2022
- 2022VMAS: A Vectorized Multi-Agent Simulator for Collective Robot Learning7 Jul 2022
50 newest of 69 All 69 (JSON)
- 2024AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Makingcited by 19
- 2026Holos: A Web-Scale LLM-Based Multi-Agent System for the Agentic Webcited by 4
- 2025Learning to Lead Themselves: Agentic AI in MAS using MARLcited by 1
- 2026Superminds Test: Actively Evaluating Collective Intelligence of Agent Society via Probing Agentscited by 1
- 2026From Pixels to Digital Agents: An Empirical Study on the Taxonomy and Technological Trends of Reinforcement Learning Environmentscited by 0
- 2026Superminds Test: Actively Evaluating Collective Intelligence of Agent Society via Probing Agents24 Apr 2026
- 2026From Pixels to Digital Agents: An Empirical Study on the Taxonomy and Technological Trends of Reinforcement Learning Environments25 Mar 2026
- 2026Holos: A Web-Scale LLM-Based Multi-Agent System for the Agentic Web18 Jan 2026
- 2025Learning to Lead Themselves: Agentic AI in MAS using MARL24 Sep 2025
- 2024AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Making6 Nov 2024
- 2023Diverse Policy Optimization for Structured Action Spacecited by 1
- 2023Diverse Policy Optimization for Structured Action Space23 Feb 2023
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 71
- 2022VMAS: A Vectorized Multi-Agent Simulator for Collective Robot Learningcited by 63
- 2021UPDeT: Universal Multi-agent Reinforcement Learning via Policy Decoupling with Transformerscited by 39
- 2022Multi-agent Dynamic Algorithm Configurationcited by 36
- 2023Multi-agent Reinforcement Learning: A Comprehensive Surveycited by 30
- 2022MARLlib: A Scalable and Efficient Multi-agent Reinforcement Learning Librarycited by 21
- 2024POGEMA: A Benchmark Platform for Cooperative Multi-Agent Pathfindingcited by 20
- 2021Collaborative Visual Navigationcited by 18
- 2022Influencing Long-Term Behavior in Multiagent Reinforcement Learningcited by 18
- 2021The Neural MMO Platform for Massively Multiagent Researchcited by 17
- 2022An Introduction to Multi-Agent Reinforcement Learning and Review of its Application to Autonomous Mobilitycited by 16
- 2022RoMFAC: A robust mean-field actor-critic reinforcement learning against adversarial perturbations on statescited by 16
12 most cited of 60 All 60 (JSON)
- 2026Heterogeneous Information-Bottleneck Coordination Graphs for Multi-Agent Reinforcement Learning17 May 2026
- 2026SCoUT: Scalable Communication via Utility-Guided Temporal Grouping in Multi-Agent Reinforcement Learning5 Mar 2026
- 2026TABX: A High-Throughput Sandbox Battle Simulator for Multi-Agent Reinforcement Learning2 Feb 2026
- 2026Explicit Credit Assignment through Local Rewards and Dependence Graphs in Multi-Agent Reinforcement Learning29 Jan 2026
- 2025StarCraft+: Benchmarking Multi-agent Algorithms in Adversary Paradigm18 Dec 2025
- 2025The Emergence of Complex Behavior in Large-Scale Ecological Environments21 Oct 2025
- 2025Vulnerable Agent Identification in Large-Scale Multi-Agent Reinforcement Learning18 Sep 2025
- 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Review14 Jul 2025
- 2025A MARL-based Approach for Easing MAS Organization Engineering5 Jun 2025
- 2025Integration of TinyML and LargeML: A Survey of 6G and Beyond20 May 2025
- 2025Bi-level Mean Field: Dynamic Grouping for Large-Scale MARL10 May 2025
- 2025Exponential Topology-enabled Scalable Communication in Multi-agent Reinforcement Learning27 Feb 2025
12 newest of 60 All 60 (JSON)