Attributing Emergence in Million-Agent Systems
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Large language models (LLMs) can simulate human-like reasoning and decision-making in individual agents. LLM-powered multi-agent systems (MAS) combine such agents to simulate population-scale social phenomena such as polarization, information cascades, and market panics. Such studies require attributing macro emergence to individual agents, but existing axiomatic methods scale combinatorially in N and have been confined to N lesssim 103, while the phenomena they explain occur at N ≥ 106. We address this gap by adapting Aumann--Shapley path-integral attribution to LLM-powered MAS at million-agent scale; the resulting method satisfies all four axioms, runs three to five orders of magnitude faster than sampled Shapley on the same hardware, and extends feasible axiomatic attribution by over three orders of magnitude (a 1670× jump). We use this method to test the scale gap empirically: across 14 days of public Bluesky data (1,671,587 active users, five topics), we compute the attribution at both full scale and the visibility-biased N = 102 convenience sample used by small-scale studies, and the two disagree structurally. At full scale the long tail and middle tier jointly carry the majority; the biased small panel shifts about twice that share onto the upper follower tiers (48% versus 24%). We then prove that the disagreement cannot in general be reduced by post-hoc rescaling: an Attribution Scaling Bias theorem shows that a reconciling global rescaling factor exists exactly when the macro indicator is linear over agents, and our nonlinear indicators give residuals of 0.10--0.98. For such nonlinear indicators, full-scale attribution is therefore a requirement rather than a methodological choice.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 29 of its 48 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
29 of 48 references.
References · 29
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2017Deep Setscited by 1,394
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
17 more
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Societycited by 180
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systemscited by 170
- 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activitiescited by 154
- 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 147
- 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 126
- 2024Emergent social conventions and collective bias in LLM populationscited by 115
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 105
- 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 76
- 2019Shapley Q-value: A Local Reward Approach to Solve Global Reward Gamescited by 71
- 2024GenSim: A General Social Simulation Platform with Large Language Model based Agentscited by 48
- 2025TwinMarket: A Scalable Behavioral and Social Simulation for Financial Marketscited by 46
- 2025Who is Introducing the Failure? Automatically Attributing Failures of Multi-Agent Systems via Spectrum Analysiscited by 33
- 2021SHAQ: Incorporating Shapley Value Theory into Multi-Agent Q-Learningcited by 26
- 2024"I'm in the Bluesky Tonight": Insights from a Year Worth of Social Datacited by 11
- 2015Measuring user influence on Twitter: A surveycited by 7
- 2026Interpreting Emergent Extreme Events in Multi-Agent Systemscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Poor Man's Agentic Modeling: Simulating Large LLM-Agent Societies on a Laptop
- 2026Scaling Multi-Agent Systems with Prospect-State Propagation
- 2026Population Physics, Population Problems: Safety and Emergence in LLM Societies
- 2026Benchmarking Emergent Coordination in Large-Scale LLM Populations: An Evaluation Framework on the MoltBook Archive
- 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulations
- 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents
- 2026Multi-agent Scaling Across Disjunctive and Compensatory Tasks
- 2026Towards Agentic Agent-based Models: Feasibility, Performance, and Statistical Model Checking