Hidden Coalitions in Multi-Agent AI: A Spectral Diagnostic from Internal Representations
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Collections of interacting AI agents can form coalitions, creating emergent group-level organization that is critical for AI safety and alignment. However, observing agent behavior alone is often insufficient to distinguish genuine informational coupling from spurious similarity, as consequential coalitions may form at the level of internal representations before any overt behavioral change is apparent. Here, we introduce a practical method for detecting coalition structure from the internal neural representations of multi-agent systems. The approach constructs a pairwise mutual-information graph from the hidden states of agents and applies spectral partitioning to identify the most salient coalition boundary. We validate this method in two domains. First, in multi-agent reinforcement learning environments, the method successfully recovers programmed hierarchical and dynamic coalition structures and correctly rejects false positives arising from behavioral coordination without informational coupling. Second, using a large language model, the method identifies coalition structures implied by descriptive prompts, tracks dynamic team reassignments, and reveals a representational hierarchy where explicit labels dominate over conflicting interaction patterns. Across both settings, the recovered partition reveals subgroup organization that a scalar cross-agent mutual-information measure cannot distinguish. The results demonstrate that analyzing hidden-state mutual information through spectral partitioning provides a scalable diagnostic for identifying representational coalitions, offering a valuable tool for monitoring emergent structure in distributed AI systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 6 of its 24 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
6 of 24 references.
References · 6
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2025Qwen3 Technical Reportcited by 8,820
- 2024Emergent social conventions and collective bias in LLM populationscited by 123
- 2017Cooperating with Machinescited by 39
- 2022Integrated information theory (IIT) 4.0: Formulating the properties of phenomenal existence in physical termscited by 21
- 2018Measuring Integrated Information: Comparison of Candidate Measures in Theory and Simulationcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SACHI: Structured Agent Coordination via Holistic Information Integration in Multi-Agent Reinforcement Learning
- 2024Group-Aware Coordination Graph for Multi-Agent Reinforcement Learning
- 2018Learning Policy Representations in Multiagent Systems
- 2026Heterogeneous Information-Bottleneck Coordination Graphs for Multi-Agent Reinforcement Learning
- 2026Physics of Agents: Statistical Mechanics Predicts Collective Behavior of AI Agents
- 2025Hedonic Neurons: A Mechanistic Mapping of Latent Coalitions in Transformer MLPs
- 2026HySTAR: Anchored Hypergraphs for Stable Credit Assignment in Cooperative Multi-Agent Reinforcement Learning
- 2026Unveiling Complex Collective Behaviors from Simple Rewards