mlsanityData to 14 Oct 2026

Predictive Maps of Multi-Agent Reasoning: A Successor-Representation Spectrum for LLM Communication Topologies

arXiv 2605.11453 ↗First posted 12 May 2026cs.MA cs.AI cs.LGcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Practitioners deploying multi-agent large language model (LLM) systems must currently choose between communication topologies such as chain, star, mesh, and richer variants without any pre-inference diagnostic for which topology will amplify drift, converge to consensus, or remain robust under perturbation. Existing evaluation answers these questions only post hoc and only for the task measured. We introduce a structural diagnostic for multi-agent LLM communication graphs based on the successor representation M = (I - γ P)-1 of the row-stochastic communication operator, and we connect three of its spectral quantities, the spectral radius ρ(M), the spectral gap Delta(M), and the condition number kappa(M), to three distinct failure modes. We derive closed-form spectra for the chain, star, and mesh under row-stochastic normalization, and validate the predictions on a 12-step structured state-tracking task with Qwen2.5-7B-Instruct over 100 independent trials. The condition number is a perfect rank-order predictor of empirical perturbation robustness (rs = 1.0); the spectral gap partially predicts consensus dynamics (rs = 0.5); and the spectral radius is perfectly inverted with respect to cumulative error (rs = -1.0). We trace this inversion to a regime in which linear spectra are blind to non-contracting bias drift, and we propose an affine-noise extension of the predictive map that recovers the empirical ordering. We read this as a first step toward representational, drift-aware structural diagnostics for multi-agent LLM systems, sitting alongside classical spectral and consensus theory.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 6 of its 51 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

6 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May

Other references · 5

  1. 2024Qwen2 Technical Reportcited by 2,120
  2. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  3. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  4. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
  5. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inference
  2. 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMs
  3. 2026GoAgent: Group-of-Agents Communication Topology Generation for LLM-based Multi-Agent Systems
  4. 2026Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systems
  5. 2026Graph-theoretic Agreement Framework for Multi-agent LLM Systems
  6. 2026QueenBee Planner: Skill-Evolving Communication Topologies for Token-Efficient LLM Multi-Agent Systems
  7. 2026CRAFT: Grounded Multi-Agent Coordination Under Partial Information
  8. 2026Inference-Time Graph Engineering for Multi-Agent LLM Workflows