mlsanityData to 14 Oct 2026

MACIE: Multi-Agent Causal Intelligence Explainer for Collective Behavior Understanding

arXiv 2511.15716 ↗First posted 11 Nov 2025cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

As Multi Agent Reinforcement Learning systems are used in safety critical applications. Understanding why agents make decisions and how they achieve collective behavior is crucial. Existing explainable AI methods struggle in multi agent settings. They fail to attribute collective outcomes to individuals, quantify emergent behaviors, or capture complex interactions. We present MACIE Multi Agent Causal Intelligence Explainer, a framework combining structural causal models, interventional counterfactuals, and Shapley values to provide comprehensive explanations. MACIE addresses three questions. First, each agent's causal contribution using interventional attribution scores. Second, system level emergent intelligence through synergy metrics separating collective effects from individual contributions. Third, actionable explanations using natural language narratives synthesizing causal insights. We evaluate MACIE across four MARL scenarios: cooperative, competitive, and mixed motive. Results show accurate outcome attribution, mean phi_i equals 5.07, standard deviation less than 0.05, detection of positive emergence in cooperative tasks, synergy index up to 0.461, and efficient computation, 0.79 seconds per dataset on CPU. MACIE uniquely combines causal rigor, emergence quantification, and multi agent support while remaining practical for real time use. This represents a step toward interpretable, trustworthy, and accountable multi agent AI.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 81 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

42 of 81 references.

References · 42

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  5. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  6. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  7. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  8. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
  9. 2015End-to-End Training of Deep Visuomotor Policiescited by 875
  10. 2017A Survey on Multi-Task Learningcited by 840
  11. 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 752
  12. 2017Counterfactual Multi-Agent Policy Gradientscited by 751
30 more
  1. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
  2. 2019The StarCraft Multi-Agent Challengecited by 597
  3. 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 503
  4. 2015Policy Distillationcited by 440
  5. 2016Learning Multiagent Communication with Backpropagationcited by 366
  6. 2019The many Shapley values for model explanationcited by 344
  7. 2017Deep Reinforcement Learning: An Overviewcited by 333
  8. 2019Google Research Football: A Novel Reinforcement Learning Environmentcited by 260
  9. 2020Causal Intervention for Weakly-Supervised Semantic Segmentationcited by 229
  10. 2020PettingZoo: Gym for Multi-Agent Reinforcement Learningcited by 220
  11. 2019Contrastive Learning of Structured World Modelscited by 209
  12. 2020Weighted QMIX: Expanding Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 197
  13. 2018Programmatically Interpretable Reinforcement Learningcited by 193
  14. 2019Explainable Reinforcement Learning Through a Causal Lenscited by 177
  15. 2019Feature relevance quantification in explainable AI: A causal problemcited by 167
  16. 2016An Actor-Critic Algorithm for Sequence Predictioncited by 159
  17. 2017Visualizing and Understanding Atari Agentscited by 141
  18. 2020Explainable Reinforcement Learning: A Surveycited by 141
  19. 2020Causal Shapley Values: Exploiting Causal Knowledge to Explain Individual Predictions of Complex Modelscited by 107
  20. 2021Sampling Permutations for Shapley Value Estimationcited by 102
  21. 2018L-Shapley and C-Shapley: Efficient Model Interpretation for Structured Datacited by 100
  22. 2020Explainability in Deep Reinforcement Learningcited by 97
  23. 2019Towards Interpretable Reinforcement Learning Using Attention Augmented Agentscited by 82
  24. 2019Hindsight Credit Assignmentcited by 79
  25. 2019Shapley Q-value: A Local Reward Approach to Solve Global Reward Gamescited by 73
  26. 2021Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learningcited by 53
  27. 2018Establishing Appropriate Trust via Critical Statescited by 48
  28. 2018Transparency and Explanation in Deep Reinforcement Learning Neural Networkscited by 40
  29. 2021Counterfactual State Explanations for Reinforcement Learning Agents via Generative Deep Learningcited by 39
  30. 2021Shapley Counterfactual Credits for Multi-Agent Reinforcement Learningcited by 38

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Causal Foundations of Collective Agency
  2. 2025MAEBE: Multi-Agent Emergent Behavior Framework
  3. 2025CausalPlan: Empowering Efficient LLM Multi-Agent Collaboration Through Causality-Driven Planning
  4. 2025Understanding Action Effects through Instrumental Empowerment in Multi-Agent Reinforcement Learning
  5. 2025A Principle of Targeted Intervention for Multi-Agent Reinforcement Learning
  6. 2025An Organizationally-Oriented Approach to Enhancing Explainability and Control in Multi-Agent Reinforcement Learning
  7. 2025Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberation
  8. 2024Multi-Agent Causal Discovery Using Large Language Models