Adaptive Accountability in Networked MAS: Tracing and Mitigating Emergent Norms at Scale
Not on the map. Why?
Abstract (arXiv)
Large-scale networked multi-agent systems increasingly underpin critical infrastructure, yet their collective behavior can drift toward undesirable emergent norms such as collusion, resource hoarding, and implicit unfairness. We present the Adaptive Accountability Framework (AAF), an end-to-end runtime layer that (i) records cryptographically verifiable interaction provenance, (ii) detects distributional change points in streaming traces, (iii) attributes responsibility via a causal influence graph, and (iv) applies cost-bounded interventions-reward shaping and targeted policy patching-to steer the system back toward compliant behavior. We establish a bounded-compromise guarantee: if the expected cost of intervention exceeds an adversary's expected payoff, the long-run fraction of compromised interactions converges to a value strictly below one. We evaluate AAF in a large-scale factorial simulation suite (87,480 runs across two tasks; up to 100 agents plus a 500-agent scaling sweep; full and partial observability; Byzantine rates up to 10%; 10 seeds per regime). Across 324 regimes, AAF lowers the executed compromise ratio relative to a Proximal Policy Optimization baseline in 96% of regimes (median relative reduction 11.9%) while preserving social welfare (median change 0.4%). Under adversarial injections, AAF detects norm violations with a median delay of 71 steps (interquartile range 39-177) and achieves a mean top-ranked attribution accuracy of 0.97 at 10% Byzantine rate.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 81 references that are in the map. First posted on arXiv 21 Dec 2025.
Builds on
23 of 81 references.
References · 23
- 2018Model Cards for Model Reportingcited by 1,080
- 2017Constrained Policy Optimizationcited by 983
- 2019Introduction to Online Convex Optimizationcited by 803
- 2017Counterfactual Multi-Agent Policy Gradientscited by 751
- 2018A Survey and Critique of Multiagent Deep Reinforcement Learningcited by 177
- 2019Principles alone cannot guarantee ethical AIcited by 135
- 2024Visibility into AI Agentscited by 79
- 2025TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systemscited by 59
- 2024Emergence of Social Norms in Generative Agent Societies: Principles and Architecturecited by 41
- 2016Distributed Constraint Optimization Problems and Applications: A Surveycited by 26
- 2023Byzantine Robust Cooperative Multi-Agent Reinforcement Learning as a Bayesian Gamecited by 18
- 2025Rethinking the Reliability of Multi-agent System: A Perspective from Byzantine Fault Tolerancecited by 17
11 more
- 2024Learning and Sustaining Shared Normative Systems via Bayesian Rule Induction in Markov Gamescited by 11
- 2023Causal Explanations for Sequential Decision-Making in Multi-Agent Systemscited by 10
- 2024Monitored Markov Decision Processescited by 10
- 2023MACCA: Offline Multi-agent Reinforcement Learning with Causal Credit Assignmentcited by 6
- 2024Norm Enforcement with a Soft Touch: Faster Emergence, Happier Agentscited by 4
- 2024Counterfactual Effect Decomposition in Multi-Agent Sequential Decision Makingcited by 4
- 2025LumiMAS: A Comprehensive Framework for Real-Time Monitoring and Enhanced Observability in Multi-Agent Systemscited by 4
- 2024Analysing the Sample Complexity of Opponent Shapingcited by 2
- 2024Measuring Responsibility in Multi-Agent Systemscited by 1
- 2024Operationalising Rawlsian Ethics for Fairness in Norm-Learning Agentscited by 1
- 2025Chronology of Multi-Agent Interactions for Provenance of Evolving Informationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Don't Trust Stubborn Neighbors: A Security Framework for Agentic Networks
- 2026Norm Enforcement for AI Agents: Robustly Shaping Behavior in Multi-Agent Systems
- 2026Beyond Single-Agent Alignment: Preventing Context-Fragmented Violations in Multi-Agent Systems
- 2025The Trust Paradox in LLM-Based Multi-Agent Systems: When Collaboration Becomes a Security Vulnerability
- 2026Proteus: A Self-Evolving Red Team for Agent Skill Ecosystems
- 2025Evaluating Control Protocols for Untrusted AI Agents
- 2026Towards Adaptive, Scalable, and Robust Coordination of LLM Agents: A Dynamic Ad-Hoc Networking Perspective
- 2026Emergent Collusion in Long-Horizon LLM Agent Interaction