BARD-MARL: Byzantine-Agent Detection for Learned Communication in Multi-Agent Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Learned communication improves coordination in cooperative multi-agent reinforcement learning, but it also creates a trust problem: a trained policy may route information through agents that have become faulty or adversarial. This paper studies Byzantine-agent detection for learned-communication MARL in adaptive traffic signal control. We propose BARD-MARL, a post-hoc diagnostic layer on top of BayesG, which is used as an attributed communication substrate rather than as a contribution of this paper. BARD-MARL combines two agent-level evidence streams: policy-graph features extracted from state-action trajectories and Bayesian trust statistics computed from BayesG latent mask probabilities. Across fixed-action, observation-flip, random-noise, and coordinated attacks in SUMO traffic grids, the results show that these signals are complementary rather than universally dominant. On a 25-agent grid, BARD-MARL reaches 0.843 AUC-ROC under a 10% observation-flip attack, while policy-graph-only detection reaches 0.917 AUC-ROC under a 10% coordinated attack. On a 100-agent grid, the unified BARD-MARL variant reaches 0.982 AUC-ROC for both 10% fixed-action and 10% coordinated attacks. The study shows that learned communication policies expose useful diagnostic evidence, but credible resilience claims require attack-specific ablations and explicit separation between coordination, detection, and mitigation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 15 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
10 of 15 references.
References · 10
- 2018Verifiable Reinforcement Learning via Policy Extractioncited by 176
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 103
- 2019Generation of Policy-Level Explanations for Reinforcement Learningcited by 37
- 2023Byzantine Robust Cooperative Multi-Agent Reinforcement Learning as a Bayesian Gamecited by 18
- 2021Towards Resilience for Multi-Agent QD-Learningcited by 4
- 2022Decentralized Vision-Based Byzantine Agent Detection in Multi-Robot Systems with IOTA Smart Contractscited by 3
- 2024On the Hardness of Decentralized Multi-Agent Policy Evaluation under Byzantine Attackscited by 3
- 2025Bayesian Ego-graph Inference for Networked Multi-Agent Reinforcement Learningcited by 2
- 2022Reinforcement Learning based Cyberattack Model for Adaptive Traffic Signal Controller in Connected Transportation Systemscited by 1
- 2024siForest: Detecting Network Anomalies with Set-Structured Isolation Forestcited by 1
Built on by
Not cited yet.