Explainable and Fine-Grained Safeguarding of LLM Multi-Agent Systems via Bi-Level Graph Anomaly Detection
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Large language model (LLM)-based multi-agent systems (MAS) have shown strong capabilities in solving complex tasks. As MAS become increasingly autonomous in various safety-critical tasks, detecting malicious agents has become a critical security concern. Although existing graph anomaly detection (GAD)-based defenses can identify anomalous agents, they mainly rely on coarse sentence-level information and overlook fine-grained lexical cues, leading to suboptimal performance. Moreover, the lack of interpretability in these methods limits their reliability and real-world applicability. To address these limitations, we propose XG-Guard, an explainable and fine-grained safeguarding framework for detecting malicious agents in MAS. To incorporate both coarse and fine-grained textual information for anomalous agent identification, we utilize a bi-level agent encoder to jointly model the sentence- and token-level representations of each agent. A theme-based anomaly detector further captures the evolving discussion focus in MAS dialogues, while a bi-level score fusion mechanism quantifies token-level contributions for explanation. Extensive experiments across diverse MAS topologies and attack scenarios demonstrate robust detection performance and strong interpretability of XG-Guard.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 31 of its 49 references that are in the map. First posted on arXiv 21 Dec 2025.
Builds on
31 of 49 references.
Closest ancestors · 6
Same direction, newest first
- 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attacks11 Aug
- 2025Attack the Messages, Not the Agents: A Multi-round Adaptive Stealthy Tampering Framework for LLM-MAS5 Aug
- 2025AgentSafe: Safeguarding Large Language Model-based Multi-agent Systems via Hierarchical Data Management6 Mar
- 2025G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent Systems16 Feb
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
- 2023Evil Geniuses: Delving into the Safety of LLM-based Agents20 Nov
Other references · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
- 2024Understanding the planning of LLM agents: A surveycited by 421
- 2025Memory in the Age of AI Agentscited by 303
- 2021Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learningcited by 177
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
13 more
- 2024Attacks, Defenses and Evaluations for LLM Conversation Safety: A Surveycited by 130
- 2025A Survey on Code Generation with LLM-based Agentscited by 106
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 104
- 2025Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generationcited by 58
- 2025Understanding the Information Propagation Effects of Communication Topologies in LLM-based Multi-Agent Systemscited by 43
- 2025A Label-Free Heterophily-Guided Approach for Unsupervised Graph Fraud Detectioncited by 24
- 2025Robust Hallucination Detection in LLMs via Adaptive Token Selectioncited by 19
- 2025Uncertainty-Aware Graph Neural Networks: A Multi-Hop Evidence Fusion Approachcited by 14
- 2025A Survey of Generalization of Graph Anomaly Detection: From Transfer Learning to Foundation Modelscited by 14
- 2025Bisecle: Binding and Separation in Continual Learning for Video Language Understandingcited by 13
- 2025Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test Timecited by 12
- 2024Noise-Resilient Unsupervised Graph Representation Learning via Multi-Hop Feature Quality Estimationcited by 11
- 2025Out-of-Distribution Detection on Graphs: A Surveycited by 6
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Towards One-for-All Anomaly Detection for Tabular Datacited by 6
- 2026FedCIGAR: A Personalized Reconstruction Approach for Federated Graph-level Anomaly Detectioncited by 6
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systemscited by 5
- 2026PropGuard: Safeguarding LLM-MAS via Propagation-Aware Exploration and Remediationcited by 3
- 2026CAMERA: Adapting to Semantic Camouflage in Unsupervised Text-Attributed Graph Fraud Detectioncited by 3
- 2026GAMMAF: A Common Framework for Graph-Based Anomaly Monitoring Benchmarking in LLM Multi-Agent Systemscited by 2
- 2026OpenEvoShield: Dual Non-Stationary Continual Defense for Open-World Multi-Agent System Attackscited by 0
- 2026Attacking and Defending Multi-Agent Collaborative Filtering Systems Through Connectivitycited by 0
- 2026Maat: Independent Deterministic Contract-Based Governance for Multi-Agent LLM Workflowscited by 0
- 2026Maat: Independent Deterministic Contract-Based Governance for Multi-Agent LLM Workflows27 Sep 2026
- 2026Attacking and Defending Multi-Agent Collaborative Filtering Systems Through Connectivity4 Aug 2026
- 2026CAMERA: Adapting to Semantic Camouflage in Unsupervised Text-Attributed Graph Fraud Detection19 May 2026
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems17 May 2026
- 2026OpenEvoShield: Dual Non-Stationary Continual Defense for Open-World Multi-Agent System Attacks13 May 2026
- 2026FedCIGAR: A Personalized Reconstruction Approach for Federated Graph-level Anomaly Detection10 May 2026
- 2026PropGuard: Safeguarding LLM-MAS via Propagation-Aware Exploration and Remediation8 May 2026
- 2026GAMMAF: A Common Framework for Graph-Based Anomaly Monitoring Benchmarking in LLM Multi-Agent Systems27 Apr 2026
- 2026Towards One-for-All Anomaly Detection for Tabular Data15 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025SentinelAgent: Graph-based Anomaly Detection in Multi-Agent Systems
- 2026When Embedding-Based Defenses Fail: Rethinking Safety in LLM-Based Multi-Agent Systems
- 2025GUARDIAN: Safeguarding LLM Multi-Agent Collaborations with Temporal Graph Modeling
- 2025Who's the Mole? Modeling and Detecting Intention-Hiding Malicious Agents in LLM-Based Multi-Agent Systems
- 2024AgentMonitor: A Plug-and-Play Framework for Predictive and Secure Multi-Agent Systems
- 2025DefenderBench: A Toolkit for Evaluating Language Agents in Cybersecurity Environments
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
- 2025Think Broad, Act Narrow: CWE Identification with Multi-Agent Large Language Models