DynGraphAgentBench: A Benchmark for Agentic Lifecycle Control in Dynamic Graph Anomaly Detection
On the map: LLM agents and tool use → Software engineering coding agents also fits: Agent threats, guardrails and governance
Abstract (arXiv)
Dynamic graph anomaly detection requires repeated decisions as graph structure and class prevalence drift, yet detector benchmarks usually score a fixed pipeline after current labels are known. We introduce DynGraphAgentBench, an executable benchmark for agentic lifecycle control under delayed feedback. It comprises seven temporal graph datasets with node- and edge-level anomaly tasks, eleven selectable detectors, and eight chronological deployment windows per dataset. In each window, a controller sees only time-causal aggregate context, registered model cards, and its own matured history. It must choose a detector before current-window training or candidate scores exist. A sandboxed executor trains the chosen architecture on mature data, scores a hidden deployment window, and releases the outcome after a one-window delay. A deterministic verifier checks decision timing, leakage guards, legal actions, training scope, and persisted artifacts. We measure detection utility with average precision and capture at fixed review depth, and characterize adaptation through model switches and compute. Complete eight-window trajectories from two primary controllers and a no-memory reference on four datasets, together with three additional controllers on three datasets, expose useful, costly, and ineffective reactions to delayed evidence without granting an exhaustive current-window oracle.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 38 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
28 of 38 references.
Closest ancestors · 1
Same direction, newest first
Other references · 27
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
- 2020Inductive Representation Learning on Temporal Graphscited by 454
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 443
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
- 2020Enhancing Graph Neural Network-based Fraud Detectors against Camouflaged Fraudsterscited by 248
- 2021Inductive Representation Learning in Temporal Networks via Causal Anonymous Walkscited by 188
- 2024LLaGA: Large Language and Graph Assistantcited by 177
- 2021Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learningcited by 175
15 more
- 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 154
- 2023Do We Really Need Complicated Model Architectures For Temporal Networks?cited by 141
- 2023Temporal Graph Benchmark for Machine Learning on Temporal Graphscited by 137
- 2025Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluationcited by 83
- 2021TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learningcited by 65
- 2022DGraph: A Large-Scale Financial Dataset for Graph Anomaly Detectioncited by 63
- 2023Realistic Synthetic Financial Transactions for Anti-Money Laundering Modelscited by 47
- 2023GAD-NR: Graph Anomaly Detection via Neighborhood Reconstructioncited by 44
- 2025CostBench: Evaluating Multi-Turn Cost-Optimal Planning and Adaptation in Dynamic Environments for LLM Tool-Use Agentscited by 32
- 2024Semi-supervised Credit Card Fraud Detection via Attribute-Driven Graph Representationcited by 25
- 2024Partitioning Message Passing for Graph Fraud Detectioncited by 21
- 2023Demystifying Fraudulent Transactions and Illicit Nodes in the Bitcoin Network for Financial Forensicscited by 17
- 2023BenchTemp: A General Benchmark for Evaluating Temporal Graph Neural Networkscited by 9
- 2023A Versatile Graph Learning Approach through LLM-based Agentcited by 6
- 2025Automated Decision-Making on Networks with LLMs through Knowledge-Guided Evolutioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SAGA: Synthetic Agentic Graph Architecture for Temporal Benchmark Generation
- 2026MAADBench: The Refreshable Paradigm for Anomaly Detection in Multi-Agent Systems
- 2026Adaptive Influence Graphs for Failure Attribution in Multi-Agent Systems
- 2026GAMMAF: A Common Framework for Graph-Based Anomaly Monitoring Benchmarking in LLM Multi-Agent Systems
- 2026Leveraging Trajectory Graphs for Pre-Execution Error Diagnosis in Agentic LLM Systems
- 2025SentinelAgent: Graph-based Anomaly Detection in Multi-Agent Systems
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspective
- 2025Detecting Silent Failures in Multi-Agentic AI Trajectories