mlsanityData to 14 Oct 2026

Guarding Against Malicious Biased Threats (GAMBiT) Experiments: Revealing Cognitive Bias in Human-Subjects Red-Team Cyber Range Operations

arXiv 2508.20963 ↗First posted 28 Aug 2025cs.CR cs.GTcited by 0

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

We present three large-scale human-subjects red-team cyber range datasets from the Guarding Against Malicious Biased Threats (GAMBiT) project. Across Experiments 1-3 (July 2024-March 2025), 19-20 skilled attackers per experiment conducted two 8-hour days of self-paced operations in a simulated enterprise network (SimSpace Cyber Force Platform) while we captured multi-modal data: self-reports (background, demographics, psychometrics), operational notes, terminal histories, keylogs, network packet captures (PCAP), and NIDS alerts (Suricata). Each participant began from a standardized Kali Linux VM and pursued realistic objectives (e.g., target discovery and data exfiltration) under controlled constraints. Derivative curated logs and labels are included. The combined release supports research on attacker behavior modeling, bias-aware analytics, and method benchmarking. Data are available via IEEE Dataport entries for Experiments 1-3.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 10 of its 25 references that are in the map. First posted on arXiv 28 Aug 2025.

Builds on

10 of 25 references.

References · 10

  1. 2025Game Theory Meets LLM and Agentic AI: Reimagining Cybersecurity for the Age of Intelligent Threatscited by 11
  2. 2024Symbiotic Game and Foundation Models for Cyber Deception Operations in Strategic Cyber Warfarecited by 8
  3. 2025PsyScam: A Benchmark for Psychological Techniques in Real-World Scamscited by 8
  4. 2025From Texts to Shields: Convergence of Large Language Models and Cybersecuritycited by 4
  5. 2025When to Deceive: A Cross-Layer Stackelberg Game Framework for Strategic Timing of Cyber Deceptioncited by 2
  6. 2025A Multi-Resolution Dynamic Game Framework for Cross-Echelon Decision-Making in Cyber Warfarecited by 2
  7. 2020Cry Wolf: Toward an Experimentation Platform and Dataset for Human Factors in Cyber Security Analysiscited by 1
  8. 2023Game of Travesty: Decoy-based Psychological Cyber Deception for Proactive Human Agentscited by 1
  9. 2024PsybORG+: Modeling and Simulation for Detecting Cognitive Biases in Advanced Persistent Threatscited by 1
  10. 2025Bilateral Cognitive Security Games in Networked Control Systems under Stealthy Injection Attackscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Detecting Ambiguity Aversion in Cyberattack Behavior to Inform Cognitive Defense Strategies ↗
  2. 2026CyBiasBench: Benchmarking Bias in LLM Agents for Cyber-Attack Scenarios
  3. 2026Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming
  4. 2024The Human Factor in AI Red Teaming: Perspectives from Social and Collaborative Computing
  5. 2023Scalable and automated Evaluation of Blue Team cyber posture in Cyber Ranges ↗
  6. 2026Red Teaming LLMs as Socio-Technical Practice: From Exploration and Data Creation to Evaluation
  7. 2025Cognitive Cybersecurity for Artificial Intelligence: Guardrail Engineering with CCS-7
  8. 2025Capability-Based Scaling Trends for LLM-Based Red-Teaming