AutoBnB-RAG: Enhancing Multi-Agent Incident Response with Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → Privacy and security of RAG
also in 1 more
Abstract (arXiv)
Incident response (IR) requires fast, coordinated, and well-informed decision-making to contain and mitigate cyber threats. While large language models (LLMs) have shown promise as autonomous agents in simulated IR settings, their reasoning is often limited by a lack of access to external knowledge. In this work, we present AutoBnB-RAG, an extension of the AutoBnB framework that incorporates retrieval-augmented generation (RAG) into multi-agent incident response simulations. Built on the Backdoors & Breaches (B&B) tabletop game environment, AutoBnB-RAG enables agents to issue retrieval queries and incorporate external evidence during collaborative investigations. We introduce two retrieval settings: one grounded in curated technical documentation (RAG-Wiki), and another using narrative-style incident reports (RAG-News). We evaluate performance across eight team structures, including newly introduced argumentative configurations designed to promote critical reasoning. To validate practical utility, we also simulate real-world cyber incidents based on public breach reports, demonstrating AutoBnB-RAG's ability to reconstruct complex multi-stage attacks. Our results show that retrieval augmentation improves decision quality and success rates across diverse organizational models. This work demonstrates the value of integrating retrieval mechanisms into LLM-based multi-agent systems for cybersecurity decision-making.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 21 of its 43 references that are in the map. First posted on arXiv 18 Aug 2025.
Builds on
21 of 43 references.
Closest ancestors · 4
Same direction, newest first
- 2025CyberRAG: An Agentic RAG cyber attack classification and reporting tool3 Jul
- 2024GenDFIR: Advancing Cyber Incident Timeline Analysis Through Retrieval Augmented Generation and Large Language Models4 Sep
- 2024MoRSE: Bridging the Gap in Cybersecurity Expertise with Retrieval Augmented Generation22 Jul
- 2024CyberMetric: A Benchmark Dataset based on Retrieval-Augmented Generation for Evaluating LLMs in Cybersecurity Knowledge12 Feb
Other references · 17
- 2023GPT-4 Technical Reportcited by 18,396
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
- 2023A Comprehensive Overview of Large Language Modelscited by 648
- 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 68
- 2023MechAgents: Large language model multi-agent collaborations can solve mechanics problems, generate new data, and integrate knowledgecited by 63
- 2023SecQA: A Concise Question-Answering Dataset for Evaluating Large Language Models in Computer Securitycited by 37
- 2024Large Language Models in Cybersecurity: State-of-the-Artcited by 34
- 2024ColaCare: Enhancing Electronic Health Record Modeling through Large Language Model-Driven Multi-Agent Collaborationcited by 23
- 2024InvAgent: A Large Language Model based Multi-Agent System for Inventory Management in Supply Chainscited by 22
- 2024A RAG-Based Question-Answering Solution for Cyber-Attack Investigation and Attributioncited by 9
5 more
- 2024Ontology-Aware RAG for Improved Question-Answering in Cybersecurity Educationcited by 9
- 2025EconWebArena: Benchmarking Autonomous Agents on Economic Tasks in Realistic Web Environmentscited by 9
- 2024Employing LLMs for Incident Response Planning and Reviewcited by 8
- 2025CRMAgent: A Multi-Agent LLM System for E-Commerce CRM Message Template Generationcited by 6
- 2024Multi-Agent Collaboration in Incident Response with Large Language Modelscited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2026Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system securitycited by 5
- 2025Shall We Play a Game? Language Models for Open-ended Wargamescited by 2
- 2025AgentBnB: A Browser-Based Cybersecurity Tabletop Exercise with Large Language Model Support and Retrieval-Aligned Scaffoldingcited by 0
- 2026Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security17 May 2026
- 2025AgentBnB: A Browser-Based Cybersecurity Tabletop Exercise with Large Language Model Support and Retrieval-Aligned Scaffolding31 Oct 2025
- 2025Shall We Play a Game? Language Models for Open-ended Wargames21 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026Beyond RAG for Cyber Threat Intelligence: A Systematic Evaluation of Graph-Based and Agentic Retrieval
- 2025Advancing Autonomous Incident Response: Leveraging LLMs and Cyber Threat Intelligence
- 2026In-Context Autonomous Network Incident Response: An End-to-End Large Language Model Agent Approach
- 2025RAGalyst: Automated Human-Aligned Agentic Evaluation for Domain-Specific RAG
- 2025Adapting Large Language Models to Emerging Cybersecurity using Retrieval Augmented Generation
- 2026KidnapRAG: A Black-Box Attack for Hijacking Reasoning in Agentic Retrieval-Augmented Generation Systems
- 2025AURA: A Multi-Agent Intelligence Framework for Knowledge-Enhanced Cyber Threat Attribution
- 2025Large Language Models for Explainable Threat Intelligence