An Agentic RAG and Evaluation Framework for Assurance Case Generation: Industrial Use Case for the EU Cyber Resilience Act Compliance
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Complying with the EU Cyber Resilience Act (CRA) is a resource-intensive challenge for SMEs due to the complexity of cybersecurity conformity assessment. Yet, it is essential for demonstrating regulatory compliance and ensuring product security and resilience. To address this, we introduce an automated framework for generating Assurance Cases (ACs) using an agentic Retrieval-Augmented Generation grounded in a formal Claim-Argument-Evidence logic. By systematically mapping technical documentation requirements, the framework streamlines the generation of certification evidence. We validate our approach on a case study of Catalink's PATROLIoT wildfire monitoring system, where the agentic RAG generated 70 ACs with high grounding density (~4.4 artefacts per AC). The proposed Natural Language Inference (NLI) evaluator achieves 0.88 accuracy, which provides robust evidence grounding and traceability, while expert-validated plausibility (3.06) supports interpretable justifications. For practitioners, this work provides a scalable, interpretable approach for automating mandatory CRA conformity assessments, reducing manual effort while maintaining transparent decision support.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 10 of its 22 references that are in the map. First posted on arXiv 19 Aug 2026.
Builds on
10 of 22 references.
References · 10
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Supervising Model Attention with Human Explanations for Robust Natural Language Inferencecited by 29
- 2025Step-by-Step Fact Verification System for Medical Claims with Explainable Reasoningcited by 17
- 2022A Principles-based Ethics Assurance Argument Pattern for AI and Autonomous Systemscited by 6
- 2024CoDefeater: Using LLMs To Find Defeaters in Assurance Casescited by 5
- 2025Explainable Compliance Detection with Multi-Hop Natural Language Inference on Assurance Case Structurecited by 5
- 2024Automatic Instantiation of Assurance Cases from Patterns Using Large Language Modelscited by 4
- 2023Trusta: Reasoning about Assurance Cases with Formal Methods and Large Language Modelscited by 3
- 2026Evaluating Assurance Cases as Text-Attributed Graphs for Structure and Provenance Analysiscited by 2
- 2025LLMs as Judges: Toward The Automatic Review of GSN-compliant Assurance Casescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Compliance-by-Construction Argument Graphs: Using Generative AI to Produce Evidence-Linked Formal Arguments for Certification-Grade Accountability
- 2026Probabilistic Agents in Deterministic Audits: Evaluating Multi-Agent Systems for Automated Audits Based on the German IT-Grundschutz
- 2026From Naive RAG to Deep Agentic Retrieval: An Evolving Context Engineering Pipeline for Regulatory Compliance
- 2026From Obligation to Specification: A Survey on Validating EU AI Act Requirements in RE
- 2026From Legacy Documentation to OSCAL: An MCP-Based Agent Pipeline for Threat-Informed Continuous Compliance in Critical Infrastructure
- 2026CTRAG: An In-Context Retrieval-based Framework for Automated Compliance Checking using LLMs
- 2025Multi-Stage Retrieval for Operational Technology Cybersecurity Compliance Using Large Language Models: A Railway Casestudy
- 2026Poisoned Playbooks: Demystifying Knowledge Poisoning Effects on AI Security Agents