SecureRAG-RTL: A Retrieval-Augmented, Multi-Agent, Zero-Shot LLM-Driven Framework for Hardware Vulnerability Detection
On the map: Retrieval-augmented generation → Privacy and security of RAG
also in 1 more
Abstract (arXiv)
Large language models (LLMs) have shown remarkable capabilities in natural language processing tasks, yet their application in hardware security verification remains limited due to scarcity of publicly available hardware description language (HDL) datasets. This knowledge gap constrains LLM performance in detecting vulnerabilities within HDL designs. To address this challenge, we propose SecureRAG-RTL, a novel Retrieval-Augmented Generation (RAG)-based approach that significantly enhances LLM-based security verification of hardware designs. Our approach integrates domain-specific retrieval with generative reasoning, enabling models to overcome inherent limitations in hardware security expertise. We establish baseline vulnerability detection rates using prompt-only methods and then demonstrate that SecureRAG-RTL achieves substantial improvements across diverse LLM architectures, regardless of size. On average, our method increases detection accuracy by about 30%, highlighting its effectiveness in bridging domain knowledge gaps. For evaluation, we curated and annotated a benchmark dataset of 14 HDL designs containing real-world security vulnerabilities, which we will release publicly to support future research. These findings underscore the potential of RAG-driven augmentation to enable scalable, efficient, and accurate hardware security verification workflows.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 31 of its 42 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
31 of 42 references.
References · 31
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2025Qwen3 Technical Reportcited by 8,195
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2025Gemma 3 Technical Reportcited by 1,686
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2023StarCoder: may the source be with you!cited by 790
- 2023The Falcon Series of Open Language Modelscited by 526
19 more
- 2022A Systematic Evaluation of Large Language Models of Codecited by 360
- 2023Self-collaboration Code Generation via ChatGPTcited by 255
- 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 246
- 2023Using an LLM to Help With Code Understandingcited by 222
- 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 197
- 2023RTLFixer: Automatically Fixing RTL Syntax Errors with Large Language Modelscited by 98
- 2023AutoChip: Automating HDL Generation Using LLM Feedbackcited by 80
- 2024Towards LLM-Powered Verilog RTL Assistant: Self-Verification and Self-Correctioncited by 39
- 2024HDLdebugger: Streamlining HDL debugging with Large Language Modelscited by 25
- 2024MEIC: Re-thinking RTL Debug Automation using LLMscited by 25
- 2023Fixing Hardware Security Bugs with Large Language Modelscited by 24
- 2024Multitask-based Evaluation of Open-Source LLM on Software Vulnerabilitycited by 23
- 2024LLM4SecHW: Leveraging Domain Specific Large Language Model for Hardware Debuggingcited by 18
- 2024Self-HWDebug: Automation of LLM Self-Instructing for Hardware Security Verificationcited by 11
- 2024Hardware Phi-1.5B: A Large Language Model Encodes Hardware Domain Specific Knowledgecited by 10
- 2025MARVEL: Multi-Agent RTL Vulnerability Extraction using Large Language Modelscited by 5
- 2025BugWhisperer: Fine-Tuning LLMs for SoC Hardware Vulnerability Detectioncited by 5
- 2025Towards LLM-based Root Cause Analysis of Hardware Design Failurescited by 4
- 2025ConSCompF: Consistency-focused Similarity Comparison Framework for Generative Large Language Modelscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HarmChip: Evaluating Hardware Security Centric LLM Safety via Jailbreak Benchmarking
- 2025SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Models
- 2025ThreatLens: LLM-guided Threat Modeling and Test Plan Generation for Hardware Security Verification
- 2025Automated Vulnerability Validation and Verification: A Large Language Model Approach
- 2025LLMpatronous: Harnessing the Power of LLMs For Vulnerability Detection
- 2026uGen: An Agentic Framework for Generating Microarchitectural Attack PoCs
- 2024TrojanWhisper: Evaluating Pre-trained LLMs to Detect and Localize Hardware Trojans
- 2024LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoning