Enhancing Large Language Models for Hardware Verification: A Novel SystemVerilog Assertion Dataset
Not on the map. Why?
Abstract (arXiv)
Hardware verification is crucial in modern SoC design, consuming around 70% of development time. SystemVerilog assertions ensure correct functionality. However, existing industrial practices rely on manual efforts for assertion generation, which becomes increasingly untenable as hardware systems become complex. Recent research shows that Large Language Models (LLMs) can automate this process. However, proprietary SOTA models like GPT-4o often generate inaccurate assertions and require expensive licenses, while smaller open-source LLMs need fine-tuning to manage HDL code complexities. To address these issues, we introduce **VERT**, an open-source dataset designed to enhance SystemVerilog assertion generation using LLMs. VERT enables researchers in academia and industry to fine-tune open-source models, outperforming larger proprietary ones in both accuracy and efficiency while ensuring data privacy through local fine-tuning and eliminating costly licenses. The dataset is curated by systematically augmenting variables from open-source HDL repositories to generate synthetic code snippets paired with corresponding assertions. Experimental results demonstrate that fine-tuned models like Deepseek Coder 6.7B and Llama 3.1 8B outperform GPT-4o, achieving up to 96.88% improvement over base models and 24.14% over GPT-4o on platforms including OpenTitan, CVA6, OpenPiton and Pulpissimo. VERT is available at https://github.com/AnandMenon12/VERT.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 25 of its 56 references that are in the map. First posted on arXiv 11 Mar 2025.
Builds on
25 of 56 references.
References · 25
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
- 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 252
- 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 200
- 2023ChipNeMo: Domain-Adapted LLMs for Chip Designcited by 174
- 2024MEDEC: A Benchmark for Medical Error Detection and Correction in Clinical Notescited by 80
- 2024MG-Verilog: Multi-grained Dataset Towards Enhanced LLM-assisted Verilog Generationcited by 46
13 more
- 2023(Security) Assertions by Large Language Modelscited by 32
- 2024AssertLLM: Generating and Evaluating Hardware Verification Assertions from Design Specifications via Multi-LLMscited by 31
- 2024AssertLLM: Generating Hardware Verification Assertions from Design Specifications via Multi-LLMscited by 31
- 2024RTL-Repo: A Benchmark for Evaluating LLMs on Large-Scale RTL Design Projectscited by 26
- 2023LLM4DV: Using Large Language Models for Hardware Test Stimuli Generationcited by 23
- 2019The Cost of Application-Class Processing: Energy and Performance Analysis of a Linux-ready 1.7GHz 64bit RISC-V Core in 22nm FDSOI Technologycited by 17
- 2024UVLLM: An Automated Universal RTL Verification Framework using LLMscited by 17
- 2024EDA Corpus: A Large Language Model Dataset for Enhanced Interaction with OpenROADcited by 13
- 2024Hardware Phi-1.5B: A Large Language Model Encodes Hardware Domain Specific Knowledgecited by 10
- 2024SA-DS: A Dataset for Large Language Model-Driven AI Accelerator Design Generationcited by 9
- 2017A Transprecision Floating-Point Platform for Ultra-Low Power Computingcited by 5
- 2021Isadora: Automated Information Flow Property Generation for Hardware Designscited by 3
- 2023SCAR: Power Side-Channel Analysis at RTL-Levelcited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 7.
10 papers.
- 2025A Survey of Circuit Foundation Model: Foundation AI Models for VLSI Circuit Design and EDAcited by 17
- 2026AssertLLM2: A Comprehensive LLM Benchmark for Assertion Generation from Design Specificationscited by 3
- 2025STELLAR: Structure-guided LLM Assertion Retrieval and Generation for Formal Verificationcited by 1
- 2026GUIDE: GenAI Units In Digital Design Educationcited by 1
- 2026Robustness of LLM-Generated SystemVerilog Assertions to Semantics-Preserving RTL Transformationscited by 1
- 2025AutoAssert 1: A LoRA Fine-Tuned LLM Model for Efficient Automated Assertion Generationcited by 0
- 2026HierSVA: A Data Synthesis Pipeline, Dataset, and Benchmark for LLM-Driven Hierarchical Hardware Formal Verificationcited by 0
- 2026VeriChat: An Agentic Conversational AI Assistant for Hardware Security Verificationcited by 0
- 2026WaveformQA: Benchmarking LLM Temporal Reasoning on Digital Waveformscited by 0
- 2026EquivSVA: A Formally Verified Dataset of Behavioral Assertions Across Equivalent RTL Implementationscited by 0
- 2026EquivSVA: A Formally Verified Dataset of Behavioral Assertions Across Equivalent RTL Implementations22 Sep 2026
- 2026Robustness of LLM-Generated SystemVerilog Assertions to Semantics-Preserving RTL Transformations4 Sep 2026
- 2026WaveformQA: Benchmarking LLM Temporal Reasoning on Digital Waveforms22 Jul 2026
- 2026VeriChat: An Agentic Conversational AI Assistant for Hardware Security Verification2 Jul 2026
- 2026HierSVA: A Data Synthesis Pipeline, Dataset, and Benchmark for LLM-Driven Hierarchical Hardware Formal Verification9 Jun 2026
- 2026AssertLLM2: A Comprehensive LLM Benchmark for Assertion Generation from Design Specifications26 May 2026
- 2026GUIDE: GenAI Units In Digital Design Education18 Mar 2026
- 2025STELLAR: Structure-guided LLM Assertion Retrieval and Generation for Formal Verification28 Nov 2025
- 2025AutoAssert 1: A LoRA Fine-Tuned LLM Model for Efficient Automated Assertion Generation10 Aug 2025
- 2025A Survey of Circuit Foundation Model: Foundation AI Models for VLSI Circuit Design and EDA28 Mar 2025