mlsanityData to 14 Oct 2026

Enhancing Large Language Models for Hardware Verification: A Novel SystemVerilog Assertion Dataset

arXiv 2503.08923 ↗First posted 11 Mar 2025cs.LG cs.CR cs.PLcited by 10

Not on the map. Why?

Abstract (arXiv)

Hardware verification is crucial in modern SoC design, consuming around 70% of development time. SystemVerilog assertions ensure correct functionality. However, existing industrial practices rely on manual efforts for assertion generation, which becomes increasingly untenable as hardware systems become complex. Recent research shows that Large Language Models (LLMs) can automate this process. However, proprietary SOTA models like GPT-4o often generate inaccurate assertions and require expensive licenses, while smaller open-source LLMs need fine-tuning to manage HDL code complexities. To address these issues, we introduce **VERT**, an open-source dataset designed to enhance SystemVerilog assertion generation using LLMs. VERT enables researchers in academia and industry to fine-tune open-source models, outperforming larger proprietary ones in both accuracy and efficiency while ensuring data privacy through local fine-tuning and eliminating costly licenses. The dataset is curated by systematically augmenting variables from open-source HDL repositories to generate synthetic code snippets paired with corresponding assertions. Experimental results demonstrate that fine-tuned models like Deepseek Coder 6.7B and Llama 3.1 8B outperform GPT-4o, achieving up to 96.88% improvement over base models and 24.14% over GPT-4o on platforms including OpenTitan, CVA6, OpenPiton and Pulpissimo. VERT is available at https://github.com/AnandMenon12/VERT.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 25 of its 56 references that are in the map. First posted on arXiv 11 Mar 2025.

Builds on

25 of 56 references.

References · 25

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  6. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  7. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  8. 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 252
  9. 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 200
  10. 2023ChipNeMo: Domain-Adapted LLMs for Chip Designcited by 174
  11. 2024MEDEC: A Benchmark for Medical Error Detection and Correction in Clinical Notescited by 80
  12. 2024MG-Verilog: Multi-grained Dataset Towards Enhanced LLM-assisted Verilog Generationcited by 46
13 more
  1. 2023(Security) Assertions by Large Language Modelscited by 32
  2. 2024AssertLLM: Generating and Evaluating Hardware Verification Assertions from Design Specifications via Multi-LLMscited by 31
  3. 2024AssertLLM: Generating Hardware Verification Assertions from Design Specifications via Multi-LLMscited by 31
  4. 2024RTL-Repo: A Benchmark for Evaluating LLMs on Large-Scale RTL Design Projectscited by 26
  5. 2023LLM4DV: Using Large Language Models for Hardware Test Stimuli Generationcited by 23
  6. 2019The Cost of Application-Class Processing: Energy and Performance Analysis of a Linux-ready 1.7GHz 64bit RISC-V Core in 22nm FDSOI Technologycited by 17
  7. 2024UVLLM: An Automated Universal RTL Verification Framework using LLMscited by 17
  8. 2024EDA Corpus: A Large Language Model Dataset for Enhanced Interaction with OpenROADcited by 13
  9. 2024Hardware Phi-1.5B: A Large Language Model Encodes Hardware Domain Specific Knowledgecited by 10
  10. 2024SA-DS: A Dataset for Large Language Model-Driven AI Accelerator Design Generationcited by 9
  11. 2017A Transprecision Floating-Point Platform for Ultra-Low Power Computingcited by 5
  12. 2021Isadora: Automated Information Flow Property Generation for Hardware Designscited by 3
  13. 2023SCAR: Power Side-Channel Analysis at RTL-Levelcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 7.

10 papers.