mlsanityData to 14 Oct 2026

Automatic High-quality Verilog Assertion Generation through Subtask-Focused Fine-Tuned LLMs and Iterative Prompting

arXiv 2411.15442 ↗First posted 23 Nov 2024cs.AR cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Formal Property Verification (FPV), using SystemVerilog Assertions (SVA), is crucial for ensuring the completeness of design with respect to the specification. However, writing SVA is a laborious task and has a steep learning curve. In this work, we present a large language model (LLM) -based flow to automatically generate high-quality SVA from the design specification documents, named ToolName. We introduce a novel sub-task-focused fine-tuning approach that effectively addresses functionally incorrect assertions produced by baseline LLMs, leading to a remarkable 7.3-fold increase in the number of functionally correct assertions. Recognizing the prevalence of syntax and semantic errors, we also developed an iterative refinement method that enhances the LLM's initial outputs by systematically re-prompting it to correct identified issues. This process is further strengthened by a custom compiler that generates meaningful error messages, guiding the LLM towards improved accuracy. The experiments demonstrate a 26% increase in the number of assertions free from syntax errors using this approach, showcasing its potential to streamline the FPV process.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 12 of its 28 references that are in the map. First posted on arXiv 23 Nov 2024.

Builds on

12 of 28 references.

References · 12

  1. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  2. 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 200
  3. 2023Software Testing with Large Language Models: Survey, Landscape, and Visioncited by 166
  4. 2019oLMpics -- On what Language Model Pre-training Capturescited by 161
  5. 2019Multi-hop Reading Comprehension through Question Decomposition and Rescoringcited by 119
  6. 2022Less Training, More Repairing Please: Revisiting Automated Program Repair via Zero-shot Learningcited by 76
  7. 2021A Syntax-Guided Edit Decoder for Neural Program Repaircited by 57
  8. 2020DAVE: Deriving Automatically Verilog from Englishcited by 48
  9. 2023(Security) Assertions by Large Language Modelscited by 32
  10. 2023Using LLMs to Facilitate Formal Verification of RTLcited by 18
  11. 2023ITER: Iterative Neural Repair for Multi-Location Patchescited by 16
  12. 2021AutoSVA: Democratizing Formal Verification of RTL Module Interactionscited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.