mlsanityData to 7 Oct 2026

From Concept to Practice: an Automated LLM-aided UVM Machine for RTL Verification

arXiv 2504.19959 ↗First posted 28 Apr 2025cs.AR cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Verification presents a major bottleneck in Integrated Circuit (IC) development, consuming nearly 70% of the total development effort. While the Universal Verification Methodology (UVM) is widely used in industry to improve verification efficiency through structured and reusable testbenches, constructing these testbenches and generating sufficient stimuli remain challenging. These challenges arise from the considerable manual coding effort required, repetitive manual execution of multiple EDA tools, and the need for in-depth domain expertise to navigate complex designs.Here, we present UVM^2, an automated verification framework that leverages Large Language Models (LLMs) to generate UVM testbenches and iteratively refine them using coverage feedback, significantly reducing manual effort while maintaining rigorous verification standards.To evaluate UVM^2, we introduce a benchmark suite comprising Register Transfer Level (RTL) designs of up to 1.6K lines of code.The results show that UVM^2 reduces testbench setup time by up to UVM^2 compared to experienced engineers, and achieve average code and function coverage of 87.44% and 89.58%, outperforming state-of-the-art solutions by 20.96% and 23.51%, respectively.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 17 of its 45 references that are in the map. First posted on arXiv 28 Apr 2025.

Builds on

17 of 45 references.

References · 17

  1. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  2. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
  3. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
  4. 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 246
  5. 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 197
  6. 2023RTLLM: An Open-Source Benchmark for Design RTL Generation with Large Language Modelcited by 143
  7. 2023Chip-Chat: Challenges and Opportunities in Conversational Hardware Designcited by 136
  8. 2023ChipGPT: How far are we from natural language hardware designcited by 101
  9. 2023RTLFixer: Automatically Fixing RTL Syntax Errors with Large Language Modelscited by 98
  10. 2024Make Every Move Count: LLM-based High-Quality RTL Code Generation Using MCTScited by 42
  11. 2024AssertLLM: Generating and Evaluating Hardware Verification Assertions from Design Specifications via Multi-LLMscited by 30
  12. 2024HDLdebugger: Streamlining HDL debugging with Large Language Modelscited by 25
5 more
  1. 2024MEIC: Re-thinking RTL Debug Automation using LLMscited by 25
  2. 2024LLM4SecHW: Leveraging Domain Specific Large Language Model for Hardware Debuggingcited by 18
  3. 2024UVLLM: An Automated Universal RTL Verification Framework using LLMscited by 17
  4. 2024Location is Key: Leveraging Large Language Model for Functional Bug Localization in Verilogcited by 8
  5. 2025Insights from Rights and Wrongs: A Large Language Model for Solving Assertion Failures in RTL Designcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.