From Concept to Practice: an Automated LLM-aided UVM Machine for RTL Verification
Not on the map. Why?
Abstract (arXiv)
Verification presents a major bottleneck in Integrated Circuit (IC) development, consuming nearly 70% of the total development effort. While the Universal Verification Methodology (UVM) is widely used in industry to improve verification efficiency through structured and reusable testbenches, constructing these testbenches and generating sufficient stimuli remain challenging. These challenges arise from the considerable manual coding effort required, repetitive manual execution of multiple EDA tools, and the need for in-depth domain expertise to navigate complex designs.Here, we present UVM^2, an automated verification framework that leverages Large Language Models (LLMs) to generate UVM testbenches and iteratively refine them using coverage feedback, significantly reducing manual effort while maintaining rigorous verification standards.To evaluate UVM^2, we introduce a benchmark suite comprising Register Transfer Level (RTL) designs of up to 1.6K lines of code.The results show that UVM^2 reduces testbench setup time by up to UVM^2 compared to experienced engineers, and achieve average code and function coverage of 87.44% and 89.58%, outperforming state-of-the-art solutions by 20.96% and 23.51%, respectively.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 17 of its 45 references that are in the map. First posted on arXiv 28 Apr 2025.
Builds on
17 of 45 references.
References · 17
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
- 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
- 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 246
- 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 197
- 2023RTLLM: An Open-Source Benchmark for Design RTL Generation with Large Language Modelcited by 143
- 2023Chip-Chat: Challenges and Opportunities in Conversational Hardware Designcited by 136
- 2023ChipGPT: How far are we from natural language hardware designcited by 101
- 2023RTLFixer: Automatically Fixing RTL Syntax Errors with Large Language Modelscited by 98
- 2024Make Every Move Count: LLM-based High-Quality RTL Code Generation Using MCTScited by 42
- 2024AssertLLM: Generating and Evaluating Hardware Verification Assertions from Design Specifications via Multi-LLMscited by 30
- 2024HDLdebugger: Streamlining HDL debugging with Large Language Modelscited by 25
5 more
- 2024MEIC: Re-thinking RTL Debug Automation using LLMscited by 25
- 2024LLM4SecHW: Leveraging Domain Specific Large Language Model for Hardware Debuggingcited by 18
- 2024UVLLM: An Automated Universal RTL Verification Framework using LLMscited by 17
- 2024Location is Key: Leveraging Large Language Model for Functional Bug Localization in Verilogcited by 8
- 2025Insights from Rights and Wrongs: A Large Language Model for Solving Assertion Failures in RTL Designcited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2025ChipMind: Retrieval-Augmented Reasoning for Long-Context Circuit Design Specificationscited by 3
- 2026QiMeng-CodeV-SVA: Training Specialized LLMs for Hardware Assertion Generation via RTL-Grounded Bidirectional Data Synthesiscited by 2
- 2026UCAgent: An End-to-End Agent for Block-Level Functional Verificationcited by 1
- 2026HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMscited by 1
- 2026GoGoTB: Agentic RTL Verification with Specification-Grounded Coverage Closurecited by 1
- 2026Agentic Electronic Design Automation: A Handoff Perspectivecited by 0
- 2026AgentDV: Closed-Loop Agentic AI for Hardware Design Verificationcited by 0
- 2026LLMs in Digital EDA: A perspective on shifting roles from Generation to Orchestrationcited by 0
- 2026LLMs in Digital EDA: A perspective on shifting roles from Generation to Orchestration27 Aug 2026
- 2026AgentDV: Closed-Loop Agentic AI for Hardware Design Verification27 Aug 2026
- 2026GoGoTB: Agentic RTL Verification with Specification-Grounded Coverage Closure28 Jul 2026
- 2026Agentic Electronic Design Automation: A Handoff Perspective18 Jun 2026
- 2026HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMs30 Apr 2026
- 2026UCAgent: An End-to-End Agent for Block-Level Functional Verification26 Mar 2026
- 2026QiMeng-CodeV-SVA: Training Specialized LLMs for Hardware Assertion Generation via RTL-Grounded Bidirectional Data Synthesis15 Mar 2026
- 2025ChipMind: Retrieval-Augmented Reasoning for Long-Context Circuit Design Specifications5 Dec 2025