UVLLM: An Automated Universal RTL Verification Framework using LLMs
Not on the map. Why?
Abstract (arXiv)
Verifying hardware designs in embedded systems is crucial but often labor-intensive and time-consuming. While existing solutions have improved automation, they frequently rely on unrealistic assumptions. To address these challenges, we introduce a novel framework, UVLLM, which combines Large Language Models (LLMs) with the Universal Verification Methodology (UVM) to relax these assumptions. UVLLM significantly enhances the automation of testing and repairing error-prone Register Transfer Level (RTL) codes, a critical aspect of verification development. Unlike existing methods, UVLLM ensures that all errors are triggered during verification, achieving a syntax error fix rate of 86.99% and a functional error fix rate of 71.92% on our proposed benchmark. These results demonstrate a substantial improvement in verification efficiency. Additionally, our study highlights the current limitations of LLM applications, particularly their reliance on extensive training data. We emphasize the transformative potential of LLMs in hardware design verification and suggest promising directions for future research in AI-driven hardware design methodologies. The Repo. of dataset and code: https://anonymous.4open.science/r/UVLLM/.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Nov 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 8; 2026: 9.
17 papers.
Sort:
By area:
- 2025Enhancing Large Language Models for Hardware Verification: A Novel SystemVerilog Assertion Datasetcited by 10
- 2025From Concept to Practice: an Automated LLM-aided UVM Machine for RTL Verificationcited by 9
- 2025Revolution or Hype? Seeking the Limits of Large Models in Hardware Designcited by 9
- 2026ChipBench: A Next-Step Benchmark for Evaluating LLM Performance in AI-Aided Chip Designcited by 8
- 2025iDSE: Navigating Design Space Exploration in High-Level Synthesis Using LLMscited by 7
- 2025SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Modelscited by 6
- 2026ChatSVA: Bridging SVA Generation for Hardware Verification via Task-Specific LLMscited by 6
- 2025ChipMind: Retrieval-Augmented Reasoning for Long-Context Circuit Design Specificationscited by 4
- 2025A Large Language Model-based Multi-Agent Framework for Analog Circuits' Sizing Relationships Extractioncited by 3
- 2025R3A: Reliable RTL Repair Framework with Multi-Agent Fault Localization and Stochastic Tree-of-Thoughts Patch Generationcited by 2
- 2026QiMeng-CodeV-SVA: Training Specialized LLMs for Hardware Assertion Generation via RTL-Grounded Bidirectional Data Synthesiscited by 2
- 2026HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMscited by 2
5 more
- 2026Clover: A Neural-Symbolic Agentic Harness with Stochastic Tree-of-Thoughts for Verified RTL Repaircited by 1
- 2026RefEvo: Agentic Design with Co-Evolutionary Verification for Agile Reference Model Generationcited by 1
- 2026GoGoTB: Agentic RTL Verification with Specification-Grounded Coverage Closurecited by 1
- 2026Agentic Electronic Design Automation: A Handoff Perspectivecited by 0
- 2026PICasso: An AI-Enabled Design Framework for Autonomous Optimization of Silicon Photonic Devicescited by 0
- 2026GoGoTB: Agentic RTL Verification with Specification-Grounded Coverage Closure28 Jul 2026
- 2026Agentic Electronic Design Automation: A Handoff Perspective18 Jun 2026
- 2026PICasso: An AI-Enabled Design Framework for Autonomous Optimization of Silicon Photonic Devices28 May 2026
- 2026HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMs30 Apr 2026
- 2026RefEvo: Agentic Design with Co-Evolutionary Verification for Agile Reference Model Generation27 Apr 2026
- 2026Clover: A Neural-Symbolic Agentic Harness with Stochastic Tree-of-Thoughts for Verified RTL Repair19 Apr 2026
- 2026ChatSVA: Bridging SVA Generation for Hardware Verification via Task-Specific LLMs3 Apr 2026
- 2026QiMeng-CodeV-SVA: Training Specialized LLMs for Hardware Assertion Generation via RTL-Grounded Bidirectional Data Synthesis15 Mar 2026
- 2026ChipBench: A Next-Step Benchmark for Evaluating LLM Performance in AI-Aided Chip Design29 Jan 2026
- 2025ChipMind: Retrieval-Augmented Reasoning for Long-Context Circuit Design Specifications5 Dec 2025
- 2025R3A: Reliable RTL Repair Framework with Multi-Agent Fault Localization and Stochastic Tree-of-Thoughts Patch Generation25 Nov 2025
- 2025Revolution or Hype? Seeking the Limits of Large Models in Hardware Design5 Sep 2025
5 more
- 2025SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Models25 Jun 2025
- 2025A Large Language Model-based Multi-Agent Framework for Analog Circuits' Sizing Relationships Extraction23 Jun 2025
- 2025iDSE: Navigating Design Space Exploration in High-Level Synthesis Using LLMs28 May 2025
- 2025From Concept to Practice: an Automated LLM-aided UVM Machine for RTL Verification28 Apr 2025
- 2025Enhancing Large Language Models for Hardware Verification: A Novel SystemVerilog Assertion Dataset11 Mar 2025
- 2025SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Modelscited by 6
- 2026RefEvo: Agentic Design with Co-Evolutionary Verification for Agile Reference Model Generationcited by 1
- 2026GoGoTB: Agentic RTL Verification with Specification-Grounded Coverage Closurecited by 1
- 2026Agentic Electronic Design Automation: A Handoff Perspectivecited by 0
- 2026GoGoTB: Agentic RTL Verification with Specification-Grounded Coverage Closure28 Jul 2026
- 2026Agentic Electronic Design Automation: A Handoff Perspective18 Jun 2026
- 2026RefEvo: Agentic Design with Co-Evolutionary Verification for Agile Reference Model Generation27 Apr 2026
- 2025SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Models25 Jun 2025
- 2025Enhancing Large Language Models for Hardware Verification: A Novel SystemVerilog Assertion Datasetcited by 10
- 2025From Concept to Practice: an Automated LLM-aided UVM Machine for RTL Verificationcited by 9
- 2025Revolution or Hype? Seeking the Limits of Large Models in Hardware Designcited by 9
- 2026ChipBench: A Next-Step Benchmark for Evaluating LLM Performance in AI-Aided Chip Designcited by 8
- 2025iDSE: Navigating Design Space Exploration in High-Level Synthesis Using LLMscited by 7
- 2026ChatSVA: Bridging SVA Generation for Hardware Verification via Task-Specific LLMscited by 6
- 2025A Large Language Model-based Multi-Agent Framework for Analog Circuits' Sizing Relationships Extractioncited by 3
- 2025R3A: Reliable RTL Repair Framework with Multi-Agent Fault Localization and Stochastic Tree-of-Thoughts Patch Generationcited by 2
- 2026HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMscited by 2
- 2026PICasso: An AI-Enabled Design Framework for Autonomous Optimization of Silicon Photonic Devicescited by 0
- 2026PICasso: An AI-Enabled Design Framework for Autonomous Optimization of Silicon Photonic Devices28 May 2026
- 2026HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMs30 Apr 2026
- 2026ChatSVA: Bridging SVA Generation for Hardware Verification via Task-Specific LLMs3 Apr 2026
- 2026ChipBench: A Next-Step Benchmark for Evaluating LLM Performance in AI-Aided Chip Design29 Jan 2026
- 2025R3A: Reliable RTL Repair Framework with Multi-Agent Fault Localization and Stochastic Tree-of-Thoughts Patch Generation25 Nov 2025
- 2025Revolution or Hype? Seeking the Limits of Large Models in Hardware Design5 Sep 2025
- 2025A Large Language Model-based Multi-Agent Framework for Analog Circuits' Sizing Relationships Extraction23 Jun 2025
- 2025iDSE: Navigating Design Space Exploration in High-Level Synthesis Using LLMs28 May 2025
- 2025From Concept to Practice: an Automated LLM-aided UVM Machine for RTL Verification28 Apr 2025
- 2025Enhancing Large Language Models for Hardware Verification: A Novel SystemVerilog Assertion Dataset11 Mar 2025