LLM-Aided Testbench Generation and Bug Detection for Finite-State Machines
Not on the map. Why?
Abstract (arXiv)
This work investigates the potential of tailoring Large Language Models (LLMs), specifically GPT3.5 and GPT4, for the domain of chip testing. A key aspect of chip design is functional testing, which relies on testbenches to evaluate the functionality and coverage of Register-Transfer Level (RTL) designs. We aim to enhance testbench generation by incorporating feedback from commercial-grade Electronic Design Automation (EDA) tools into LLMs. Through iterative feedback from these tools, we refine the testbenches to achieve improved test coverage. Our case studies present promising results, demonstrating that this approach can effectively enhance test coverage. By integrating EDA tool feedback, the generated testbenches become more accurate in identifying potential issues in the RTL design. Furthermore, we extended our study to use this enhanced test coverage framework for detecting bugs in the RTL implementations
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Jun 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 3; 2025: 6; 2026: 8.
17 papers.
Sort:
By area:
- 2024CraftRTL: High-quality Synthetic Data Generation for Verilog Code Models with Correct-by-Construction Non-Textual Representations and Targeted Code Repaircited by 42
- 2024RTL-Breaker: Assessing the Security of LLMs against Backdoor Attacks on HDL Code Generationcited by 15
- 2025VeriContaminated: Assessing LLM-Driven Verilog Coding for Data Contaminationcited by 12
- 2025SALAD: Systematic Assessment of Machine Unlearning on LLM-Aided Hardware Designcited by 12
- 2025VeriLeaky: Navigating IP Protection vs Utility in Fine-Tuning for LLM-Driven Verilog Codingcited by 11
- 2024Are LLMs Any Good for High-Level Synthesis?cited by 6
- 2025ChipMind: Retrieval-Augmented Reasoning for Long-Context Circuit Design Specificationscited by 4
- 2026UCAgent: An End-to-End Agent for Block-Level Functional Verificationcited by 2
- 2025AutoFSM: A Multi-agent Framework for FSM Code Generation with IR and SystemC-Based Testingcited by 1
- 2026GUIDE: GenAI Units In Digital Design Educationcited by 1
- 2026LLMs for Secure Hardware Design and Related Problems: Opportunities and Challengescited by 1
- 2025Legal Document Summarization: Enhancing Judicial Efficiency through Automation Detectioncited by 0
5 more
- 2026Designing FSMs Specifications from Requirements with GPT 4.0cited by 0
- 2026EstRTL: Functional Estimation Guided RTL Code Generationcited by 0
- 2026Hardware Design and Security in the Era of Chiplets and LLMscited by 0
- 2026BEHAVE: Functional Behavior Modeling Enables Self-Improving Agents for Hardware Design and Verificationcited by 0
- 2026A Survey on LLM-Integrated Hardware Design Verificationcited by 0
- 2026A Survey on LLM-Integrated Hardware Design Verification6 Oct 2026
- 2026BEHAVE: Functional Behavior Modeling Enables Self-Improving Agents for Hardware Design and Verification28 Sep 2026
- 2026Hardware Design and Security in the Era of Chiplets and LLMs5 Aug 2026
- 2026EstRTL: Functional Estimation Guided RTL Code Generation1 Jun 2026
- 2026LLMs for Secure Hardware Design and Related Problems: Opportunities and Challenges11 May 2026
- 2026Designing FSMs Specifications from Requirements with GPT 4.031 Mar 2026
- 2026UCAgent: An End-to-End Agent for Block-Level Functional Verification26 Mar 2026
- 2026GUIDE: GenAI Units In Digital Design Education18 Mar 2026
- 2025AutoFSM: A Multi-agent Framework for FSM Code Generation with IR and SystemC-Based Testing12 Dec 2025
- 2025ChipMind: Retrieval-Augmented Reasoning for Long-Context Circuit Design Specifications5 Dec 2025
- 2025Legal Document Summarization: Enhancing Judicial Efficiency through Automation Detection25 Jul 2025
- 2025SALAD: Systematic Assessment of Machine Unlearning on LLM-Aided Hardware Design2 Jun 2025
5 more
- 2025VeriContaminated: Assessing LLM-Driven Verilog Coding for Data Contamination17 Mar 2025
- 2025VeriLeaky: Navigating IP Protection vs Utility in Fine-Tuning for LLM-Driven Verilog Coding17 Mar 2025
- 2024RTL-Breaker: Assessing the Security of LLMs against Backdoor Attacks on HDL Code Generation26 Nov 2024
- 2024CraftRTL: High-quality Synthetic Data Generation for Verilog Code Models with Correct-by-Construction Non-Textual Representations and Targeted Code Repair19 Sep 2024
- 2024Are LLMs Any Good for High-Level Synthesis?19 Aug 2024
- 2025VeriContaminated: Assessing LLM-Driven Verilog Coding for Data Contaminationcited by 12
- 2025VeriLeaky: Navigating IP Protection vs Utility in Fine-Tuning for LLM-Driven Verilog Codingcited by 11
- 2024Are LLMs Any Good for High-Level Synthesis?cited by 6
- 2026GUIDE: GenAI Units In Digital Design Educationcited by 1
- 2026LLMs for Secure Hardware Design and Related Problems: Opportunities and Challengescited by 1
- 2025Legal Document Summarization: Enhancing Judicial Efficiency through Automation Detectioncited by 0
- 2026Designing FSMs Specifications from Requirements with GPT 4.0cited by 0
- 2026EstRTL: Functional Estimation Guided RTL Code Generationcited by 0
- 2026Hardware Design and Security in the Era of Chiplets and LLMscited by 0
- 2026Hardware Design and Security in the Era of Chiplets and LLMs5 Aug 2026
- 2026EstRTL: Functional Estimation Guided RTL Code Generation1 Jun 2026
- 2026LLMs for Secure Hardware Design and Related Problems: Opportunities and Challenges11 May 2026
- 2026Designing FSMs Specifications from Requirements with GPT 4.031 Mar 2026
- 2026GUIDE: GenAI Units In Digital Design Education18 Mar 2026
- 2025Legal Document Summarization: Enhancing Judicial Efficiency through Automation Detection25 Jul 2025
- 2025VeriContaminated: Assessing LLM-Driven Verilog Coding for Data Contamination17 Mar 2025
- 2025VeriLeaky: Navigating IP Protection vs Utility in Fine-Tuning for LLM-Driven Verilog Coding17 Mar 2025
- 2024Are LLMs Any Good for High-Level Synthesis?19 Aug 2024