HDLdebugger: Streamlining HDL debugging with Large Language Models
Not on the map. Why?
Abstract (arXiv)
In the domain of chip design, Hardware Description Languages (HDLs) play a pivotal role. However, due to the complex syntax of HDLs and the limited availability of online resources, debugging HDL codes remains a difficult and time-intensive task, even for seasoned engineers. Consequently, there is a pressing need to develop automated HDL code debugging models, which can alleviate the burden on hardware engineers. Despite the strong capabilities of Large Language Models (LLMs) in generating, completing, and debugging software code, their utilization in the specialized field of HDL debugging has been limited and, to date, has not yielded satisfactory results. In this paper, we propose an LLM-assisted HDL debugging framework, namely HDLdebugger, which consists of HDL debugging data generation via a reverse engineering approach, a search engine for retrieval-augmented generation, and a retrieval-augmented LLM fine-tuning approach. Through the integration of these components, HDLdebugger can automate and streamline HDL debugging for chip design. Our comprehensive experiments, conducted on an HDL code dataset sourced from Huawei, reveal that HDLdebugger outperforms 13 cutting-edge LLM baselines, displaying exceptional effectiveness in HDL code debugging.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 31 of its 81 references that are in the map. First posted on arXiv 18 Mar 2024.
Builds on
31 of 81 references.
References · 31
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2023Teaching Large Language Models to Self-Debugcited by 988
- 2023StarCoder: may the source be with you!cited by 799
19 more
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
- 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 252
- 2023OpenChat: Advancing Open-source Language Models with Mixed-Quality Datacited by 252
- 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 200
- 2023ChipNeMo: Domain-Adapted LLMs for Chip Designcited by 174
- 2023Software Testing with Large Language Models: Survey, Landscape, and Visioncited by 166
- 2023Orca 2: Teaching Small Language Models How to Reasoncited by 159
- 2023Chip-Chat: Challenges and Opportunities in Conversational Hardware Designcited by 140
- 2023RTLFixer: Automatically Fixing RTL Syntax Errors with Large Language Modelscited by 100
- 2024BetterV: Controlled Verilog Generation with Discriminative Guidancecited by 100
- 2023RTLCoder: Outperforming GPT-3.5 in Design RTL Generation with Our Open-Source Dataset and Lightweight Solutioncited by 71
- 2019TBar: Revisiting Template-based Automated Program Repaircited by 65
- 2024Make Every Move Count: LLM-based High-Quality RTL Code Generation Using MCTScited by 43
- 2021Neural Transfer Learning for Repairing Security Vulnerabilities in C Codecited by 36
- 2018Nopol: Automatic Repair of Conditional Statement Bugs in Java Programscited by 32
- 2024AssertLLM: Generating and Evaluating Hardware Verification Assertions from Design Specifications via Multi-LLMscited by 31
- 2017ARJA: Automated Repair of Java Programs via Multi-Objective Genetic Programmingcited by 26
- 2018Automatic Software Repair: a Bibliographycited by 24
- 2016Precise Condition Synthesis for Program Repaircited by 13
Built on by
Citing papers per year: 2024: 8; 2025: 10; 2026: 8.
26 papers.
Sort:
By area:
- 2024AnalogCoder: Analog Circuit Design via Training-Free Code Generationcited by 84
- 2024RTLRewriter: Methodologies for Large Models aided RTL Code Optimizationcited by 31
- 2024Customized Retrieval Augmented Generation and Benchmarking for EDA Tool Documentation QAcited by 28
- 2024LLMs and the Future of Chip Design: Unveiling Security Risks and Building Trustcited by 20
- 2025AnalogCoder-Pro: Unifying Analog Circuit Generation and Optimization via Multi-modal LLMscited by 15
- 2025RealBench: Benchmarking Verilog Generation Models with Real-World IP Designscited by 14
- 2024Natural language is not enough: Benchmarking multi-modal generative AI for Verilog generationcited by 11
- 2025From Concept to Practice: an Automated LLM-aided UVM Machine for RTL Verificationcited by 9
- 2025Understanding and Mitigating Errors of LLM-Generated RTL Codecited by 8
- 2025ReChisel: Effective Automatic Chisel Code Generation by LLM with Reflectioncited by 6
- 2025SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Modelscited by 6
- 2025HLSDebugger: Identification and Correction of Logic Bugs in HLS Code with LLM Solutionscited by 5
14 more
- 2024SemiKong: Curating, Training, and Evaluating A Semiconductor Industry-Specific Large Language Modelcited by 4
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generationcited by 4
- 2024Classification-Based Automatic HDL Code Generation Using LLMscited by 3
- 2026Can Agents Secure Hardware? Evaluating Agentic LLM-Driven Obfuscation for IP Protectioncited by 3
- 2026HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMscited by 2
- 2024IICPilot: An Intelligent Integrated Circuit Backend Design Framework Using Open EDAcited by 1
- 2025GenEDA: Towards Generative Netlist Functional Reasoning via Cross-Modal Circuit Encoder-Decoder Alignmentcited by 1
- 2025HDLxGraph: Bridging Large Language Models and HDL Repositories via HDL Graph Databasescited by 1
- 2026Clover: A Neural-Symbolic Agentic Harness with Stochastic Tree-of-Thoughts for Verified RTL Repaircited by 1
- 2026VeriPilot: An LLM-Powered Verilog Debugging Frameworkcited by 1
- 2025DUET: Agentic Design Understanding via Experimentation and Testingcited by 0
- 2026SecureRAG-RTL: A Retrieval-Augmented, Multi-Agent, Zero-Shot LLM-Driven Framework for Hardware Vulnerability Detectioncited by 0
- 2026Agentic Electronic Design Automation: A Handoff Perspectivecited by 0
- 2026An Executable Benchmark for LLM-Based HLS Repair:Design Complexity and Repair Underconstraintcited by 0
- 2026An Executable Benchmark for LLM-Based HLS Repair:Design Complexity and Repair Underconstraint2 Oct 2026
- 2026VeriPilot: An LLM-Powered Verilog Debugging Framework22 Jun 2026
- 2026Agentic Electronic Design Automation: A Handoff Perspective18 Jun 2026
- 2026HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMs30 Apr 2026
- 2026Clover: A Neural-Symbolic Agentic Harness with Stochastic Tree-of-Thoughts for Verified RTL Repair19 Apr 2026
- 2026Can Agents Secure Hardware? Evaluating Agentic LLM-Driven Obfuscation for IP Protection14 Apr 2026
- 2026SecureRAG-RTL: A Retrieval-Augmented, Multi-Agent, Zero-Shot LLM-Driven Framework for Hardware Vulnerability Detection5 Mar 2026
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generation12 Jan 2026
- 2025DUET: Agentic Design Understanding via Experimentation and Testing6 Dec 2025
- 2025Understanding and Mitigating Errors of LLM-Generated RTL Code7 Aug 2025
- 2025AnalogCoder-Pro: Unifying Analog Circuit Generation and Optimization via Multi-modal LLMs4 Aug 2025
- 2025HLSDebugger: Identification and Correction of Logic Bugs in HLS Code with LLM Solutions29 Jul 2025
14 more
- 2025RealBench: Benchmarking Verilog Generation Models with Real-World IP Designs22 Jul 2025
- 2025SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Models25 Jun 2025
- 2025ReChisel: Effective Automatic Chisel Code Generation by LLM with Reflection26 May 2025
- 2025HDLxGraph: Bridging Large Language Models and HDL Repositories via HDL Graph Databases21 May 2025
- 2025From Concept to Practice: an Automated LLM-aided UVM Machine for RTL Verification28 Apr 2025
- 2025GenEDA: Towards Generative Netlist Functional Reasoning via Cross-Modal Circuit Encoder-Decoder Alignment13 Apr 2025
- 2024SemiKong: Curating, Training, and Evaluating A Semiconductor Industry-Specific Large Language Model21 Nov 2024
- 2024RTLRewriter: Methodologies for Large Models aided RTL Code Optimization4 Sep 2024
- 2024Customized Retrieval Augmented Generation and Benchmarking for EDA Tool Documentation QA22 Jul 2024
- 2024IICPilot: An Intelligent Integrated Circuit Backend Design Framework Using Open EDA17 Jul 2024
- 2024Natural language is not enough: Benchmarking multi-modal generative AI for Verilog generation11 Jul 2024
- 2024Classification-Based Automatic HDL Code Generation Using LLMs4 Jul 2024
- 2024AnalogCoder: Analog Circuit Design via Training-Free Code Generation23 May 2024
- 2024LLMs and the Future of Chip Design: Unveiling Security Risks and Building Trust11 May 2024
- 2025SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Modelscited by 6
- 2026Can Agents Secure Hardware? Evaluating Agentic LLM-Driven Obfuscation for IP Protectioncited by 3
- 2025DUET: Agentic Design Understanding via Experimentation and Testingcited by 0
- 2026Agentic Electronic Design Automation: A Handoff Perspectivecited by 0
- 2026Agentic Electronic Design Automation: A Handoff Perspective18 Jun 2026
- 2026Can Agents Secure Hardware? Evaluating Agentic LLM-Driven Obfuscation for IP Protection14 Apr 2026
- 2025DUET: Agentic Design Understanding via Experimentation and Testing6 Dec 2025
- 2025SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Models25 Jun 2025
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generationcited by 4
- 2025GenEDA: Towards Generative Netlist Functional Reasoning via Cross-Modal Circuit Encoder-Decoder Alignmentcited by 1
- 2026Clover: A Neural-Symbolic Agentic Harness with Stochastic Tree-of-Thoughts for Verified RTL Repaircited by 1
- 2026Clover: A Neural-Symbolic Agentic Harness with Stochastic Tree-of-Thoughts for Verified RTL Repair19 Apr 2026
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generation12 Jan 2026
- 2025GenEDA: Towards Generative Netlist Functional Reasoning via Cross-Modal Circuit Encoder-Decoder Alignment13 Apr 2025
- 2024Customized Retrieval Augmented Generation and Benchmarking for EDA Tool Documentation QAcited by 28
- 2025HDLxGraph: Bridging Large Language Models and HDL Repositories via HDL Graph Databasescited by 1
- 2026SecureRAG-RTL: A Retrieval-Augmented, Multi-Agent, Zero-Shot LLM-Driven Framework for Hardware Vulnerability Detectioncited by 0
- 2026SecureRAG-RTL: A Retrieval-Augmented, Multi-Agent, Zero-Shot LLM-Driven Framework for Hardware Vulnerability Detection5 Mar 2026
- 2025HDLxGraph: Bridging Large Language Models and HDL Repositories via HDL Graph Databases21 May 2025
- 2024Customized Retrieval Augmented Generation and Benchmarking for EDA Tool Documentation QA22 Jul 2024
- 2024AnalogCoder: Analog Circuit Design via Training-Free Code Generationcited by 84
- 2024RTLRewriter: Methodologies for Large Models aided RTL Code Optimizationcited by 31
- 2024LLMs and the Future of Chip Design: Unveiling Security Risks and Building Trustcited by 20
- 2025AnalogCoder-Pro: Unifying Analog Circuit Generation and Optimization via Multi-modal LLMscited by 15
- 2025RealBench: Benchmarking Verilog Generation Models with Real-World IP Designscited by 14
- 2024Natural language is not enough: Benchmarking multi-modal generative AI for Verilog generationcited by 11
- 2025From Concept to Practice: an Automated LLM-aided UVM Machine for RTL Verificationcited by 9
- 2025Understanding and Mitigating Errors of LLM-Generated RTL Codecited by 8
- 2025ReChisel: Effective Automatic Chisel Code Generation by LLM with Reflectioncited by 6
- 2025HLSDebugger: Identification and Correction of Logic Bugs in HLS Code with LLM Solutionscited by 5
- 2024SemiKong: Curating, Training, and Evaluating A Semiconductor Industry-Specific Large Language Modelcited by 4
- 2024Classification-Based Automatic HDL Code Generation Using LLMscited by 3
12 most cited of 16 All 16 (JSON)
- 2026An Executable Benchmark for LLM-Based HLS Repair:Design Complexity and Repair Underconstraint2 Oct 2026
- 2026VeriPilot: An LLM-Powered Verilog Debugging Framework22 Jun 2026
- 2026HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMs30 Apr 2026
- 2025Understanding and Mitigating Errors of LLM-Generated RTL Code7 Aug 2025
- 2025AnalogCoder-Pro: Unifying Analog Circuit Generation and Optimization via Multi-modal LLMs4 Aug 2025
- 2025HLSDebugger: Identification and Correction of Logic Bugs in HLS Code with LLM Solutions29 Jul 2025
- 2025RealBench: Benchmarking Verilog Generation Models with Real-World IP Designs22 Jul 2025
- 2025ReChisel: Effective Automatic Chisel Code Generation by LLM with Reflection26 May 2025
- 2025From Concept to Practice: an Automated LLM-aided UVM Machine for RTL Verification28 Apr 2025
- 2024SemiKong: Curating, Training, and Evaluating A Semiconductor Industry-Specific Large Language Model21 Nov 2024
- 2024RTLRewriter: Methodologies for Large Models aided RTL Code Optimization4 Sep 2024
- 2024IICPilot: An Intelligent Integrated Circuit Backend Design Framework Using Open EDA17 Jul 2024
12 newest of 16 All 16 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025HDLCoRe: A Training-Free Framework for Mitigating Hallucinations in LLM-Generated HDL
- 2025CorrectHDL: Agentic HDL Design with LLMs Leveraging High-Level Synthesis as Reference
- 2025hdl2v: A Code Translation Dataset for Enhanced LLM Verilog Generation
- 2024RTL-Breaker: Assessing the Security of LLMs against Backdoor Attacks on HDL Code Generation
- 2025Large Language Model for Verilog Code Generation: Literature Review and the Road Ahead
- 2026VHDLSuite: Unified Pipeline for LLM VHDL Generation with Data Synthesis and Evaluation
- 2025Exploring Code Language Models for Automated HLS-based Hardware Generation: Benchmark, Infrastructure and Analysis
- 2024MetRex: A Benchmark for Verilog Code Metric Reasoning Using LLMs