AutoChip: Automating HDL Generation Using LLM Feedback
Not on the map. Why?
Abstract (arXiv)
Traditionally, designs are written in Verilog hardware description language (HDL) and debugged by hardware engineers. While this approach is effective, it is time-consuming and error-prone for complex designs. Large language models (LLMs) are promising in automating HDL code generation. LLMs are trained on massive datasets of text and code, and they can learn to generate code that compiles and is functionally accurate. We aim to evaluate the ability of LLMs to generate functionally correct HDL models. We build AutoChip by combining the interactive capabilities of LLMs and the output from Verilog simulations to generate Verilog modules. We start with a design prompt for a module and the context from compilation errors and debugging messages, which highlight differences between the expected and actual outputs. This ensures that accurate Verilog code can be generated without human intervention. We evaluate AutoChip using problem sets from HDLBits. We conduct a comprehensive analysis of the AutoChip using several LLMs and problem categories. The results show that incorporating context from compiler tools, such as Icarus Verilog, improves the effectiveness, yielding 24.20% more accurate Verilog. We release our evaluation scripts and datasets as open-source contributions at the following link https://github.com/shailja-thakur/AutoChip.
Key facts. Cited by 80 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Nov 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 1; 2024: 20; 2025: 39; 2026: 20.
80 papers.
Sort:
By area:
- 2024AnalogCoder: Analog Circuit Design via Training-Free Code Generationcited by 82
- 2024OriGen:Enhancing RTL Code Generation with Code-to-Code Augmentation and Self-Reflectioncited by 56
- 2024Make Every Move Count: LLM-based High-Quality RTL Code Generation Using MCTScited by 42
- 2023LLM4EDA: Emerging Progress in Large Language Models for Electronic Design Automationcited by 40
- 2025A Survey of Research in Large Language Models for Electronic Design Automationcited by 38
- 2024PropertyGPT: LLM-driven Formal Verification of Smart Contracts through Retrieval-Augmented Property Generationcited by 36
- 2024AutoVCoder: A Systematic Framework for Automated Verilog Code Generation using LLMscited by 36
- 2025AnalogGenie: A Generative Engine for Automatic Discovery of Analog Circuit Topologiescited by 35
- 2024Customized Retrieval Augmented Generation and Benchmarking for EDA Tool Documentation QAcited by 28
- 2024Rome was Not Built in a Single Step: Hierarchical Prompting for LLM-based Chip Designcited by 24
- 2024CreativEval: Evaluating Creativity of LLM-Based Hardware Code Generationcited by 19
- 2024PyraNet: A Multi-Layered Hierarchical Dataset for Verilogcited by 19
38 more
- 2024LLMs and the Future of Chip Design: Unveiling Security Risks and Building Trustcited by 18
- 2024Automatically Improving LLM-based Verilog Generation using EDA Tool Feedbackcited by 18
- 2025HDLCoRe: A Training-Free Framework for Mitigating Hallucinations in LLM-Generated HDLcited by 17
- 2024VerilogReader: LLM-Aided Hardware Test Generationcited by 16
- 2025VeriMoA: A Mixture-of-Agents Framework for Spec-to-HDL Generationcited by 15
- 2024VHDL-Eval: A Framework for Evaluating Large Language Models in VHDL Code Generationcited by 14
- 2025AnalogCoder-Pro: Unifying Analog Circuit Generation and Optimization via Multi-modal LLMscited by 14
- 2024EDA Corpus: A Large Language Model Dataset for Enhanced Interaction with OpenROADcited by 12
- 2025VeriContaminated: Assessing LLM-Driven Verilog Coding for Data Contaminationcited by 12
- 2024SPICEPilot: Navigating SPICE Code Generation and Simulation with AI Guidancecited by 10
- 2025VeriLeaky: Navigating IP Protection vs Utility in Fine-Tuning for LLM-Driven Verilog Codingcited by 10
- 2025SALAD: Systematic Assessment of Machine Unlearning on LLM-Aided Hardware Designcited by 10
- 2024ITERTL: An Iterative Framework for Fine-tuning LLMs for RTL Code Generationcited by 9
- 2025Can Reasoning Models Reason about Hardware? An Agentic HLS Perspectivecited by 9
- 2025Revolution or Hype? Seeking the Limits of Large Models in Hardware Designcited by 9
- 2025VerilogDB: The Largest, Highest-Quality Dataset with a Preprocessing Framework for LLM-based RTL Generationcited by 8
- 2025Understanding and Mitigating Errors of LLM-Generated RTL Codecited by 8
- 2024New Solutions on LLM Acceleration, Optimization, and Applicationcited by 7
- 2025RTLRepoCoder: Repository-Level RTL Code Completion through the Combination of Fine-Tuning and Retrieval Augmentationcited by 7
- 2025Image2Net: Datasets, Benchmark and Hybrid Framework to Convert Analog Circuit Diagrams into Netlistscited by 7
- 2025Large Language Model for Verilog Code Generation: Literature Review and the Road Aheadcited by 7
- 2025BugGen: A Self-Correcting Multi-Agent LLM Pipeline for Realistic RTL Bug Synthesiscited by 6
- 2025MMCircuitEval: A Comprehensive Multimodal Circuit-Focused Benchmark for Evaluating LLMscited by 6
- 2026Agentic Hardware Design as Repository-Level Code Evolutioncited by 6
- 2025ReChisel: Effective Automatic Chisel Code Generation by LLM with Reflectioncited by 5
- 2025VeriDispatcher: Multi-Model Dispatching through Pre-Inference Difficulty Prediction for RTL Generation Optimizationcited by 5
- 2025Using GUI Agent for Electronic Design Automationcited by 5
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generationcited by 4
- 2024Classification-Based Automatic HDL Code Generation Using LLMscited by 3
- 2025RTLMarker: Protecting LLM-Generated RTL Copyright via a Hardware Watermarking Frameworkcited by 3
- 2025CorrectHDL: Agentic HDL Design with LLMs Leveraging High-Level Synthesis as Referencecited by 3
- 2026Veri-Sure: A Contract-Aware Multi-Agent Framework with Temporal Tracing and Formal Verification for Correct RTL Code Generationcited by 3
- 2025TPU-Gen: LLM-Driven Custom Tensor Processing Unit Generatorcited by 2
- 2025Free and Fair Hardware: A Pathway to Copyright Infringement-Free Verilog Generation using LLMscited by 2
- 2025Evaluating LLM-based Workflows for Switched-Mode Power Supply Designcited by 2
- 2025EvoVerilog: Large Langugage Model Assisted Evolution of Verilog Codecited by 2
- 2026CODMAS: A Dialectic Multi-Agent Collaborative Framework for Structured RTL Optimizationcited by 2
- 2024Digital ASIC Design with Ongoing LLMs: Strategies and Prospectscited by 1
50 most cited of 80 All 80 (JSON)
- 2026LLMs in Digital EDA: A perspective on shifting roles from Generation to Orchestration27 Aug 2026
- 2026SeqFeed: Improving Agentic RTL Code Generation with Sequential Behavior Feedback9 Aug 2026
- 2026LACE: Large Language Model Aided Multi-Agent Framework for Agile RISC-V Instruction Extension3 Aug 2026
- 2026DRC-Aid: Design-Rule Correction via Agentic Framework utilizing Inference-Time Large Language Models23 Jul 2026
- 2026SINA: A Fully Automated Circuit Schematic Image to Netlist Generator Using Artificial Intelligence2 Jul 2026
- 2026Agentic Hardware Design as Repository-Level Code Evolution26 Jun 2026
- 2026VeriPilot: An LLM-Powered Verilog Debugging Framework22 Jun 2026
- 2026Interpretable and Verifiable Hardware Generation with LLM-Driven Stepwise Refinement16 Jun 2026
- 2026VHDLSuite: Unified Pipeline for LLM VHDL Generation with Data Synthesis and Evaluation11 Jun 2026
- 2026RTL-BenchLS: A Large-Scale Benchmark for RTL Reasoning and Generation with Large Language Models8 Jun 2026
- 2026ROSUM-MCTS: Monte Carlo Tree Search-Inspired HDL Code Summarization with Structural Rewards6 Jun 2026
- 2026R-APS: Compositional Reasoning and In-Context Meta-Learning for Constrained Design via Reflective Adversarial Pareto Search3 Jun 2026
38 more
- 2026PICasso: An AI-Enabled Design Framework for Autonomous Optimization of Silicon Photonic Devices28 May 2026
- 2026LEGO: An LLM Skill-Based Front-End Design Generation Platform25 Apr 2026
- 2026ChipCraftBrain: Validation-First RTL Generation via Multi-Agent Orchestration21 Apr 2026
- 2026GUIDE: GenAI Units In Digital Design Education18 Mar 2026
- 2026CODMAS: A Dialectic Multi-Agent Collaborative Framework for Structured RTL Optimization17 Mar 2026
- 2026SecureRAG-RTL: A Retrieval-Augmented, Multi-Agent, Zero-Shot LLM-Driven Framework for Hardware Vulnerability Detection5 Mar 2026
- 2026Veri-Sure: A Contract-Aware Multi-Agent Framework with Temporal Tracing and Formal Verification for Correct RTL Code Generation27 Jan 2026
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generation12 Jan 2026
- 2025AMS-IO-Bench and AMS-IO-Agent: Benchmarking and Structured Reasoning for Analog and Mixed-Signal Integrated Circuit Input/Output Design25 Dec 2025
- 2025Using GUI Agent for Electronic Design Automation12 Dec 2025
- 2025DUET: Agentic Design Understanding via Experimentation and Testing6 Dec 2025
- 2025When Forgetting Builds Reliability: LLM Unlearning for Reliable Hardware Code Generation5 Dec 2025
- 2025VeriDispatcher: Multi-Model Dispatching through Pre-Inference Difficulty Prediction for RTL Generation Optimization27 Nov 2025
- 2025Learning to Debug: LLM-Organized Knowledge Trees for Solving RTL Assertion Failures21 Nov 2025
- 2025CorrectHDL: Agentic HDL Design with LLMs Leveraging High-Level Synthesis as Reference20 Nov 2025
- 2025PEFA-AI: Advancing Open-source LLMs for RTL generation using Progressive Error Feedback Agentic-AI6 Nov 2025
- 2025VeriMoA: A Mixture-of-Agents Framework for Spec-to-HDL Generation31 Oct 2025
- 2025Large Language Model for Verilog Code Generation: Literature Review and the Road Ahead29 Oct 2025
- 2025DeepV: A Model-Agnostic Retrieval-Augmented Framework for Verilog Code Generation with a High-Quality Knowledge Base6 Oct 2025
- 2025Revolution or Hype? Seeking the Limits of Large Models in Hardware Design5 Sep 2025
- 2025Understanding and Mitigating Errors of LLM-Generated RTL Code7 Aug 2025
- 2025AnalogCoder-Pro: Unifying Analog Circuit Generation and Optimization via Multi-modal LLMs4 Aug 2025
- 2025A2H-MAS: An Algorithm-to-HLS Multi-Agent System for Automated and Reliable FPGA Implementation29 Jul 2025
- 2025FedChip: Federated LLM for Artificial Intelligence Accelerator Chip Design23 Jul 2025
- 2025MMCircuitEval: A Comprehensive Multimodal Circuit-Focused Benchmark for Evaluating LLMs20 Jul 2025
- 2025Evaluating LLM-based Workflows for Switched-Mode Power Supply Design14 Jul 2025
- 2025VerilogDB: The Largest, Highest-Quality Dataset with a Preprocessing Framework for LLM-based RTL Generation9 Jul 2025
- 2025Image2Net: Datasets, Benchmark and Hybrid Framework to Convert Analog Circuit Diagrams into Netlists27 Jun 2025
- 2025EvoVerilog: Large Langugage Model Assisted Evolution of Verilog Code26 Jun 2025
- 2025BugGen: A Self-Correcting Multi-Agent LLM Pipeline for Realistic RTL Bug Synthesis12 Jun 2025
- 2025QiMeng: Fully Automated Hardware and Software Design for Processor Chip5 Jun 2025
- 2025SALAD: Systematic Assessment of Machine Unlearning on LLM-Aided Hardware Design2 Jun 2025
- 2025ReChisel: Effective Automatic Chisel Code Generation by LLM with Reflection26 May 2025
- 2025Customizing a Large Language Model for VHDL Design of High-Performance Microprocessors14 May 2025
- 2025Free and Fair Hardware: A Pathway to Copyright Infringement-Free Verilog Generation using LLMs9 May 2025
- 2025RTLRepoCoder: Repository-Level RTL Code Completion through the Combination of Fine-Tuning and Retrieval Augmentation11 Apr 2025
- 2025BRIDGES: Bridging Graph Modality and Large Language Models within EDA Tasks7 Apr 2025
- 2025Enhancing Finite State Machine Design Automation with Large Language Models and Prompt Engineering Techniques26 Mar 2025
50 newest of 80 All 80 (JSON)
- 2025VeriMoA: A Mixture-of-Agents Framework for Spec-to-HDL Generationcited by 15
- 2025BugGen: A Self-Correcting Multi-Agent LLM Pipeline for Realistic RTL Bug Synthesiscited by 6
- 2026Agentic Hardware Design as Repository-Level Code Evolutioncited by 6
- 2025Using GUI Agent for Electronic Design Automationcited by 5
- 2026Veri-Sure: A Contract-Aware Multi-Agent Framework with Temporal Tracing and Formal Verification for Correct RTL Code Generationcited by 3
- 2026CODMAS: A Dialectic Multi-Agent Collaborative Framework for Structured RTL Optimizationcited by 2
- 2025A2H-MAS: An Algorithm-to-HLS Multi-Agent System for Automated and Reliable FPGA Implementationcited by 0
- 2025PEFA-AI: Advancing Open-source LLMs for RTL generation using Progressive Error Feedback Agentic-AIcited by 0
- 2025DUET: Agentic Design Understanding via Experimentation and Testingcited by 0
- 2025AMS-IO-Bench and AMS-IO-Agent: Benchmarking and Structured Reasoning for Analog and Mixed-Signal Integrated Circuit Input/Output Designcited by 0
- 2026ChipCraftBrain: Validation-First RTL Generation via Multi-Agent Orchestrationcited by 0
- 2026LACE: Large Language Model Aided Multi-Agent Framework for Agile RISC-V Instruction Extensioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026SeqFeed: Improving Agentic RTL Code Generation with Sequential Behavior Feedback9 Aug 2026
- 2026LACE: Large Language Model Aided Multi-Agent Framework for Agile RISC-V Instruction Extension3 Aug 2026
- 2026Agentic Hardware Design as Repository-Level Code Evolution26 Jun 2026
- 2026ChipCraftBrain: Validation-First RTL Generation via Multi-Agent Orchestration21 Apr 2026
- 2026CODMAS: A Dialectic Multi-Agent Collaborative Framework for Structured RTL Optimization17 Mar 2026
- 2026Veri-Sure: A Contract-Aware Multi-Agent Framework with Temporal Tracing and Formal Verification for Correct RTL Code Generation27 Jan 2026
- 2025AMS-IO-Bench and AMS-IO-Agent: Benchmarking and Structured Reasoning for Analog and Mixed-Signal Integrated Circuit Input/Output Design25 Dec 2025
- 2025Using GUI Agent for Electronic Design Automation12 Dec 2025
- 2025DUET: Agentic Design Understanding via Experimentation and Testing6 Dec 2025
- 2025PEFA-AI: Advancing Open-source LLMs for RTL generation using Progressive Error Feedback Agentic-AI6 Nov 2025
- 2025VeriMoA: A Mixture-of-Agents Framework for Spec-to-HDL Generation31 Oct 2025
- 2025A2H-MAS: An Algorithm-to-HLS Multi-Agent System for Automated and Reliable FPGA Implementation29 Jul 2025
12 newest of 13 All 13 (JSON)
- 2024PropertyGPT: LLM-driven Formal Verification of Smart Contracts through Retrieval-Augmented Property Generationcited by 36
- 2024Customized Retrieval Augmented Generation and Benchmarking for EDA Tool Documentation QAcited by 28
- 2025HDLCoRe: A Training-Free Framework for Mitigating Hallucinations in LLM-Generated HDLcited by 17
- 2025RTLRepoCoder: Repository-Level RTL Code Completion through the Combination of Fine-Tuning and Retrieval Augmentationcited by 7
- 2025DeepV: A Model-Agnostic Retrieval-Augmented Framework for Verilog Code Generation with a High-Quality Knowledge Basecited by 1
- 2026SecureRAG-RTL: A Retrieval-Augmented, Multi-Agent, Zero-Shot LLM-Driven Framework for Hardware Vulnerability Detectioncited by 0
- 2026SecureRAG-RTL: A Retrieval-Augmented, Multi-Agent, Zero-Shot LLM-Driven Framework for Hardware Vulnerability Detection5 Mar 2026
- 2025DeepV: A Model-Agnostic Retrieval-Augmented Framework for Verilog Code Generation with a High-Quality Knowledge Base6 Oct 2025
- 2025RTLRepoCoder: Repository-Level RTL Code Completion through the Combination of Fine-Tuning and Retrieval Augmentation11 Apr 2025
- 2025HDLCoRe: A Training-Free Framework for Mitigating Hallucinations in LLM-Generated HDL18 Mar 2025
- 2024Customized Retrieval Augmented Generation and Benchmarking for EDA Tool Documentation QA22 Jul 2024
- 2024PropertyGPT: LLM-driven Formal Verification of Smart Contracts through Retrieval-Augmented Property Generation4 May 2024
- 2025Can Reasoning Models Reason about Hardware? An Agentic HLS Perspectivecited by 9
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generationcited by 4
- 2026RTL-BenchLS: A Large-Scale Benchmark for RTL Reasoning and Generation with Large Language Modelscited by 1
- 2026R-APS: Compositional Reasoning and In-Context Meta-Learning for Constrained Design via Reflective Adversarial Pareto Searchcited by 0
- 2026RTL-BenchLS: A Large-Scale Benchmark for RTL Reasoning and Generation with Large Language Models8 Jun 2026
- 2026R-APS: Compositional Reasoning and In-Context Meta-Learning for Constrained Design via Reflective Adversarial Pareto Search3 Jun 2026
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generation12 Jan 2026
- 2025Can Reasoning Models Reason about Hardware? An Agentic HLS Perspective17 Mar 2025
- 2024AnalogCoder: Analog Circuit Design via Training-Free Code Generationcited by 82
- 2024OriGen:Enhancing RTL Code Generation with Code-to-Code Augmentation and Self-Reflectioncited by 56
- 2024Make Every Move Count: LLM-based High-Quality RTL Code Generation Using MCTScited by 42
- 2023LLM4EDA: Emerging Progress in Large Language Models for Electronic Design Automationcited by 40
- 2025A Survey of Research in Large Language Models for Electronic Design Automationcited by 38
- 2024AutoVCoder: A Systematic Framework for Automated Verilog Code Generation using LLMscited by 36
- 2025AnalogGenie: A Generative Engine for Automatic Discovery of Analog Circuit Topologiescited by 35
- 2024Rome was Not Built in a Single Step: Hierarchical Prompting for LLM-based Chip Designcited by 24
- 2024CreativEval: Evaluating Creativity of LLM-Based Hardware Code Generationcited by 19
- 2024PyraNet: A Multi-Layered Hierarchical Dataset for Verilogcited by 19
- 2024LLMs and the Future of Chip Design: Unveiling Security Risks and Building Trustcited by 18
- 2024Automatically Improving LLM-based Verilog Generation using EDA Tool Feedbackcited by 18
12 most cited of 53 All 53 (JSON)
- 2026LLMs in Digital EDA: A perspective on shifting roles from Generation to Orchestration27 Aug 2026
- 2026DRC-Aid: Design-Rule Correction via Agentic Framework utilizing Inference-Time Large Language Models23 Jul 2026
- 2026SINA: A Fully Automated Circuit Schematic Image to Netlist Generator Using Artificial Intelligence2 Jul 2026
- 2026VeriPilot: An LLM-Powered Verilog Debugging Framework22 Jun 2026
- 2026Interpretable and Verifiable Hardware Generation with LLM-Driven Stepwise Refinement16 Jun 2026
- 2026VHDLSuite: Unified Pipeline for LLM VHDL Generation with Data Synthesis and Evaluation11 Jun 2026
- 2026ROSUM-MCTS: Monte Carlo Tree Search-Inspired HDL Code Summarization with Structural Rewards6 Jun 2026
- 2026PICasso: An AI-Enabled Design Framework for Autonomous Optimization of Silicon Photonic Devices28 May 2026
- 2026LEGO: An LLM Skill-Based Front-End Design Generation Platform25 Apr 2026
- 2026GUIDE: GenAI Units In Digital Design Education18 Mar 2026
- 2025VeriDispatcher: Multi-Model Dispatching through Pre-Inference Difficulty Prediction for RTL Generation Optimization27 Nov 2025
- 2025Learning to Debug: LLM-Organized Knowledge Trees for Solving RTL Assertion Failures21 Nov 2025
12 newest of 53 All 53 (JSON)