VerilogCoder: Autonomous Verilog Coding Agents with Graph-based Planning and Abstract Syntax Tree (AST)-based Waveform Tracing Tool
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Due to the growing complexity of modern Integrated Circuits (ICs), automating hardware design can prevent a significant amount of human error from the engineering process and result in less errors. Verilog is a popular hardware description language for designing and modeling digital systems; thus, Verilog generation is one of the emerging areas of research to facilitate the design process. In this work, we propose VerilogCoder, a system of multiple Artificial Intelligence (AI) agents for Verilog code generation, to autonomously write Verilog code and fix syntax and functional errors using collaborative Verilog tools (i.e., syntax checker, simulator, and waveform tracer). Firstly, we propose a task planner that utilizes a novel Task and Circuit Relation Graph retrieval method to construct a holistic plan based on module descriptions. To debug and fix functional errors, we develop a novel and efficient abstract syntax tree (AST)-based waveform tracing tool, which is integrated within the autonomous Verilog completion flow. The proposed methodology successfully generates 94.2% syntactically and functionally correct Verilog code, surpassing the state-of-the-art methods by 33.9% on the VerilogEval-Human v2 benchmark.
Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 22 references that are in the map. First posted on arXiv 15 Aug 2024.
Builds on
11 of 22 references.
Closest ancestors · 1
Same direction, newest first
Other references · 10
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 197
- 2023CodePlan: Repository-level Coding using LLMs and Planningcited by 139
- 2023CodeGen2: Lessons for Training LLMs on Programming and Natural Languagescited by 124
- 2024BetterV: Controlled Verilog Generation with Discriminative Guidancecited by 99
- 2023RTLCoder: Outperforming GPT-3.5 in Design RTL Generation with Our Open-Source Dataset and Lightweight Solutioncited by 69
- 2023CodeTF: One-stop Transformer Library for State-of-the-art Code LLMscited by 21
Built on by
Citing papers per year: 2024: 7; 2025: 36; 2026: 42.
85 papers.
Sort:
By area:
- 2024Revisiting VerilogEval: A Year of Improvements in Large-Language Models for Hardware Code Generationcited by 45
- 2025Comprehensive Verilog Design Problems: A Next-Generation Benchmark Dataset for Evaluating Large Language Models and Agents on RTL Design and Verificationcited by 41
- 2025A Survey of Research in Large Language Models for Electronic Design Automationcited by 38
- 2025Large Language Models for Planning: A Comprehensive and Systematic Surveycited by 38
- 2024MAGE: A Multi-Agent Engine for Automated RTL Code Generationcited by 31
- 2025ScaleRTL: Scaling LLMs with Reasoning Data and Test-Time Compute for Accurate RTL Code Generationcited by 22
- 2025VFlow: Discovering Optimal Agentic Workflows for Verilog Generationcited by 19
- 2024AIvril: AI-Driven RTL Generation With Verification In-The-Loopcited by 15
- 2024DRC-Coder: Automated DRC Checker Code Generation Using LLM Autonomous Agentcited by 15
- 2025Insights from Verification: Training a Verilog Generation LLM with Reinforcement Learning with Testbench Feedbackcited by 14
- 2025RealBench: Benchmarking Verilog Generation Models with Real-World IP Designscited by 14
- 2025ReasoningV: Efficient Verilog Code Generation with Adaptive Hybrid Reasoning Modelcited by 12
38 more
- 2026ACE-RTL: When Agentic Context Evolution Meets RTL-Specialized LLMscited by 12
- 2026MemPO: Self-Memory Policy Optimization for Long-Horizon Agentscited by 11
- 2024CoopetitiveV: Leveraging LLM-powered Coopetitive Multi-Agent Prompting for High-quality Verilog Generationcited by 9
- 2025QAgent: An LLM-based Multi-Agent System for Autonomous OpenQASM programmingcited by 9
- 2025Revolution or Hype? Seeking the Limits of Large Models in Hardware Designcited by 9
- 2025Understanding and Mitigating Errors of LLM-Generated RTL Codecited by 8
- 2025LLM-DSE: Searching Accelerator Parameters with LLM Agentscited by 7
- 2025Large Language Model for Verilog Code Generation: Literature Review and the Road Aheadcited by 7
- 2026EvolVE: Evolutionary Search for LLM-based Verilog Generation and Optimizationcited by 7
- 2026ChipBench: A Next-Step Benchmark for Evaluating LLM Performance in AI-Aided Chip Designcited by 7
- 2024Does Few-Shot Learning Help LLM Performance in Code Synthesis?cited by 6
- 2026Agentic Hardware Design as Repository-Level Code Evolutioncited by 6
- 2025ReChisel: Effective Automatic Chisel Code Generation by LLM with Reflectioncited by 5
- 2025ChipSeek: Optimizing Verilog Generation via EDA-Integrated Reinforcement Learningcited by 5
- 2025LLM-VeriPPA: Power, Performance, and Area Optimization aware Verilog Code Generation with Large Language Modelscited by 5
- 2025Nexus: A Lightweight and Scalable Multi-Agent Framework for Complex Tasks Automationcited by 4
- 2025REvolution: An Evolutionary Framework for RTL Generation driven by Large Language Modelscited by 4
- 2025VFocus: Better Verilog Generation from Large Language Model via Focused Reasoningcited by 4
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generationcited by 4
- 2026LLM4Cov: Execution-Aware Agentic Learning for High-coverage Testbench Generationcited by 4
- 2026SiliconMind-V1: Multi-Agent Distillation and Debug-Reasoning Workflows for Verilog Code Generationcited by 4
- 2026VeriAgent: A Tool-Integrated Multi-Agent System with Evolving Memory for PPA-Aware RTL Code Generationcited by 4
- 2025TB or Not TB: Coverage-Driven Direct Preference Optimization for Verilog Stimulus Generationcited by 3
- 2026Veri-Sure: A Contract-Aware Multi-Agent Framework with Temporal Tracing and Formal Verification for Correct RTL Code Generationcited by 3
- 2026COEVO: Co-Evolutionary Framework for Joint Functional Correctness and PPA Optimization in LLM-Based RTL Generationcited by 3
- 2026Trace2Skill: Verifier-Guided Skill Evolution for Long-Context EDA Agentscited by 3
- 2025Symmetrization Weighted Binary Cross-Entropy: Modeling Perceptual Asymmetry for Human-Consistent Neural Edge Detectioncited by 2
- 2025Timing Analysis Agent: Autonomous Multi-Corner Multi-Mode (MCMM) Timing Debugging with Timing Debug Relation Graphcited by 2
- 2025hdl2v: A Code Translation Dataset for Enhanced LLM Verilog Generationcited by 2
- 2025SecFSM: Knowledge Graph-Guided Verilog Code Generation for Secure Finite State Machines in Systems-on-Chipcited by 2
- 2025ASIC-Agent: An Autonomous Multi-Agent System for ASIC Design with Benchmark Evaluationcited by 2
- 2025GENIE-ASI: Generative Instruction and Executable Code for Analog Subcircuit Identificationcited by 2
- 2026CODMAS: A Dialectic Multi-Agent Collaborative Framework for Structured RTL Optimizationcited by 2
- 2026LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Reviewcited by 2
- 2026RTL-BenchMT: Dynamic Maintenance of RTL Generation Benchmark Through Agent-Assisted Analysis and Revisioncited by 2
- 2025Polymath: A Self-Optimizing Agent with Dynamic Hierarchical Workflowcited by 1
- 2025CRADLE: Conversational RTL Design Space Exploration with LLM-based Multi-Agent Systemscited by 1
- 2025The Cream Rises to the Top: Efficient Reranking Method for Verilog Code Generationcited by 1
50 most cited of 85 All 85 (JSON)
- 2026Can Agents Design Better Chips with a Higher Level Abstraction?17 Sep 2026
- 2026LLMs in Digital EDA: A perspective on shifting roles from Generation to Orchestration27 Aug 2026
- 2026CHORUS: Complementary Experts for High-Coverage Testbench Stimulus Generation10 Aug 2026
- 2026QuantumMind: Constraint-Grounded Agentic Reasoning for Speedup Analysis in Quantum Computing7 Aug 2026
- 2026VeriTrace: Human-Like Temporal Exploration Completes Agentic Action Space3 Aug 2026
- 2026SCALE: Self-Supervised Constraint-Aware Layout GEneration for Local P&R DRV Fixing at Advanced Nodes23 Jul 2026
- 2026When LLMs Over-Answer: Measuring and Mitigating Quality Issues in LLM-Based Hardware Description Language Question Answering19 Jul 2026
- 2026PCBWorld: A Benchmark Environment for Engine-Grounded PCB Design Automation7 Jul 2026
- 2026Agentic Hardware Design as Repository-Level Code Evolution26 Jun 2026
- 2026VeriPilot: An LLM-Powered Verilog Debugging Framework22 Jun 2026
- 2026Agentic Electronic Design Automation: A Handoff Perspective18 Jun 2026
- 2026Interpretable and Verifiable Hardware Generation with LLM-Driven Stepwise Refinement16 Jun 2026
38 more
- 2026RTL-BenchLS: A Large-Scale Benchmark for RTL Reasoning and Generation with Large Language Models8 Jun 2026
- 2026Trace2Skill: Verifier-Guided Skill Evolution for Long-Context EDA Agents20 May 2026
- 2026RTL-BenchMT: Dynamic Maintenance of RTL Generation Benchmark Through Agent-Assisted Analysis and Revision15 May 2026
- 2026Are Agents Ready to Teach? A Multi-Stage Benchmark for Real-World Teaching Workflows14 May 2026
- 2026ChipMATE: Multi-Agent Training via Reinforcement Learning for Enhanced RTL Generation13 May 2026
- 2026DiagramNet: An End-to-End Recognition Framework and Dataset for Non-Standard System-Level Diagrams2 May 2026
- 2026LEGO: An LLM Skill-Based Front-End Design Generation Platform25 Apr 2026
- 2026ChipCraftBrain: Validation-First RTL Generation via Multi-Agent Orchestration21 Apr 2026
- 2026AutoPPA: Automated Circuit PPA Optimization via Contrastive Code-based Rule Library Learning20 Apr 2026
- 2026COEVO: Co-Evolutionary Framework for Joint Functional Correctness and PPA Optimization in LLM-Based RTL Generation16 Apr 2026
- 2026QiMeng-PRepair: Precise Code Repair via Edit-Aware Reward Optimization7 Apr 2026
- 2026IncreRTL: Traceability-Guided Incremental RTL Generation under Requirement Evolution26 Mar 2026
- 2026UCAgent: An End-to-End Agent for Block-Level Functional Verification26 Mar 2026
- 2026VeriAgent: A Tool-Integrated Multi-Agent System with Evolving Memory for PPA-Aware RTL Code Generation18 Mar 2026
- 2026SYMDIREC: A Neuro-Symbolic Divide-Retrieve-Conquer Framework for Enhanced RTL Synthesis and Summarization17 Mar 2026
- 2026CODMAS: A Dialectic Multi-Agent Collaborative Framework for Structured RTL Optimization17 Mar 2026
- 2026GNNVerifier: Graph-based Verifier for LLM Task Planning16 Mar 2026
- 2026ChatNeuroSim: An LLM Agent Framework for Automated Compute-in-Memory Accelerator Deployment and Optimization4 Mar 2026
- 2026MemPO: Self-Memory Policy Optimization for Long-Horizon Agents28 Feb 2026
- 2026LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Review25 Feb 2026
- 2026Unseen-Codebases-Domain Data Synthesis and Training Based on Code Graphs24 Feb 2026
- 2026LLM4Cov: Execution-Aware Agentic Learning for High-coverage Testbench Generation18 Feb 2026
- 2026SiliconMind-V1: Multi-Agent Distillation and Debug-Reasoning Workflows for Verilog Code Generation10 Feb 2026
- 2026ACE-RTL: When Agentic Context Evolution Meets RTL-Specialized LLMs10 Feb 2026
- 2026QiMeng-ChipV-RTL: Exploiting Information Locality for IP-level Verilog Generation31 Jan 2026
- 2026ChipBench: A Next-Step Benchmark for Evaluating LLM Performance in AI-Aided Chip Design29 Jan 2026
- 2026Veri-Sure: A Contract-Aware Multi-Agent Framework with Temporal Tracing and Formal Verification for Correct RTL Code Generation27 Jan 2026
- 2026EvolVE: Evolutionary Search for LLM-based Verilog Generation and Optimization26 Jan 2026
- 2026Report for NSF Workshop on AI for Electronic Design Automation20 Jan 2026
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generation12 Jan 2026
- 2025AutoFSM: A Multi-agent Framework for FSM Code Generation with IR and SystemC-Based Testing12 Dec 2025
- 2025DUET: Agentic Design Understanding via Experimentation and Testing6 Dec 2025
- 2025Learning to Debug: LLM-Organized Knowledge Trees for Solving RTL Assertion Failures21 Nov 2025
- 2025TB or Not TB: Coverage-Driven Direct Preference Optimization for Verilog Stimulus Generation19 Nov 2025
- 2025Automating Hardware Design and Verification from Architectural Papers via a Neural-Symbolic Graph Framework8 Nov 2025
- 2025PEFA-AI: Advancing Open-source LLMs for RTL generation using Progressive Error Feedback Agentic-AI6 Nov 2025
- 2025VFocus: Better Verilog Generation from Large Language Model via Focused Reasoning4 Nov 2025
- 2025Large Language Model for Verilog Code Generation: Literature Review and the Road Ahead29 Oct 2025
50 newest of 85 All 85 (JSON)
- 2025Comprehensive Verilog Design Problems: A Next-Generation Benchmark Dataset for Evaluating Large Language Models and Agents on RTL Design and Verificationcited by 41
- 2024MAGE: A Multi-Agent Engine for Automated RTL Code Generationcited by 31
- 2025VFlow: Discovering Optimal Agentic Workflows for Verilog Generationcited by 19
- 2026ACE-RTL: When Agentic Context Evolution Meets RTL-Specialized LLMscited by 12
- 2024CoopetitiveV: Leveraging LLM-powered Coopetitive Multi-Agent Prompting for High-quality Verilog Generationcited by 9
- 2025QAgent: An LLM-based Multi-Agent System for Autonomous OpenQASM programmingcited by 9
- 2025LLM-DSE: Searching Accelerator Parameters with LLM Agentscited by 7
- 2026Agentic Hardware Design as Repository-Level Code Evolutioncited by 6
- 2026LLM4Cov: Execution-Aware Agentic Learning for High-coverage Testbench Generationcited by 4
- 2026VeriAgent: A Tool-Integrated Multi-Agent System with Evolving Memory for PPA-Aware RTL Code Generationcited by 4
- 2026Veri-Sure: A Contract-Aware Multi-Agent Framework with Temporal Tracing and Formal Verification for Correct RTL Code Generationcited by 3
- 2026Trace2Skill: Verifier-Guided Skill Evolution for Long-Context EDA Agentscited by 3
12 most cited of 29 All 29 (JSON)
- 2026Can Agents Design Better Chips with a Higher Level Abstraction?17 Sep 2026
- 2026QuantumMind: Constraint-Grounded Agentic Reasoning for Speedup Analysis in Quantum Computing7 Aug 2026
- 2026VeriTrace: Human-Like Temporal Exploration Completes Agentic Action Space3 Aug 2026
- 2026Agentic Hardware Design as Repository-Level Code Evolution26 Jun 2026
- 2026Agentic Electronic Design Automation: A Handoff Perspective18 Jun 2026
- 2026Trace2Skill: Verifier-Guided Skill Evolution for Long-Context EDA Agents20 May 2026
- 2026RTL-BenchMT: Dynamic Maintenance of RTL Generation Benchmark Through Agent-Assisted Analysis and Revision15 May 2026
- 2026ChipMATE: Multi-Agent Training via Reinforcement Learning for Enhanced RTL Generation13 May 2026
- 2026ChipCraftBrain: Validation-First RTL Generation via Multi-Agent Orchestration21 Apr 2026
- 2026UCAgent: An End-to-End Agent for Block-Level Functional Verification26 Mar 2026
- 2026VeriAgent: A Tool-Integrated Multi-Agent System with Evolving Memory for PPA-Aware RTL Code Generation18 Mar 2026
- 2026CODMAS: A Dialectic Multi-Agent Collaborative Framework for Structured RTL Optimization17 Mar 2026
12 newest of 29 All 29 (JSON)
- 2025Large Language Models for Planning: A Comprehensive and Systematic Surveycited by 38
- 2025ScaleRTL: Scaling LLMs with Reasoning Data and Test-Time Compute for Accurate RTL Code Generationcited by 22
- 2025ReasoningV: Efficient Verilog Code Generation with Adaptive Hybrid Reasoning Modelcited by 12
- 2024Does Few-Shot Learning Help LLM Performance in Code Synthesis?cited by 6
- 2025Nexus: A Lightweight and Scalable Multi-Agent Framework for Complex Tasks Automationcited by 4
- 2025VFocus: Better Verilog Generation from Large Language Model via Focused Reasoningcited by 4
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generationcited by 4
- 2026SiliconMind-V1: Multi-Agent Distillation and Debug-Reasoning Workflows for Verilog Code Generationcited by 4
- 2026RTL-BenchLS: A Large-Scale Benchmark for RTL Reasoning and Generation with Large Language Modelscited by 1
- 2026RTL-BenchLS: A Large-Scale Benchmark for RTL Reasoning and Generation with Large Language Models8 Jun 2026
- 2026SiliconMind-V1: Multi-Agent Distillation and Debug-Reasoning Workflows for Verilog Code Generation10 Feb 2026
- 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generation12 Jan 2026
- 2025VFocus: Better Verilog Generation from Large Language Model via Focused Reasoning4 Nov 2025
- 2025ScaleRTL: Scaling LLMs with Reasoning Data and Test-Time Compute for Accurate RTL Code Generation5 Jun 2025
- 2025Large Language Models for Planning: A Comprehensive and Systematic Survey26 May 2025
- 2025ReasoningV: Efficient Verilog Code Generation with Adaptive Hybrid Reasoning Model20 Apr 2025
- 2025Nexus: A Lightweight and Scalable Multi-Agent Framework for Complex Tasks Automation26 Feb 2025
- 2024Does Few-Shot Learning Help LLM Performance in Code Synthesis?3 Dec 2024
- 2024Revisiting VerilogEval: A Year of Improvements in Large-Language Models for Hardware Code Generationcited by 45
- 2025A Survey of Research in Large Language Models for Electronic Design Automationcited by 38
- 2024AIvril: AI-Driven RTL Generation With Verification In-The-Loopcited by 15
- 2024DRC-Coder: Automated DRC Checker Code Generation Using LLM Autonomous Agentcited by 15
- 2025RealBench: Benchmarking Verilog Generation Models with Real-World IP Designscited by 14
- 2026MemPO: Self-Memory Policy Optimization for Long-Horizon Agentscited by 11
- 2025Revolution or Hype? Seeking the Limits of Large Models in Hardware Designcited by 9
- 2025Understanding and Mitigating Errors of LLM-Generated RTL Codecited by 8
- 2025Large Language Model for Verilog Code Generation: Literature Review and the Road Aheadcited by 7
- 2026EvolVE: Evolutionary Search for LLM-based Verilog Generation and Optimizationcited by 7
- 2026ChipBench: A Next-Step Benchmark for Evaluating LLM Performance in AI-Aided Chip Designcited by 7
- 2025ReChisel: Effective Automatic Chisel Code Generation by LLM with Reflectioncited by 5
12 most cited of 44 All 44 (JSON)
- 2026LLMs in Digital EDA: A perspective on shifting roles from Generation to Orchestration27 Aug 2026
- 2026CHORUS: Complementary Experts for High-Coverage Testbench Stimulus Generation10 Aug 2026
- 2026SCALE: Self-Supervised Constraint-Aware Layout GEneration for Local P&R DRV Fixing at Advanced Nodes23 Jul 2026
- 2026When LLMs Over-Answer: Measuring and Mitigating Quality Issues in LLM-Based Hardware Description Language Question Answering19 Jul 2026
- 2026PCBWorld: A Benchmark Environment for Engine-Grounded PCB Design Automation7 Jul 2026
- 2026VeriPilot: An LLM-Powered Verilog Debugging Framework22 Jun 2026
- 2026Interpretable and Verifiable Hardware Generation with LLM-Driven Stepwise Refinement16 Jun 2026
- 2026Are Agents Ready to Teach? A Multi-Stage Benchmark for Real-World Teaching Workflows14 May 2026
- 2026DiagramNet: An End-to-End Recognition Framework and Dataset for Non-Standard System-Level Diagrams2 May 2026
- 2026LEGO: An LLM Skill-Based Front-End Design Generation Platform25 Apr 2026
- 2026AutoPPA: Automated Circuit PPA Optimization via Contrastive Code-based Rule Library Learning20 Apr 2026
- 2026COEVO: Co-Evolutionary Framework for Joint Functional Correctness and PPA Optimization in LLM-Based RTL Generation16 Apr 2026
12 newest of 44 All 44 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025VeriMind: Agentic LLM for Automated Verilog Generation with a Novel Evaluation Metric
- 2025QiMeng-SALV: Signal-Aware Learning for Verilog Code Generation
- 2026VeriGraphi: A Multi-Agent Framework of Hierarchical RTL Generation for Large Hardware Designs
- 2025EvoVerilog: Large Langugage Model Assisted Evolution of Verilog Code
- 2026Exploring the Agentic Frontier of Verilog Code Generation
- 2026From Mirage to Grounding: Towards Reliable Multimodal Circuit-to-Verilog Code Generation
- 2025AnalogCoder-Pro: Unifying Analog Circuit Generation and Optimization via Multi-modal LLMs
- 2024MetRex: A Benchmark for Verilog Code Metric Reasoning Using LLMs