Can AI Agents Really Complete RTL-to-GDS? Lessons from Benchmarking Tool-Interactive EDA Workflows
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Large language model (LLM) agents are extending electronic design automation (EDA) beyond static RTL generation toward long-horizon, tool-interactive workflows. Yet it remains unclear whether general-purpose coding agents, even with domain-specific EDA skills, can reliably execute an end-to-end RTL-to-GDS flow encompassing synthesis, physical implementation, and engineering change order (ECO) optimization. We evaluate AI agents on a PicoRV32 RTL-to-GDS flow using commercial EDA tools under two timing targets. Their performance is assessed using end-to-end design score, stage completion, and Token ROI, a cost-efficiency metric relating design quality to runtime and cost. Comparing three agent architectures and four foundation models, we derive three practical lessons. First, domain-specific skills improve agents' understanding of individual subtasks but do not ensure reliable completion of a long-horizon EDA flow. Second, agents that achieve similar design progress can still differ by up to 141 times in Token ROI, revealing substantial differences in runtime and cost efficiency. Third, low-level tool-interface mismatches are a major source of physical design failures, particularly when Tcl commands depend on the tool version or execution mode. These results suggest that robust Agentic EDA requires not only stronger models but also structured tool interfaces, persistent design context, controlled execution, and process-level evaluation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 7 of its 13 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
7 of 13 references.
Closest ancestors · 3
Same direction, newest first
- 2025AutoEDA: Enabling EDA Flow Automation through Microservice-Based LLM Agents1 Aug
- 2025Divergent Thoughts toward One Goal: LLM-based Multi-Agent Collaboration System for Electronic Design Automation15 Feb
- 2023ChatEDA: A Large Language Model Powered Autonomous Agent for EDA20 Aug
Other references · 4
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 252
- 2023LLM4EDA: Emerging Progress in Large Language Models for Electronic Design Automationcited by 40
- 2026Design Conductor: An agent autonomously builds a 1.5 GHz Linux-capable RISC-V CPUcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Automated Multi-Agent Workflows for RTL Design
- 2025PEFA-AI: Advancing Open-source LLMs for RTL generation using Progressive Error Feedback Agentic-AI
- 2025JARVIS: A Multi-Agent Code Assistant for High-Quality EDA Script Generation
- 2026LLM for EDA in Front-End Design: Challenges and Opportunities
- 2025TuRTLe: A Unified Evaluation of LLMs for RTL Generation
- 2024EDA-Aware RTL Generation with Large Language Models
- 2026CODMAS: A Dialectic Multi-Agent Collaborative Framework for Structured RTL Optimization
- 2026Dr. RTL: Autonomous Agentic RTL Optimization through Tool-Grounded Self-Improvement