mlsanityData to 14 Oct 2026

ASIC-Agent: An Autonomous Multi-Agent System for ASIC Design with Benchmark Evaluation

arXiv 2508.15940 ↗First posted 21 Aug 2025cs.AR cs.AI cs.CLcited by 2

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Large Language Models (LLMs) have demonstrated remarkable capabilities in Register Transfer Level (RTL) design, enabling high-quality code generation from natural language descriptions. However, LLMs alone face significant limitations in real-world hardware design workflows, including the inability to execute code, lack of debugging capabilities, and absence of long-term memory. To address these challenges, we present ASIC-Agent, an autonomous system designed specifically for digital ASIC design tasks. ASIC-Agent enhances base LLMs with a multi-agent architecture incorporating specialized sub-agents for RTL generation, verification, OpenLane hardening, and Caravel chip integration, all operating within a comprehensive sandbox environment with access to essential hardware design tools. The system leverages a vector database containing documentation, API references, error knowledge, and curated insights from the open-source silicon community. To evaluate ASIC-Agent's performance, we introduce ASIC-Agent-Bench, the first benchmark specifically designed to assess agentic systems in hardware design tasks. We evaluate ASIC-Agent with various base LLMs, providing quantitative comparisons and qualitative insights into agent behavior across different design scenarios. Our results demonstrate that ASIC-Agent, when powered by Claude 4 Sonnet, successfully automates a broad range of ASIC design tasks spanning varying levels of complexity, showing the potential of significantly accelerating the ASIC design workflow.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 14 of its 28 references that are in the map. First posted on arXiv 21 Aug 2025.

Builds on

14 of 28 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024VerilogCoder: Autonomous Verilog Coding Agents with Graph-based Planning and Abstract Syntax Tree (AST)-based Waveform Tracing Tool15 Aug
  2. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
  4. 2024Executable Code Actions Elicit Better LLM Agents1 Feb

Other references · 10

  1. 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
  2. 2024StarCoder 2 and The Stack v2: The Next Generationcited by 502
  3. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
  4. 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 252
  5. 2024OpenCodeInterpreter: Integrating Code Generation with Execution and Refinementcited by 247
  6. 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 200
  7. 2023ChipNeMo: Domain-Adapted LLMs for Chip Designcited by 174
  8. 2023RTLLM: An Open-Source Benchmark for Design RTL Generation with Large Language Modelcited by 148
  9. 2024RTL-Repo: A Benchmark for Evaluating LLMs on Large-Scale RTL Design Projectscited by 26
  10. 2024Effective Design Verification -- Constrained Random with Python and Cocotbcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Can Agents Design Better Chips with a Higher Level Abstraction?
  2. 2025Comprehensive Verilog Design Problems: A Next-Generation Benchmark Dataset for Evaluating Large Language Models and Agents on RTL Design and Verification
  3. 2025DUET: Agentic Design Understanding via Experimentation and Testing
  4. 2026Back to the Future: Rethinking EDA Infrastructure for Agentic Systems in Chip Design Verification
  5. 2026VeriGraphi: A Multi-Agent Framework of Hierarchical RTL Generation for Large Hardware Designs
  6. 2026ACE-RTL: When Agentic Context Evolution Meets RTL-Specialized LLMs
  7. 2025RTLSquad: Multi-Agent Based Interpretable RTL Design
  8. 2025VeriMind: Agentic LLM for Automated Verilog Generation with a Novel Evaluation Metric