mlsanityData to 14 Oct 2026

ZhuLong: Execution-Grounded LLM Agent for EDA Scripting with Offline API Self-Exploration

arXiv 2608.07925 ↗First posted 8 Aug 2026cs.AIcited by 1

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

EDA scripting with tool-specific, often undocumented APIs remains a long-tail bottleneck that existing LLMs fail to address. This paper presents ZhuLong, an execution-grounded LLM coding agent for PyAether and SKILL that combines API retrieval, documentation inspection, and sandbox execution via unified MCP tools, augmented by an offline API self-exploration mechanism that infers undocumented API behaviors through counterfactual experimentation. We evaluate ZhuLong on EDA-Eval-PyAether, a benchmark of 158 real-world tasks with assertion-based execution, where the complete system achieves 78.5% Pass@1 in the commercial Empyrean Aether environment, substantially outperforming a pure LLM baseline (23.6%). Ablation studies identify sandbox execution as the dominant performance driver (41.2 pp drop when removed), with the self-exploration mechanism contributing an additional 3.2 pp accuracy gain and a 22.1% reduction in per-task tool calls. On 20 interactive tasks involving unsaved layouts and schematics, ZhuLong achieves 60.0% Pass@1 for PyAether and 50.0% for SKILL.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 21 references that are in the map. First posted on arXiv 8 Aug 2026.

Builds on

9 of 21 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026AgentForge: Execution-Grounded Multi-Agent LLM Framework for Autonomous Software Engineering13 Apr
  2. 2025AutoEDA: Enabling EDA Flow Automation through Microservice-Based LLM Agents1 Aug

Other references · 7

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Program Synthesis with Large Language Modelscited by 3,637
  3. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  4. 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 200
  5. 2023RTLCoder: Outperforming GPT-3.5 in Design RTL Generation with Our Open-Source Dataset and Lightweight Solutioncited by 71
  6. 2024Customized Retrieval Augmented Generation and Benchmarking for EDA Tool Documentation QAcited by 28
  7. 2024LayoutCopilot: An LLM-powered Multi-agent Collaborative Framework for Interactive Analog Layout Designcited by 25

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025JARVIS: A Multi-Agent Code Assistant for High-Quality EDA Script Generation
  2. 2026ProcCtrlBench: Evaluating Process-Level Defects and Control Preservation in LLM Coding Agents
  3. 2025LoCoBench-Agent: An Interactive Benchmark for LLM Agents in Long-Context Software Engineering
  4. 2025Divergent Thoughts toward One Goal: LLM-based Multi-Agent Collaboration System for Electronic Design Automation
  5. 2026FluxEDA: A Unified Execution Infrastructure for Stateful Agentic EDA
  6. 2026Agent-Diff: Benchmarking LLM Agents on Enterprise API Tasks via Code Execution with State-Diff-Based Evaluation
  7. 2026A Large-Scale Empirical Study of Quality Assurance Practices and Gaps in AI Agents
  8. 2026Taming Scylla: Understanding the multi-headed agentic daemon of the coding seas