ZhuLong: Execution-Grounded LLM Agent for EDA Scripting with Offline API Self-Exploration
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
EDA scripting with tool-specific, often undocumented APIs remains a long-tail bottleneck that existing LLMs fail to address. This paper presents ZhuLong, an execution-grounded LLM coding agent for PyAether and SKILL that combines API retrieval, documentation inspection, and sandbox execution via unified MCP tools, augmented by an offline API self-exploration mechanism that infers undocumented API behaviors through counterfactual experimentation. We evaluate ZhuLong on EDA-Eval-PyAether, a benchmark of 158 real-world tasks with assertion-based execution, where the complete system achieves 78.5% Pass@1 in the commercial Empyrean Aether environment, substantially outperforming a pure LLM baseline (23.6%). Ablation studies identify sandbox execution as the dominant performance driver (41.2 pp drop when removed), with the self-exploration mechanism contributing an additional 3.2 pp accuracy gain and a 22.1% reduction in per-task tool calls. On 20 interactive tasks involving unsaved layouts and schematics, ZhuLong achieves 60.0% Pass@1 for PyAether and 50.0% for SKILL.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 21 references that are in the map. First posted on arXiv 8 Aug 2026.
Builds on
9 of 21 references.
Closest ancestors · 2
Same direction, newest first
- 2026AgentForge: Execution-Grounded Multi-Agent LLM Framework for Autonomous Software Engineering13 Apr
- 2025AutoEDA: Enabling EDA Flow Automation through Microservice-Based LLM Agents1 Aug
Other references · 7
- 2017Attention Is All You Needcited by 60,361
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 200
- 2023RTLCoder: Outperforming GPT-3.5 in Design RTL Generation with Our Open-Source Dataset and Lightweight Solutioncited by 71
- 2024Customized Retrieval Augmented Generation and Benchmarking for EDA Tool Documentation QAcited by 28
- 2024LayoutCopilot: An LLM-powered Multi-agent Collaborative Framework for Interactive Analog Layout Designcited by 25
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025JARVIS: A Multi-Agent Code Assistant for High-Quality EDA Script Generation
- 2026ProcCtrlBench: Evaluating Process-Level Defects and Control Preservation in LLM Coding Agents
- 2025LoCoBench-Agent: An Interactive Benchmark for LLM Agents in Long-Context Software Engineering
- 2025Divergent Thoughts toward One Goal: LLM-based Multi-Agent Collaboration System for Electronic Design Automation
- 2026FluxEDA: A Unified Execution Infrastructure for Stateful Agentic EDA
- 2026Agent-Diff: Benchmarking LLM Agents on Enterprise API Tasks via Code Execution with State-Diff-Based Evaluation
- 2026A Large-Scale Empirical Study of Quality Assurance Practices and Gaps in AI Agents
- 2026Taming Scylla: Understanding the multi-headed agentic daemon of the coding seas