SGAnalog: An End-to-End Circuit Benchmark from Open-Source Silicon Tapeouts
Not on the map. Why?
Abstract (arXiv)
Existing analog integrated circuit design benchmarks make two questions hard to answer: whether a model has learned transferable circuit skills rather than recalled familiar examples, and whether its output works under defined process and test conditions. We introduce a benchmark built from human-designed, open-source circuits associated with Tiny Tapeout manufacturing shuttles. The collection contains 273 topologically distinct top-level designs. Every source is retrieved at the revision recorded for its shuttle submission and processed in a fixed containerized environment. The pipeline exports each eligible schematic image and its SPICE netlist from the same source file, giving transcription an exact structural reference. Commit dates support model-specific training-cutoff analysis, while author testbenches provide the simulation context for sizing. The benchmark evaluates schematic-to-netlist transcription and device sizing. Across seven models on a fixed set of 66 transcription tasks, the strongest model reaches 56.1% exact graph isomorphism, and six of seven models drop sharply from the small to the medium tier. For one frontier model, removing author-chosen labels reduces exact matches while preserving aggregate structural F1, suggesting that labels can aid connectivity tracing. On the 17 sizing tasks, the leading model converges on all 17 proposals and reaches 91.2 out of 100 against the human reference, while the two newest Claude models refuse 4 and 11 of the same prompts they transcribe without objection; a proposal without sizes scores zero. The two tasks produce different model rankings, exposing distinct visual and design capabilities and, in one family, a policy rather than capability limit.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 16 references that are in the map. First posted on arXiv 2 Oct 2026.
Builds on
10 of 16 references.
References · 10
- 2024AnalogCoder: Analog Circuit Design via Training-Free Code Generationcited by 84
- 2023CktGNN: Circuit Graph Neural Network for Electronic Design Automationcited by 58
- 2025AnalogGenie: A Generative Engine for Automatic Discovery of Analog Circuit Topologiescited by 37
- 2024AMSNet: Netlist Dataset for AMS Circuitscited by 25
- 2024Masala-CHAI: A Large-Scale SPICE Netlist Dataset for Analog Circuits by Harnessing AIcited by 18
- 2025AnalogCoder-Pro: Unifying Analog Circuit Generation and Optimization via Multi-modal LLMscited by 15
- 2024AICircuit: A Multi-Level Dataset and Benchmark for AI-Driven Analog Integrated Circuit Designcited by 9
- 2024AnalogGym: An Open and Practical Testing Suite for Analog Circuit Synthesiscited by 9
- 2025NotSoTiny: A Large, Living Benchmark for RTL Code Generationcited by 4
- 2026OSIRIS: Bridging Analog Circuit Design and Machine Learning with Scalable Dataset Generationcited by 3
Built on by
Not cited yet.