mlsanityData to 14 Oct 2026

Structured Testbench Generation for LLM-Driven HDL Design and Verification-Oriented Data Curation

arXiv 2606.12983 ↗First posted 11 Jun 2026cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Automated testbench generation has become a critical bottleneck in large language model (LLM)-driven Register Transfer Level (RTL) workflows, where large numbers of candidate designs must be verified rapidly and reliably. Existing prompt-based approaches treat testbench generation as unconstrained code synthesis, yielding stochastic outputs with high token cost, low reproducibility, and insufficient coverage. To address this gap, we present STG, a Structured Testbench Generation framework that exploits the inherent structure of hardware designs to generate deterministic testbenches. As a direct verification tool, STG runs 720x faster than an iterative LLM-based testbench generation flow and higher rate of successful compilation, achieves higher coverage, and reduces false-pass verdicts on incorrect DUTs. STG also helps identify errors in RTL generation benchmarks by exposing faulty benchmark testbenches. As a data curation engine, it is 11x faster than LLM-based filtering on a single CPU core with 127x less energy, and the resulting distilled models provide state-of-the-art performance in our multi-benchmark evaluation. As a test-time scaling oracle, it reduces node count by 14-47%. Our models are available at https://huggingface.co/collections/AS-SiliconMind/siliconmind-v12.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 10 of its 22 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

10 of 22 references.

References · 10

  1. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,653
  2. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  3. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
  4. 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 252
  5. 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
  6. 2024Revisiting VerilogEval: A Year of Improvements in Large-Language Models for Hardware Code Generationcited by 45
  7. 2025QiMeng-CodeV-R1: Reasoning-Enhanced Verilog Generationcited by 35
  8. 2024CorrectBench: Automatic Testbench Generation with Functional Self-Correction using LLMs for HDL Designcited by 24
  9. 2025ScaleRTL: Scaling LLMs with Reasoning Data and Test-Time Compute for Accurate RTL Code Generationcited by 22
  10. 2025VFlow: Discovering Optimal Agentic Workflows for Verilog Generationcited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026VHDLSuite: Unified Pipeline for LLM VHDL Generation with Data Synthesis and Evaluation
  2. 2025Faver: Boosting LLM-based RTL Generation with Function Abstracted Verifiable Middleware
  3. 2026RTL-BenchLS: A Large-Scale Benchmark for RTL Reasoning and Generation with Large Language Models
  4. 2026HierSVA: A Data Synthesis Pipeline, Dataset, and Benchmark for LLM-Driven Hierarchical Hardware Formal Verification
  5. 2026LLM-FSM: Scaling Large Language Models for Finite-State Reasoning in RTL Code Generation
  6. 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generation
  7. 2025AssertCoder: LLM-Based Assertion Generation via Multimodal Specification Extraction
  8. 2026LLM4RTL: Tool-Assisted LLM for RTL Generation